| Equivalence Matching Results for OMIM-ORDO (Disease) |
| |
Unsupervised (No Train Maps) |
Semi-supervised (Optional 30% Train Maps) |
| ⇕System |
⇕Precision |
⇕Recall |
⇕F-score |
⇕MRR |
⇕Hits@1 |
⇕Use Train Maps |
⇕Precision |
⇕Recall |
⇕F-score |
⇕MRR |
⇕Hits@1 |
| BERTMap‡ |
0.734 |
0.576 |
0.646 |
0.880 |
0.830 |
✔ |
0.645 |
0.592 |
0.617 |
0.891 |
0.841 |
| BERTMapLt‡ |
0.834 |
0.497 |
0.623 |
0.766 |
0.716 |
✘ |
0.782 |
0.507 |
0.615 |
0.766 |
0.716 |
| BioGITOM∗ |
|
|
|
|
|
✔ |
0.951 |
0.773 |
0.853 |
|
|
| BioSTransMatch∗ |
0.312 |
0.586 |
0.407 |
0.741 |
0.683 |
✔ |
0.973 |
0.278 |
0.432 |
0.737 |
0.672 |
| HybridOM∗ |
0.690 |
0.679 |
0.685 |
0.849 |
0.792 |
✘ |
0.611 |
0.683 |
0.645 |
0.849 |
0.792 |
| LogMap† |
0.876 |
0.448 |
0.593 |
|
|
✘ |
0.834 |
0.456 |
0.589 |
|
|
| LogMapBio† |
0.866 |
0.609 |
0.715 |
|
|
✘ |
0.821 |
0.614 |
0.703 |
|
|
| LogMapLt† |
0.940 |
0.252 |
0.397 |
|
|
✘ |
0.919 |
0.261 |
0.407 |
|
|
| Matcha† |
0.781 |
0.509 |
0.617 |
0.815 |
0.782 |
✘ |
0.718 |
0.519 |
0.602 |
0.815 |
0.782 |