| Equivalence Matching Results for NCIT-DOID (Disease) |
| |
Unsupervised (No Train Maps) |
Semi-supervised (Optional 30% Train Maps) |
| ⇕System |
⇕Precision |
⇕Recall |
⇕F-score |
⇕MRR |
⇕Hits@1 |
⇕Use Train Maps |
⇕Precision |
⇕Recall |
⇕F-score |
⇕MRR |
⇕Hits@1 |
| BERTMap‡ |
0.888 |
0.878 |
0.883 |
0.959 |
0.937 |
✔ |
0.831 |
0.883 |
0.856 |
0.960 |
0.938 |
| BERTMapLt‡ |
0.919 |
0.772 |
0.839 |
0.890 |
0.861 |
✘ |
0.888 |
0.770 |
0.825 |
0.890 |
0.861 |
| BioGITOM∗ |
|
|
|
|
|
✔ |
0.944 |
0.884 |
0.913 |
|
|
| BioSTransMatch∗ |
0.657 |
0.833 |
0.735 |
0.900 |
0.865 |
✔ |
0.698 |
0.741 |
0.719 |
0.906 |
0.872 |
| HybridOM∗ |
0.924 |
0.913 |
0.918 |
0.952 |
0.928 |
✘ |
0.895 |
0.913 |
0.904 |
0.952 |
0.928 |
| LogMap† |
0.934 |
0.668 |
0.779 |
|
|
✘ |
0.908 |
0.664 |
0.767 |
|
|
| LogMapBio† |
0.860 |
0.962 |
0.908 |
|
|
✘ |
0.811 |
0.959 |
0.879 |
|
|
| LogMapLt† |
0.983 |
0.575 |
0.725 |
|
|
✘ |
0.976 |
0.575 |
0.723 |
|
|
| Matcha† |
0.882 |
0.756 |
0.814 |
0.902 |
0.873 |
✘ |
0.839 |
0.750 |
0.792 |
0.902 |
0.873 |