| Equivalence Matching Results for SNOMED-NCIT (Pharm) |
| |
Unsupervised (No Train Maps) |
Semi-supervised (Optional 30% Train Maps) |
| ⇕System |
⇕Precision |
⇕Recall |
⇕F-score |
⇕MRR |
⇕Hits@1 |
⇕Use Train Maps |
⇕Precision |
⇕Recall |
⇕F-score |
⇕MRR |
⇕Hits@1 |
| BERTMap‡ |
0.971 |
0.585 |
0.730 |
0.969 |
0.951 |
✔ |
0.898 |
0.715 |
0.796 |
0.971 |
0.953 |
| BERTMapLt‡ |
0.981 |
0.574 |
0.724 |
0.849 |
0.773 |
✘ |
0.973 |
0.569 |
0.718 |
0.849 |
0.773 |
| BioGITOM∗ |
|
|
|
|
|
✔ |
0.983 |
0.713 |
0.827 |
|
|
| BioSTransMatch∗ |
0.584 |
0.844 |
0.690 |
0.943 |
0.918 |
✔ |
0.845 |
0.860 |
0.852 |
0.957 |
0.943 |
| HybridOM∗ |
0.916 |
0.889 |
0.902 |
0.964 |
0.936 |
✘ |
0.884 |
0.886 |
0.885 |
0.964 |
0.936 |
| LogMap† |
0.966 |
0.607 |
0.746 |
|
|
✘ |
0.952 |
0.603 |
0.738 |
|
|
| LogMapBio† |
0.928 |
0.611 |
0.737 |
|
|
✘ |
0.899 |
0.606 |
0.724 |
|
|
| LogMapLt† |
0.996 |
0.599 |
0.748 |
|
|
✘ |
0.994 |
0.594 |
0.743 |
|
|
| Matcha† |
0.987 |
0.607 |
0.752 |
0.936 |
0.921 |
✘ |
0.982 |
0.601 |
0.746 |
0.936 |
0.921 |