Equivalence Matching Results for SNOMED-FMA (Body)
 
Unsupervised (No Train Maps)
Semi-supervised (Optional 30% Train Maps)
⇕System ⇕Precision ⇕Recall ⇕F-score ⇕MRR ⇕Hits@1 ⇕Use Train Maps ⇕Precision ⇕Recall ⇕F-score ⇕MRR ⇕Hits@1
BERTMap 0.979 0.662 0.790 0.944 0.920 0.970 0.669 0.792 0.965 0.947
BERTMapLt 0.979 0.655 0.785 0.892 0.865 0.970 0.662 0.787 0.892 0.865
BioGITOM 0.962 0.886 0.923
BioSTransMatch 0.128 0.384 0.192 0.633 0.513 0.357 0.661 0.464 0.855 0.798
HybridOM 0.870 0.722 0.790 0.907 0.861 0.825 0.725 0.772 0.907 0.861
LogMap 0.744 0.407 0.526 0.673 0.411 0.511
LogMapBio 0.827 0.577 0.680 0.770 0.577 0.660
LogMapLt 0.970 0.542 0.696 0.958 0.542 0.693
Matcha 0.887 0.502 0.641 0.950 0.935 0.846 0.502 0.630 0.950 0.935

Note: The BERTMap model for this task does not apply mapping repair on this task as the reasoning was not able to be completed.