Equivalence Matching Results for SNOMED-NCIT (Pharm)
 
Unsupervised (No Train Maps)
Semi-supervised (Optional 30% Train Maps)
⇕System ⇕Precision ⇕Recall ⇕F-score ⇕MRR ⇕Hits@1 ⇕Use Train Maps ⇕Precision ⇕Recall ⇕F-score ⇕MRR ⇕Hits@1
AMD 0.962 0.670 0.790 0.952 0.746 0.836
BERTMap 0.971 0.585 0.730 0.969 0.951 0.898 0.715 0.796 0.971 0.953
BERTMapLt 0.981 0.574 0.724 0.849 0.773 0.973 0.569 0.718 0.849 0.773
LogMap 0.966 0.607 0.746 0.952 0.603 0.738
LogMapBio 0.928 0.611 0.737 0.899 0.606 0.724
LogMapLt 0.996 0.599 0.748 0.994 0.594 0.743
Matcha 0.987 0.607 0.752 0.982 0.601 0.746
Matcha-DL 0.904 0.616 0.733 0.931 0.917 0.903 0.872 0.888 0.931 0.917
SORBETMtch†∗ 0.973 0.607 0.748 0.876 0.604 0.715

Note: OLaLa did not submit the results for the task.

Note: Mixed results for SORBETMtch, where unsupervised results come from MELT and semi-supervised results come from direct result submission.