| ⇕System | ⇕Precision | ⇕Recall | ⇕F-score | ⇕MRR | ⇕Hits@1 | ⇕Use Train Maps | ⇕Precision | ⇕Recall | ⇕F-score | ⇕MRR | ⇕Hits@1 |
|---|---|---|---|---|---|---|---|---|---|---|---|
| AMD∗ | 0.962 | 0.670 | 0.790 | ✔ | 0.952 | 0.746 | 0.836 | ||||
| BERTMap‡ | 0.971 | 0.585 | 0.730 | 0.969 | 0.951 | ✔ | 0.898 | 0.715 | 0.796 | 0.971 | 0.953 |
| BERTMapLt‡ | 0.981 | 0.574 | 0.724 | 0.849 | 0.773 | ✘ | 0.973 | 0.569 | 0.718 | 0.849 | 0.773 |
| LogMap† | 0.966 | 0.607 | 0.746 | ✘ | 0.952 | 0.603 | 0.738 | ||||
| LogMapBio† | 0.928 | 0.611 | 0.737 | ✘ | 0.899 | 0.606 | 0.724 | ||||
| LogMapLt† | 0.996 | 0.599 | 0.748 | ✘ | 0.994 | 0.594 | 0.743 | ||||
| Matcha† | 0.987 | 0.607 | 0.752 | ✘ | 0.982 | 0.601 | 0.746 | ||||
| Matcha-DL∗ | 0.904 | 0.616 | 0.733 | 0.931 | 0.917 | ✔ | 0.903 | 0.872 | 0.888 | 0.931 | 0.917 |
| SORBETMtch†∗ | 0.973 | 0.607 | 0.748 | ✔ | 0.876 | 0.604 | 0.715 | ||||
Note: OLaLa did not submit the results for the task.
Note: Mixed results for SORBETMtch, where unsupervised results come from MELT and semi-supervised results come from direct result submission.