| ⇕System | ⇕Precision | ⇕Recall | ⇕F-score | ⇕MRR | ⇕Hits@1 | ⇕Use Train Maps | ⇕Precision | ⇕Recall | ⇕F-score | ⇕MRR | ⇕Hits@1 |
|---|---|---|---|---|---|---|---|---|---|---|---|
| AMD∗ | 0.664 | 0.508 | 0.576 | ✔ | 0.601 | 0.567 | 0.583 | ||||
| BERTMap‡ | 0.734 | 0.576 | 0.646 | 0.880 | 0.830 | ✔ | 0.645 | 0.592 | 0.617 | 0.891 | 0.841 |
| BERTMapLt‡ | 0.834 | 0.497 | 0.623 | 0.766 | 0.716 | ✘ | 0.782 | 0.507 | 0.615 | 0.766 | 0.716 |
| LogMap† | 0.876 | 0.448 | 0.593 | ✘ | 0.834 | 0.456 | 0.589 | ||||
| LogMapBio† | 0.866 | 0.609 | 0.715 | ✘ | 0.821 | 0.614 | 0.703 | ||||
| LogMapLt† | 0.940 | 0.252 | 0.397 | ✘ | 0.919 | 0.261 | 0.407 | ||||
| Matcha† | 0.781 | 0.509 | 0.617 | ✘ | 0.718 | 0.519 | 0.602 | ||||
| Matcha-DL∗ | 0.745 | 0.513 | 0.607 | 0.811 | 0.780 | ✔ | 0.745 | 0.732 | 0.738 | 0.811 | 0.780 |
| OLaLa∗ | 0.735 | 0.582 | 0.649 | ✘ | 0.655 | 0.570 | 0.610 | ||||
| SORBETMtch†∗ | 0.693 | 0.635 | 0.663 | ✔ | 0.568 | 0.652 | 0.607 | ||||
Note: Mixed results for SORBETMtch, where unsupervised results come from MELT and semi-supervised results come from direct result submission.