| ⇕System | ⇕Precision | ⇕Recall | ⇕F-score | ⇕MRR | ⇕Hits@1 | ⇕Use Train Maps | ⇕Precision | ⇕Recall | ⇕F-score | ⇕MRR | ⇕Hits@1 |
|---|---|---|---|---|---|---|---|---|---|---|---|
| BERTMap‡ | 0.979 | 0.662 | 0.790 | 0.944 | 0.920 | ✔ | 0.970 | 0.669 | 0.792 | 0.965 | 0.947 |
| BERTMapLt‡ | 0.979 | 0.655 | 0.785 | 0.892 | 0.865 | ✘ | 0.970 | 0.662 | 0.787 | 0.892 | 0.865 |
| BioGITOM∗ | ✔ | 0.962 | 0.886 | 0.923 | |||||||
| BioSTransMatch∗ | 0.128 | 0.384 | 0.192 | 0.633 | 0.513 | ✔ | 0.357 | 0.661 | 0.464 | 0.855 | 0.798 |
| HybridOM∗ | 0.870 | 0.722 | 0.790 | 0.907 | 0.861 | ✘ | 0.825 | 0.725 | 0.772 | 0.907 | 0.861 |
| LogMap† | 0.744 | 0.407 | 0.526 | ✘ | 0.673 | 0.411 | 0.511 | ||||
| LogMapBio† | 0.827 | 0.577 | 0.680 | ✘ | 0.770 | 0.577 | 0.660 | ||||
| LogMapLt† | 0.970 | 0.542 | 0.696 | ✘ | 0.958 | 0.542 | 0.693 | ||||
| Matcha† | 0.887 | 0.502 | 0.641 | 0.950 | 0.935 | ✘ | 0.846 | 0.502 | 0.630 | 0.950 | 0.935 |
Note: The BERTMap model for this task does not apply mapping repair on this task as the reasoning was not able to be completed.