Subsumption Matching Results for NCIT-DOID (Disease)
⇕System ⇕Use Training Maps ⇕MRR ⇕Hits@1 ⇕Hits@5 ⇕Hits@10
BERTSubs (IC) 0.5350.3420.7960.938
BERTSubs (IC) 0.4420.2400.7100.916
OWL2Vec* + RF 0.617 0.5030.7550.858
SORBETMtch 0.802 0.695 0.941 0.977
Word2Vec + RF 0.520 0.3780.6900.806
Word2Vec + RF (del) 0.330 0.2290.4190.532

Note: (del) is a trial setting that uses the pruned target ontology similar to OAEI 2022.

Note: OWL2Vec* uses structure, literal and mixture documents, without using pre-trained Word2Vec. RF indicates Random Forest Classifier with n_estimators=50.