This track presents an unified evaluation framework suitable for both ML-based and non-ML-based OM systems. The datasets of this track are based on Mondo and the UMLS Metathesaurus.
The 2022 edition involves the following ontologies: OMIM (Online Mendelian Inheritance in Man), ORDO (Orphanet Rare Disease Ontology), NCIT (National Cancer Institute Thesaurus) and DOID (Human Disease Ontology), FMA (Foundational Model of Anatyomy) and SNOMED CT.
The 2023 edition adopts locality-based logic modules to enrich existing pruned ontologies with logical and structural context from their original versions. The added entities are annotated as "not used in alignment". A new special sub-track for Large Language Model-based OM systems, named Bio-LLM, is also introduced.
The 2024 edition will follow on the 2023 edition, with the slight changes to the subsumption mappings.
]