MetaMap versus BERT models with explainable active learning: ontology-based experiments with prior knowledge for COVID-19

Authors: Arguello-Casteleiro, Mercedes;

Henson, Chloe;

Maroto, Nava;

Li, Saihong ;

Des-Diz, Julio;

Fernandez-Prieto, Maria Jesus;

Peters, Sarah;

Furmston, Tim;

Sevillano Torrado, Carlos;

Maseda Fernandez, Diego;

Kulshrestha, Manoj;

Keane, John;

Stevens, Robert;

Wroe, Chris

Source: Proceedings of the 13th International Conference on Semantic Web Applications and Tools for Health Care and Life Sciences, Leiden, Netherlands, 10.01.2022 - 14.01.2022

Full text

: http://hdl.handle.net/1893/34323

Abstract

Emergence of the Coronavirus 2019 Disease has highlighted further the need for timely support for clinicians as they manage severely ill patients. We combine Semantic Web technologies with Deep Learning for Natural Language Processing with the aim of converting human-readable best evidence/practice for COVID-19 into that which is computer-interpretable. We present the results of experiments with 1212 clinical ideas (medical terms and expressions) from two UK national healthcare services specialty guides for COVID-19 and three versions of two BMJ Best Practice documents for COVID-19. The paper seeks to recognise and categorise clinical ideas, performing a Named Entity Recognition (NER) task, with an ontology providing extra terms as context and describing the intended meaning of categories understandable by clinicians. The paper investigates: 1) the performance of classical NER using MetaMap versus NER with fine-tuned BERT models; 2) the integration of both NER approaches using a lightweight ontology developed in close collaboration with senior doctors; and 3) the easy interpretation by junior doctors of the main classes from the ontology once populated with NER results. We report the NER performance and the observed agreement for human audits.

Rights

Cite as

Arguello-Casteleiro, M., Henson, C., Maroto, N., Li, S., Des-Diz, J., Fernandez-Prieto, M., Peters, S., Furmston, T., Sevillano Torrado, C., Maseda Fernandez, D., Kulshrestha, M., Keane, J., Stevens, R. & Wroe, C. 2022, 'MetaMap versus BERT models with explainable active learning: ontology-based experiments with prior knowledge for COVID-19', Proceedings of the 13th International Conference on Semantic Web Applications and Tools for Health Care and Life Sciences, Leiden, Netherlands, 10.01.2022 - 14.01.2022, Aachen, Germany, pp. 108-117. http://hdl.handle.net/1893/34323

Downloadable citations

HTML BIB RIS

Identifiers

Repository URI: http://hdl.handle.net/1893/34323