Combining an expert-based medical entity recognizer to a machine-learning system: methods and a case-study - Archive ouverte HAL Access content directly
Journal Articles Biomedical Informatics Insights Year : 2013

Combining an expert-based medical entity recognizer to a machine-learning system: methods and a case-study

(1) , (1, 2) , (3) , (4) , (1) , (1, 5)
1
2
3
4
5

Abstract

Medical entity recognition is currently generally performed by data-driven methods based on supervised machine learning. Expert-based systems, where linguistic and domain expertise are directly provided to the system, for instance in the form of lexicons and pattern-based rules, are often combined with data-driven systems. We present here a case study where an existing expert-based medical entity recognition system, Ogmios, is combined with a data-driven system, Caramba, based on a linear-chain Conditional Random Field (CRF) classifier. We examine different methods to combine two such systems and test the most relevant ones through experiments performed on the i2b2/VA 2012 challenge data. Our case study specifically highlights the risk of overfitting incurred by an expert-based system. We observe that it prevents the combination of the two systems from obtaining improvements in precision, recall, or F-measure, and analyse the underlying mechanisms through a post-hoc feature-level analysis. We also observe that wrapping the expert-based system alone as attributes input to a CRF classifier does boost its F-measure from 0.603 to 0.710 (strict matching of types and boundaries, as per the conlleval program), bringing it on par with the data-driven system. The generality of this method remains to be further investigated.
Not file

Dates and versions

hal-01972779 , version 1 (07-01-2019)

Identifiers

  • HAL Id : hal-01972779 , version 1

Cite

Pierre Zweigenbaum, Thomas Lavergne, Natalia Grabar, Thierry Hamon, Sophie Rosset, et al.. Combining an expert-based medical entity recognizer to a machine-learning system: methods and a case-study. Biomedical Informatics Insights, 2013, 13p. ⟨hal-01972779⟩
151 View
0 Download

Share

Gmail Facebook Twitter LinkedIn More