Corpus domain effects on distributional semantic modeling of medical terms

Serguei V.S. Pakhomov, Greg Finley, Reed McEwan, Yan Wang, Genevieve B. Melton

Research output: Contribution to journalArticlepeer-review

74 Scopus citations


Motivation: Automatically quantifying semantic similarity and relatedness between clinical terms is an important aspect of text mining from electronic health records, which are increasingly recognized as valuable sources of phenotypic information for clinical genomics and bioinformatics research. A key obstacle to development of semantic relatedness measures is the limited availability of large quantities of clinical text to researchers and developers outside of major medical centers. Text from general English and biomedical literature are freely available; however, their validity as a substitute for clinical domain to represent semantics of clinical terms remains to be demonstrated. Results: We constructed neural network representations of clinical terms found in a publicly available benchmark dataset manually labeled for semantic similarity and relatedness. Similarity and relatedness measures computed from text corpora in three domains (Clinical Notes, PubMed Central articles and Wikipedia) were compared using the benchmark as reference. We found that measures computed from full text of biomedical articles in PubMed Central repository (rho=0.62 for similarity and 0.58 for relatedness) are on par with measures computed from clinical reports (rho=0.60 for similarity and 0.57 for relatedness). We also evaluated the use of neural network based relatedness measures for query expansion in a clinical document retrieval task and a biomedical term word sense disambiguation task. We found that, with some limitations, biomedical articles may be used in lieu of clinical reports to represent the semantics of clinical terms and that distributional semantic methods are useful for clinical and biomedical natural language processing applications.

Original languageEnglish (US)
Pages (from-to)3635-3644
Number of pages10
Issue number23
StatePublished - 2016

Bibliographical note

Publisher Copyright:
© The Author 2016.


Dive into the research topics of 'Corpus domain effects on distributional semantic modeling of medical terms'. Together they form a unique fingerprint.

Cite this