A cascaded approach for Chinese clinical text de-identification with less annotation effort

Zhe Jian, Xusheng Guo, Shijian Liu, Handong Ma, Shaodian Zhang, Rui Zhang, Jianbo Lei

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

With rapid adoption of Electronic Health Records (EHR) in China, an increasing amount of clinical data has been available to support clinical research. Clinical data secondary use usually requires de-identification of personal information to protect patient privacy. Since manually de-identification of free clinical text requires significant amount of human work, developing an automated de-identification system is necessary. While there are many de-identification systems available for English clinical text, designing a de-identification system for Chinese clinical text faces many challenges such as unavailability of necessary lexical resources and sparsity of patient health information (PHI) in Chinese clinical text. In this paper, we designed a de-identification pipeline taking advantage of both rule-based and machine learning techniques. Our method, in particular, can effectively construct a data set with dense PHI information, which saves annotation time significantly for subsequent supervised learning. We experiment on a dataset of 3000 heterogeneous clinical documents to evaluate the annotation cost and the de-identification performance. Our approach can increase the efficiency of the annotation effort by over 60% while reaching performance as high as over 90% measured by F score. We demonstrate that combing rule-based and machine learning is an effective way to reduce the annotation cost and achieve high performance in Chinese clinical text de-identification task.

Original languageEnglish (US)
Pages (from-to)76-83
Number of pages8
JournalJournal of Biomedical Informatics
Volume73
DOIs
StatePublished - Sep 2017

Bibliographical note

Funding Information:
This study was partly supported by the National Natural Science Foundation of China (NSFC) Grant #81471756 and by the U.S. National Institutes of Health, National Center for Complementary and Integrative Health award (R01AT009457, Zhang).

Publisher Copyright:
© 2017 Elsevier Inc.

Keywords

  • Annotation cost
  • Chinese NLP
  • Clinical natural language processing
  • De-identification

Fingerprint

Dive into the research topics of 'A cascaded approach for Chinese clinical text de-identification with less annotation effort'. Together they form a unique fingerprint.

Cite this