This Article Full Text Full Text (PDF) Appendix All Versions of this Article: M1369v1 10/6/580    most recent Submit a response Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Huang, Y. Articles by Hersh, W. R. Search for Related Content PubMed PubMed Citation Articles by Huang, Y. Articles by Hersh, W. R.

A Pilot Study of Contextual UMLS Indexing to Improve the Precision of Concept-based Representation in XML-structured Clinical Radiology Reports

Affiliations of the authors: Stanford Medical Informatics and The Office of Information Resources and Technology, Stanford University School of Medicine, Stanford, California (YH, HJL); Division of Medical Informatics & Outcomes Research, Oregon Health & Science University, Portland, Oregon (WRH)

Correspondence and reprints: Yang Huang, MS, Stanford Medical Informatics, MSOB X200, 251 Campus Drive, Stanford University, Stanford, CA 94305; e-mail: <yhuang{at}smi.stanford.edu>

Received for publication: 03/21/03; accepted for publication: 06/30/03.

Objective: Despite the advantages of structured data entry, much of the patient record is still stored as unstructured or semistructured narrative text. The issue of representing clinical document content remains problematic. The authors' prior work using an automated UMLS document indexing system has been encouraging but has been affected by the generally low indexing precision of such systems. In an effort to improve precision, the authors have developed a context-sensitive document indexing model to calculate the optimal subset of UMLS source vocabularies used to index each document section. This pilot study was performed to evaluate the utility of this indexing approach on a set of clinical radiology reports.

Design: A set of clinical radiology reports that had been indexed manually using UMLS concept descriptors was indexed automatically by the SAPHIRE indexing engine. Using the data generated by this process the authors developed a system that simulated indexing, at the document section level, of the same document set using many permutations of a subset of the UMLS constituent vocabularies.

Measurements: The precision and recall scores generated by simulated indexing for each permutation of two or three UMLS constituent vocabularies were determined.

Results: While there was considerable variation in precision and recall values across the different subtypes of radiology reports, the overall effect of this indexing strategy using the best combination of two or three UMLS constituent vocabularies was an improvement in precision without significant impact of recall.

Conclusion: In this pilot study a contextual indexing strategy improved overall precision in a set of clinical radiology reports.

This article has been cited by other articles:

				C. E. Kahn Jr. and D. L. Rubin Automated Semantic Indexing of Figure Captions to Improve Radiology Image Retrieval J. Am. Med. Inform. Assoc., May 1, 2009; 16(3): 380 - 386. [Abstract] [Full Text] [PDF]

				Y. Huang and H. J. Lowe A Novel Hybrid Approach to Automated Negation Detection in Clinical Radiology Reports J. Am. Med. Inform. Assoc., May 1, 2007; 14(3): 304 - 311. [Abstract] [Full Text] [PDF]

				S. H. Brown, T. Speroff, E. M. Fielstein, B. A. Bauer, D. L. Wahner-Roedler, R. Greevy, and P. L. Elkin eQuality: Electronic Quality Assessment From Narrative Clinical Reports Mayo Clin. Proc., November 1, 2006; 81(11): 1472 - 1481. [Abstract] [Full Text] [PDF]

				R. H. Gottlieb Imaging for Whom: Patient or Physician? Am. J. Roentgenol., December 1, 2005; 185(6): 1399 - 1403. [Abstract] [Full Text] [PDF]

				B. Hazlehurst, H. R. Frost, D. F. Sittig, and V. J. Stevens MediClass: A System for Detecting and Classifying Encounter-based Clinical Events in Any Electronic Medical Record J. Am. Med. Inform. Assoc., September 1, 2005; 12(5): 517 - 529. [Abstract] [Full Text] [PDF]

				Y. Huang, H. J. Lowe, D. Klein, and R. J. Cucina Improved Identification of Noun Phrases in Clinical Radiology Reports Using a High-Performance Statistical Natural Language Parser Augmented with the UMLS Specialist Lexicon J. Am. Med. Inform. Assoc., May 1, 2005; 12(3): 275 - 285. [Abstract] [Full Text] [PDF]

				C. Friedman, L. Shagina, Y. Lussier, and G. Hripcsak Automated Encoding of Clinical Documents Based on Natural Language Processing J. Am. Med. Inform. Assoc., September 1, 2004; 11(5): 392 - 402. [Abstract] [Full Text] [PDF]