This Article Full Text Full Text (PDF) Submit a response Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Fiszman, M. Articles by Haug, P. J. Search for Related Content PubMed PubMed Citation Articles by Fiszman, M. Articles by Haug, P. J.

Automatic Detection of Acute Bacterial Pneumonia from Chest X-ray Reports

Affiliation of authors: The University of Utah, Salt Lake City, Utah.

Correspondence and reprints: Marcelo Fiszman, MD, Department of Medical Informatics, LDS Hospital, 8th Avenue and C Street, Salt Lake City, UT 84143; e-mail: <M.Fiszman{at}m.cc.utah.edu>.

Objective: To evaluate the performance of a natural language processing system in extracting pneumonia-related concepts from chest x-ray reports.

Methods: Design: Four physicians, three lay persons, a natural language processing system, and two keyword searches (designated AAKS and KS) detected the presence or absence of three pneumonia-related concepts and inferred the presence or absence of acute bacterial pneumonia from 292 chest x-ray reports. Gold standard: Majority vote of three independent physicians. Reliability of the gold standard was measured. Outcome measures: Recall, precision, specificity, and agreement (using Finn's R statistic) with respect to the gold standard. Differences between the physicians and the other subjects were tested using the McNemar test for each pneumonia concept and for the disease inference of acute bacterial pneumonia.

Results: Reliability of the reference standard ranged from 0.86 to 0.96. Recall, precision, specificity, and agreement (Finn R) for the inference on acute bacterial pneumonia were, respectively, 0.94, 0.87, 0.91, and 0.84 for physicians; 0.95, 0.78, 0.85, and 0.75 for natural language processing system; 0.46, 0.89, 0.95, and 0.54 for lay persons; 0.79, 0.63, 0.71, and 0.49 for AAKS; and 0.87, 0.70, 0.77, and 0.62 for KS. The McNemar pairwise comparisons showed differences between one physician and the natural language processing system for the infiltrate concept and between another physician and the natural language processing system for the inference on acute bacterial pneumonia. The comparisons also showed that most physicians were significantly different from the other subjects in all pneumonia concepts and the disease inference.

Conclusion: In extracting pneumonia related concepts from chest x-ray reports, the performance of the natural language processing system was similar to that of physicians and better than that of lay persons and keyword searches. The encoded pneumonia information has the potential to support several pneumonia-related applications used in our institution. The applications include a decision support system called the antibiotic assistant, a computerized clinical protocol for pneumonia, and a quality assurance application in the radiology department.

This article has been cited by other articles:

				S. V.S. Pakhomov, P. L. Hanson, S. S. Bjornsen, and S. A. Smith Automatic Classification of Foot Examination Findings Using Clinical Notes and Machine Learning J. Am. Med. Inform. Assoc., March 1, 2008; 15(2): 198 - 202. [Abstract] [Full Text] [PDF]

				A. Turchin, N. S. Kolatkar, R. W. Grant, E. C. Makhni, M. L. Pendergrass, and J. S. Einbinder Using Regular Expressions to Abstract Blood Pressure and Treatment Intensification Information from the Text of Physician Notes J. Am. Med. Inform. Assoc., November 1, 2006; 13(6): 691 - 695. [Abstract] [Full Text] [PDF]

				S. V.S. Pakhomov, J. D. Buntrock, and C. G. Chute Automating the Assignment of Diagnosis Codes to Patient Encounters Using Example-based and Machine Learning Techniques J. Am. Med. Inform. Assoc., September 1, 2006; 13(5): 516 - 525. [Abstract] [Full Text] [PDF]

				R. Kukafka, M. E. Bales, A. Burkhardt, and C. Friedman Human and Automated Coding of Rehabilitation Discharge Summaries According to the International Classification of Functioning, Disability, and Health J. Am. Med. Inform. Assoc., September 1, 2006; 13(5): 508 - 515. [Abstract] [Full Text] [PDF]

				W. W. Chapman, J. N. Dowling, and M. M. Wagner Generating a Reliable Reference Standard Set for Syndromic Case Classification J. Am. Med. Inform. Assoc., November 1, 2005; 12(6): 618 - 629. [Abstract] [Full Text] [PDF]

				B. Hazlehurst, H. R. Frost, D. F. Sittig, and V. J. Stevens MediClass: A System for Detecting and Classifying Encounter-based Clinical Events in Any Electronic Medical Record J. Am. Med. Inform. Assoc., September 1, 2005; 12(5): 517 - 529. [Abstract] [Full Text] [PDF]

				G. B. Melton and G. Hripcsak Automated Detection of Adverse Events Using Natural Language Processing of Discharge Summaries J. Am. Med. Inform. Assoc., July 1, 2005; 12(4): 448 - 457. [Abstract] [Full Text] [PDF]

				B. J. Thomas, H. Ouellette, E. F. Halpern, and D. I. Rosenthal Automated Computer-Assisted Categorization of Radiology Reports Am. J. Roentgenol., February 1, 2005; 184(2): 687 - 690. [Abstract] [Full Text] [PDF]

				D. Aronsky, E. Kasworm, J. A. Jacobson, P. J. Haug, and N. C. Dean Electronic Screening of Dictated Reports to Identify Patients with Do-Not-Resuscitate Status J. Am. Med. Inform. Assoc., September 1, 2004; 11(5): 403 - 409. [Abstract] [Full Text] [PDF]

				W. W. Chapman, G. F. Cooper, P. Hanbury, B. E. Chapman, L. H. Harrison, and M. M. Wagner Creating a Text Classifier to Detect Radiology Reports Describing Mediastinal Findings Associated with Inhalational Anthrax and Other Disorders J. Am. Med. Inform. Assoc., September 1, 2003; 10(5): 494 - 503. [Abstract] [Full Text] [PDF]

				D. W. Bates, R. S. Evans, H. Murff, P. D. Stetson, L. Pizziferri, and G. Hripcsak Detecting Adverse Events Using Information Technology J. Am. Med. Inform. Assoc., March 1, 2003; 10(2): 115 - 128. [Abstract] [Full Text] [PDF]

				G. Hripcsak, J. H. M. Austin, P. O. Alderson, and C. Friedman Use of Natural Language Processing to Translate Clinical Information from a Database of 889,921 Chest Radiographic Reports Radiology, July 1, 2002; 224(1): 157 - 163. [Abstract] [Full Text]

				G. Hripcsak and A. Wilcox Reference Standards, Judges, and Comparison Subjects: Roles for Experts in Evaluating System Performance J. Am. Med. Inform. Assoc., January 1, 2002; 9(1): 1 - 15. [Abstract] [Full Text] [PDF]