This Article Full Text Full Text (PDF) Submit a response Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Aronsky, D. Articles by Haug, P. J. Search for Related Content PubMed PubMed Citation Articles by Aronsky, D. Articles by Haug, P. J.

Assessing the Quality of Clinical Data in a Computer-based Record for Calculating the Pneumonia Severity Index

LDS Hospital, University of Utah, Salt Lake City, Utah.

Corresdpondence and reprints: Dominik Aronsky, MD, Department of Medical Informatics, LDS Hospital, 8th Avenue and C Street, Salt Lake City, UT 84143; e-mail: lddarons{at}ihc.com .

Received for publication: 05/19/99; accepted for publication: 09/15/99.

Objective: This study examined whether clinical data routinely available in a computerized patient record (CPR) can be used to drive a complex guideline that supports physicians in real time and at the point of care in assessing the risk of mortality for patients with community-acquired pneumonia.

Setting: Emergency department of a tertiary-care hospital.

Design: Retrospective analysis with medical chart review.

Patients: All 241 inpatients during a 17-month period (Jun 1995 to Nov 1996) who presented to the emergency department and had a primary discharge diagnosis of community-acquired pneumonia.

Methods/Main Outcome Measures: The 20 guideline variables were extracted from the CPR (HELP System) and the paper chart. The risk score and the risk class of the Pneumonia Severity Index were computed using data from the CPR alone and from a reference standard of all data available in the paper chart and the CPR at the time of the emergency department encounters. Availability and concordance were quantified to determine data quality. The type and cause of errors were analyzed depending on the source and format of the clinical variables.

Results: Of the 20 guideline variables, 12 variables were required to be present for every computer-charted emergency department patient, seven variables were required for selected patients only, and one variable was not typically available in the HELP System during a patient's encounter. The risk class was identical for 86.7 percent of the patients. The majority of patients with different risk classes were assigned too low a risk class. The risk scores were identical for 72.1 percent of the patients. The average availability was 0.99 for the data elements that were required to be present and 0.79 for the data elements that were not required to be present. The average concordance was 0.98 when all a patient's variables were taken into account. The cause of error was attributed to the nurse charting in 77 percent of the cases and to the computerized evaluation in 23 percent. The type of error originated from the free-text fields in 64 percent, from coded fields in 21 percent, from vital signs in 14 percent, and from laboratory results in 1 percent.

Conclusion: From a clinical perspective, the current level of data quality in the HELP System supports the automation and the prospective evaluation of the Pneumonia Severity Index as a computerized decision support tool.

This article has been cited by other articles:

				P. D. Stetson, F. P. Morrison, S. Bakken, S. B. Johnson, and eNote Research Team Preliminary Development of the Physician Documentation Quality Instrument J. Am. Med. Inform. Assoc., July 1, 2008; 15(4): 534 - 541. [Abstract] [Full Text] [PDF]

				M. Christ-Crain, D. Stolz, S. Jutla, O. Couppis, C. Muller, R. Bingisser, P. Schuetz, M. Tamm, R. Edwards, B. Muller, et al. Free and Total Cortisol Levels as Predictors of Severity and Outcome in Community-acquired Pneumonia Am. J. Respir. Crit. Care Med., November 1, 2007; 176(9): 913 - 920. [Abstract] [Full Text] [PDF]

				D. Aronsky, P. J. Haug, C. Lagor, and N. C. Dean Accuracy of Administrative Data for Identifying Patients With Pneumonia American Journal of Medical Quality, November 1, 2005; 20(6): 319 - 328. [Abstract] [PDF]

				J. Stausberg, D. Koch, J. Ingenerf, and M. Betzler Comparing Paper-based with Electronic Patient Records: Lessons Learned during a Study on Diagnosis and Procedure Codes J. Am. Med. Inform. Assoc., September 1, 2003; 10(5): 470 - 477. [Abstract] [Full Text] [PDF]

				D. G. T. Arts, N. F. de Keizer, and G.-J. Scheffer Defining and Improving Data Quality in Medical Registries: A Literature Review, Case Study, and Generic Framework J. Am. Med. Inform. Assoc., November 1, 2002; 9(6): 600 - 611. [Abstract] [Full Text] [PDF]

				D. Aronsky, K. J. Chan, and P. J. Haug Evaluation of a Computerized Diagnostic Decision Support System for Patients with Pneumonia: Study Design Considerations J. Am. Med. Inform. Assoc., September 1, 2001; 8(5): 473 - 485. [Abstract] [Full Text] [PDF]