help button home button JAMIA Bigger figures
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH

First published June 4, 2003 as JAMIA PrePrint; doi:10.1197/jamia.M1279
Journal of the American Medical Informatics Association 2003;10(5):478-483
© 2003 American Medical Informatics Association


A more recent version of this article appeared on September 1, 2003
This Article
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
M1279v1
10/5/478    most recent
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Tsai, T. L.
Right arrow Articles by Gatti, G.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Tsai, T. L.
Right arrow Articles by Gatti, G.

Submitted on October 23, 2002
Accepted on May 5, 2003

Computer Decision Support as a Source of Interpretation Error: The Case of Electrocardiograms

Theodore L. Tsai MD1*, Douglas B. Fridsma MD1, and Guido Gatti MA1

Affiliation of the authors: 1 Center for Biomedical Informatics and Department of Medicine, University of Pittsburgh, Pittsburgh, PA

* To whom correspondence should be addressed.

Objective To determine the effect that the computer interpretation (CI) of EKGs has on the accuracy of resident (non-cardiologist) physicians reading EKGs.

Design Randomized controlled trial conducted in a laboratory setting from February-June 2001, using a 2 period crossover design with matched pairs of subjects randomly assigned to sequencing groups.

Measurements Subjects' interpretive accuracy of discrete, cardiologist-determined EKG findings, as judged by a board-certified internist.

Results Without the CI, subjects interpreted 48.9% (95% confidence interval 45.0% to 52.8%) of the findings correctly. With the CI, subjects interpreted 55.4% (51.9% to 58.9%) correctly (p < 0.0001). When the CIs that agreed with the gold standard (Correct CIs) were not included, 53.1% (47.7% to 58.5%) of the findings were interpreted correctly. When the correct CI were included accuracy increased to 68.1% (63.2% to 72.7%; p < 0.0001). When computer advice that did not agree with the gold standard (Incorrect CI) was not provided to the subjects, 56.7% (48.5% to 64.5%) of findings were interpreted correctly. Accuracy dropped to 48.3% (40.4% to 56.4%) when the incorrect computer advice was provided (p = 0.131). Subjects erroneously agreed with the incorrect CI more often when it was presented with the EKG 67.7% (57.2% to 76.7%) than when it was not 34.6% (23.8% to 47.3%; p < 0.0001).

Conclusion Computer decision support systems can generally improve the interpretive accuracy of internal medicine residents in reading EKGs. However, subjects were significantly influenced by incorrect advice which tempers the overall usefulness of computer generated advice in this and perhaps other areas.




This article has been cited by other articles:


Home page
Acad. PsychiatryHome page
C. R. Keenan, H. H. Nguyen, and M. Srinivasan
Electronic Medical Records and Their Impact on Resident and Medical Student Education
Acad Psychiatry, December 1, 2006; 30(6): 522 - 527.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
K. A. McKibbon and D. B. Fridsma
Effectiveness of Clinician-selected Electronic Information Resources for Answering Primary Care Physicians' Information Needs
J. Am. Med. Inform. Assoc., November 1, 2006; 13(6): 653 - 659.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
J. S. Ash, M. Berg, and E. Coiera
Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors
J. Am. Med. Inform. Assoc., March 1, 2004; 11(2): 104 - 112.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
E. S. Berner
Diagnostic Decision Support Systems: How to Determine the Gold Standard?
J. Am. Med. Inform. Assoc., November 1, 2003; 10(6): 608 - 610.
[Full Text] [PDF]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH
Copyright © 1994 by the American Medical Informatics Association.