| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
Research Paper |
Affiliations of the authors: Brigham and Women's Hospital (AKJ, GJK, JMT, BS, ER, DLS, MVV, DWB) and Harvard School of Public Health (LL, EB), Boston, Massachusetts.
Correspondence and reprints: David W. Bates, MD, MSc, Division of General Medicine, Department of Medicine, Brigham and Women's Hospital, 75 Francis Street, Boston, MA 02115. e-mail: <dwbates{at}bics.harvard.edu>.
Abstract Background: Adverse drug events (ADEs) are both common and costly. Most hospitals identify ADEs using spontaneous reporting, but this approach lacks sensitivity; chart review identifies more events but is expensive. Computer-based approaches to ADE identification appear promising, but they have not been directly compared with chart review and they are not widely used.
Objectives: To develop a computer-based ADE monitor, and to compare the rate and type of ADEs found with the monitor with those discovered by chart review and by stimulated voluntary report.
Design: Prospective cohort study in one tertiary-care hospital.
Participants: All patients admitted to nine medical and surgical units in a tertiary-care hospital over an eight-month period.
Main Outcome Measure: Adverse drug events identified by the computer-based monitor, by chart review, and by stimulated voluntary report.
Methods: A computer-based monitoring program identified alerts, which were situations suggesting that an ADE might be present (e.g., an order for an antidote such as naloxone). A trained reviewer then examined patients' hospital records to determine whether an ADE had occurred. The results of the computer-based monitoring strategy were compared with two other ADE detection strategies: intensive chart review and stimulated voluntary report by nurses and pharmacists. The monitor and the chart review strategies were independent, and the reviewers were blinded.
Results: The computer monitoring strategy identified 2,620 alerts, of which 275 were determined to be ADEs. The chart review found 398 ADEs, whereas voluntary report detected 23. Of the 617 ADEs detected by at least one method, 76 ADEs were detected by both computer monitor and chart review. The computer monitor identified 45 percent; chart review, 65 percent; and voluntary report, 4 percent. The ADEs identified by computer monitor were more likely to be classified as "severe" than were those identified by chart review (51 versus 42 percent, p =.04). The positive predictive value of computer-generated alerts was 16 percent during the first eight weeks of the study; rule modifications increased this to 23 percent in the final eight weeks. The computer strategy required 11 person-hours per week to execute, whereas chart review required 55 person-hours per week and voluntary report strategy required 5.
Conclusions: The computer-based monitor identified fewer ADEs than did chart review but many more ADEs than did stimulated voluntary report. The overlap among the ADEs identified using different methods was small, suggesting that the incidence of ADEs may be higher than previously reported and that different detection methods capture different events. The computer-based monitoring system represents an efficient approach for measuring ADE frequency and gauging the effectiveness of ADE prevention programs.
This article has been cited by other articles:
![]() |
P. M. Kilbridge and D. C. Classen The Informatics Opportunities at the Intersection of Patient Safety and Clinical Informatics J. Am. Med. Inform. Assoc., July 1, 2008; 15(4): 397 - 407. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. W Bates Mountains in the clouds: patient safety research Qual. Saf. Health Care, June 1, 2008; 17(3): 156 - 157. [Full Text] [PDF] |
||||
![]() |
C Brown, T Hofer, A Johal, R Thomson, J Nicholl, B D Franklin, and R J Lilford An epistemology of patient safety research: a framework for study design and interpretation. Part 3. End points and measurement Qual. Saf. Health Care, June 1, 2008; 17(3): 170 - 177. [Abstract] [Full Text] [PDF] |
||||
![]() |
H Hogan, S Olsen, S Scobie, E Chapman, R Sachs, M McKee, C Vincent, and R Thomson What can we learn about patient safety from information sources within an acute hospital: a step on the ladder of integrated risk management? Qual. Saf. Health Care, June 1, 2008; 17(3): 209 - 215. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Ferranti, M. M. Horvath, H. Cozart, J. Whitehurst, and J. Eckstrand Reevaluating the Safety Profile of Pediatrics: A Comparison of Computerized Adverse Drug Event Surveillance and Voluntary Reporting in the Pediatric Environment Pediatrics, May 1, 2008; 121(5): e1201 - e1207. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. S. Takata, W. Mason, C. Taketomo, T. Logsdon, and P. J. Sharek Development, Testing, and Findings of a Pediatric-Focused Trigger Tool to Identify Medication-Related Harm in US Children's Hospitals Pediatrics, April 1, 2008; 121(4): e927 - e935. [Abstract] [Full Text] [PDF] |
||||
![]() |
P D Mills, J Neily, L M Kinney, J Bagian, and W B Weeks Effective interventions and implementation strategies to reduce adverse drug events in the Veterans Affairs (VA) system Qual. Saf. Health Care, February 1, 2008; 17(1): 37 - 46. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. M. Cresswell, B. Fernando, B. McKinstry, and A. Sheikh Adverse drug events in the elderly Br. Med. Bull., September 1, 2007; 83(1): 259 - 274. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. A. Thomsen, A. G Winterstein, B. Sondergaard, L. S. Haugbolle, and A. Melander Systematic Review of the Incidence and Characteristics of Preventable Adverse Drug Events in Ambulatory Care Ann. Pharmacother., September 1, 2007; 41(9): 1411 - 1426. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Pierson, R. Hansen, S. Greene, C. Williams, R. Akers, M. Jonsson, and T. Carey Preventing medication errors in long-term care: results and evaluation of a large scale web-based error reporting system Qual. Saf. Health Care, August 1, 2007; 16(4): 297 - 302. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. S. Hankin, J. Schein, J. A. Clark, and S. Panchal Adverse events involving intravenous patient-controlled analgesia Am. J. Health Syst. Pharm., July 15, 2007; 64(14): 1492 - 1499. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Handler, R. L. Altman, S. Perera, J. T. Hanlon, S. A. Studenski, J. E. Bost, M. I. Saul, and D. B. Fridsma A Systematic Review of the Performance Characteristics of Clinical Event Monitor Signals Used to Detect Adverse Drug Events in the Hospital Setting J. Am. Med. Inform. Assoc., July 1, 2007; 14(4): 451 - 458. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M Evans, B. J Smith, A. Esterman, W. B Runciman, G. Maddern, K. Stead, P. Selim, J. O'Shaughnessy, S. Muecke, and S. Jones Evaluation of an intervention aimed at improving voluntary incident reporting in hospitals Qual. Saf. Health Care, June 1, 2007; 16(3): 169 - 175. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Phansalkar, J. M. Hoffman, J. R. Nebeker, and J. F. Hurdle Pharmacists versus nonpharmacists in adverse drug event detection: A meta-analysis and systematic review Am. J. Health Syst. Pharm., April 15, 2007; 64(8): 842 - 849. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. N Cantor, H. J Feldman, and M. M Triola Using trigger phrases to detect adverse drug reactions in ambulatory care notes Qual. Saf. Health Care, April 1, 2007; 16(2): 132 - 134. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Olsen, G. Neale, K. Schwab, B. Psaila, T. Patel, E J. Chapman, and C. Vincent Hospital staff should use more than one method to detect adverse events and potential adverse events: incident reporting, pharmacist surveillance and local real-time record review may all have a place Qual. Saf. Health Care, February 1, 2007; 16(1): 40 - 44. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. C. Classen, A. J. Avery, and D. W. Bates Evaluation and Certification of Computerized Provider Order Entry Systems J. Am. Med. Inform. Assoc., January 1, 2007; 14(1): 48 - 55. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. K. Wang, N. S. Herzog, R. Kaushal, C. Park, C. Mochizuki, and S. R. Weingarten Prevention of Pediatric Medication Errors by Hospital Pharmacists and the Potential Benefit of Computerized Physician Order Entry Pediatrics, January 1, 2007; 119(1): e77 - e85. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. E. Walsh, W. G. Adams, H. Bauchner, R. J. Vinci, J. B. Chessare, M. R. Cooper, P. M. Hebert, E. G. Schainker, and C. P. Landrigan Medication Errors Related to Computerized Order Entry for Children Pediatrics, November 1, 2006; 118(5): 1872 - 1879. [Abstract] [Full Text] [PDF] |
||||
![]() |
F Ziemssen, S Grisanti, and K U Bartz-Schmidt The international intravitreal bevacizumab safety survey. Br. J. Ophthalmol., November 1, 2006; 90(11): 1440 - 1441. [Full Text] [PDF] |
||||
![]() |
S. Kane-Gill, R. S. Rea, M. M. Verrico, and R. J. Weber Adverse-drug-event rates for high-cost and high-use drugs in the intensive care unit. Am. J. Health Syst. Pharm., October 1, 2006; 63(19): 1876 - 1881. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. J. Sharek, J. D. Horbar, W. Mason, H. Bisarya, C. W. Thurm, G. Suresh, J. E. Gray, W. H. Edwards, D. Goldmann, and D. Classen Adverse Events in the Neonatal Intensive Care Unit: Development, Testing, and Findings of an NICU-Focused Trigger Tool to Identify Harm in North American NICUs Pediatrics, October 1, 2006; 118(4): 1332 - 1340. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. P. Schade, K. Hannah, P. Ruddick, C. Starling, and J. Brehm Improving self-reporting of adverse drug events in a west virginia hospital. American Journal of Medical Quality, September 1, 2006; 21(5): 335 - 341. [Abstract] [PDF] |
||||
![]() |
J. Le, T. Nguyen, A. V. Law, and J. Hodding Adverse Drug Reactions Among Children Over a 10-Year Period Pediatrics, August 1, 2006; 118(2): 555 - 562. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. M. Kilbridge, U. C. Campbell, H. B. Cozart, and M. G. Mojarrad Automated Surveillance for Adverse Drug Events at a Community Hospital and an Academic Medical Center J. Am. Med. Inform. Assoc., July 1, 2006; 13(4): 372 - 377. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. L Kane-Gill and J. W Devlin Adverse Drug Event Reporting in Intensive Care Units: A Survey of Current Practices Ann. Pharmacother., July 1, 2006; 40(7): 1267 - 1273. [Abstract] [Full Text] [PDF] |
||||
![]() |
P M Kilbridge and D C Classen Automated surveillance for adverse events in hospitalized patients: back to the future. Qual. Saf. Health Care, June 1, 2006; 15(3): 148 - 149. [Full Text] [PDF] |
||||
![]() |
D. H. Smith, N. Perrin, A. Feldstein, X. Yang, D. Kuang, S. R. Simon, D. F. Sittig, R. Platt, and S. B. Soumerai The impact of prescribing safety alerts for elderly persons in an electronic medical record: an interrupted time series evaluation. Arch Intern Med, May 22, 2006; 166(10): 1098 - 1104. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Chaudhry, J. Wang, S. Wu, M. Maglione, W. Mojica, E. Roth, S. C. Morton, and P. G. Shekelle Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care Ann Intern Med, May 16, 2006; 144(10): 742 - 752. [Abstract] [Full Text] [PDF] |
||||
![]() |
P M Kilbridge, E M Welebob, and D C Classen Development of the Leapfrog methodology for evaluating hospital implemented inpatient computerized physician order entry systems. Qual. Saf. Health Care, April 1, 2006; 15(2): 81 - 84. [Abstract] [Full Text] [PDF] |
||||
![]() |
R Ursprung, J E Gray, W H Edwards, J D Horbar, J Nickerson, P Plsek, P H Shiono, G K Suresh, and D A Goldmann Real time patient safety audits: improving safety every day Qual. Saf. Health Care, August 1, 2005; 14(4): 284 - 289. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. B. Melton and G. Hripcsak Automated Detection of Adverse Events Using Natural Language Processing of Discharge Summaries J. Am. Med. Inform. Assoc., July 1, 2005; 12(4): 448 - 457. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. R. Nebeker, J. M. Hoffman, C. R. Weir, C. L. Bennett, and J. F. Hurdle High Rates of Adverse Drug Events in a Highly Computerized Hospital Arch Intern Med, May 23, 2005; 165(10): 1111 - 1116. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. D. Schiff, S. Kim, N. Krosnjar, M. F. Wisniewski, J. Bult, L. Fogelfeld, and R. A. McNutt Missed Hypothyroidism Diagnosis Uncovered by Linking Laboratory and Pharmacy Data Arch Intern Med, March 14, 2005; 165(5): 574 - 577. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. S. Nash, M. Rojas, P. Hebert, S. R. Marrone, C. Colgan, L. A. Fisher, G. Caliendo, and M. R. Chassin Reducing Excessive Medication Administration in Hospitalized Adults With Renal Dysfunction American Journal of Medical Quality, March 1, 2005; 20(2): 64 - 69. [Abstract] [PDF] |
||||
![]() |
A. J. Forster, J. Andrade, and C. van Walraven Validation of a Discharge Summary Term Search Method to Detect Adverse Events J. Am. Med. Inform. Assoc., March 1, 2005; 12(2): 200 - 206. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. A. Boxwala, M. Dierks, M. Keenan, S. Jackson, R. Hanscom, D. W. Bates, and L. Sato Organization and Representation of Patient Safety Data: Current Status and Issues around Generalizability and Scalability J. Am. Med. Inform. Assoc., November 1, 2004; 11(6): 468 - 478. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. S. Field, J. H. Gurwitz, L. R. Harrold, J. M. Rothschild, K. Debellis, A. C. Seger, L. S. Fish, L. Garber, M. Kelleher, and D. W. Bates Strategies for Detecting Adverse Drug Events among Older Persons in the Ambulatory Setting J. Am. Med. Inform. Assoc., November 1, 2004; 11(6): 492 - 498. [Abstract] [Full Text] [PDF] |
||||
![]() |
T Morimoto, T K Gandhi, A C Seger, T C Hsieh, and D W Bates Adverse drug events and medication errors: detection and classification methods Qual. Saf. Health Care, August 1, 2004; 13(4): 306 - 314. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. H. Samore, R. S. Evans, A. Lassen, P. Gould, J. Lloyd, R. M. Gardner, R. Abouzelof, C. Taylor, D. A. Woodbury, M. Willy, et al. Surveillance of Medical Device-Related Hazards and Adverse Events in Hospitalized Patients JAMA, January 21, 2004; 291(3): 325 - 334. [Abstract] [Full Text] [PDF] |
||||
![]() |
C W Johnson How will we get the data and what will we do with it then? Issues in the reporting of adverse healthcare events Qual. Saf. Health Care, December 1, 2003; 12(90002): ii64 - 67. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Frankel, T. K. Gandhi, and D. W. Bates Improving patient safety across a large integrated health care delivery system Int. J. Qual. Health Care, December 1, 2003; 15(90001): i31 - 40. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. C. Classen and J. Metzger Improving medication safety: the measurement conundrum and where to start Int. J. Qual. Health Care, December 1, 2003; 15(90001): i41 - 47. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Tsilimingras, A. K. Rosen, and D. R. Berlowitz Review Article: Patient Safety in Geriatrics: A Call for Action J. Gerontol. A Biol. Sci. Med. Sci., September 1, 2003; 58(9): M813 - 819. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. J. Murff, A. J. Forster, J. F. Peterson, J. M. Fiskio, H. L. Heiman, and D. W. Bates Electronically Screening Discharge Summaries for Adverse Medical Events J. Am. Med. Inform. Assoc., July 1, 2003; 10(4): 339 - 350. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Kaushal, K. G. Shojania, and D. W. Bates Effects of Computerized Physician Order Entry and Clinical Decision Support Systems on Medication Safety: A Systematic Review Arch Intern Med, June 23, 2003; 163(12): 1409 - 1416. [Abstract] [Full Text] [PDF] |
||||
![]() |
J D Rozich, C R Haraden, and R K Resar Adverse drug event trigger tool: a practical methodology for measuring medication related harm Qual. Saf. Health Care, June 1, 2003; 12(3): 194 - 200. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. G. Anderson, S. J. Jay, M. Anderson, and T. J. Hunt Evaluating the Impact of Information Technology on Medication Errors: A Simulation J. Am. Med. Inform. Assoc., May 1, 2003; 10(3): 292 - 293. [Full Text] [PDF] |
||||
![]() |
G. D. Schiff, D. Klass, J. Peterson, G. Shah, and D. W. Bates Linking Laboratory and Pharmacy: Opportunities for Reducing Errors and Improving Care Arch Intern Med, April 28, 2003; 163(8): 893 - 900. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. J. Vicente, K. Kada-Bekhaled, G. Hillel, A. Cassano, and B. A. Orser Programming errors contribute to death from patient-controlled analgesia: case report and estimate of probability: [Des erreurs de programmation en cause dans un deces lie a l'analgesie auto-controlee : une etude de cas et une estimation de la probabilite] Can J Anesth, April 1, 2003; 50(4): 328 - 332. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. W. Bates, R. S. Evans, H. Murff, P. D. Stetson, L. Pizziferri, and G. Hripcsak Detecting Adverse Events Using Information Technology J. Am. Med. Inform. Assoc., March 1, 2003; 10(2): 115 - 128. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. W. Bates, R. S. Evans, H. Murff, P. D. Stetson, L. Pizziferri, and G. Hripcsak Policy and the Future of Adverse Event Detection Using Information Technology J. Am. Med. Inform. Assoc., March 1, 2003; 10(2): 226 - 228. [Full Text] [PDF] |
||||
![]() |
D. F. Doolan, D. W. Bates, and B. C. James The Use of Computers for Clinical Care: A Case Series of Advanced U.S. Sites J. Am. Med. Inform. Assoc., January 1, 2003; 10(1): 94 - 107. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Rothschild, F. A. Federico, T. K. Gandhi, R. Kaushal, D. H. Williams, and D. W. Bates Analysis of Medication-Related Malpractice Claims: Causes, Preventability, and Costs Arch Intern Med, November 25, 2002; 162(21): 2414 - 2420. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. E. Freedman, R. C. Becker, J. E. Adams, S. Borzak, R. L. Jesse, L. K. Newby, P. O'Gara, J. C. Pezzullo, R. Kerber, B. Coleman, et al. Medication Errors in Acute Cardiac Care: An American Heart Association Scientific Statement From the Council on Clinical Cardiology Subcommittee on Acute Cardiac Care, Council on Cardiopulmonary and Critical Care, Council on Cardiovascular Nursing, and Council on Stroke Circulation, November 12, 2002; 106(20): 2623 - 2629. [Full Text] [PDF] |
||||
![]() |
J. S. Einbinder and K. Scully Using a Clinical Data Repository to Estimate the Frequency and Costs of Adverse Drug Events J. Am. Med. Inform. Assoc., November 1, 2002; 9(90061): S34 - 38. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. G. Anderson, S. J. Jay, M. Anderson, and T. J. Hunt Evaluating the Capability of Information Technology to Prevent Adverse Drug Events: A Computer Simulation Approach J. Am. Med. Inform. Assoc., September 1, 2002; 9(5): 479 - 490. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Weiss, S. Krebs, C. Hoffmann, U. Werner, A. Neubert, K. Brune, and W. Rascher Survey of Adverse Drug Reactions on a Pediatric Ward: A Strategy for Early and Detailed Detection Pediatrics, August 1, 2002; 110(2): 254 - 257. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. G. Poon, G. J. Kuperman, J. Fiskio, and D. W. Bates Real-time Notification of Laboratory Data Requested by Users through Alphanumeric Pagers J. Am. Med. Inform. Assoc., May 1, 2002; 9(3): 217 - 222. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Hripcsak and A. Wilcox Reference Standards, Judges, and Comparison Subjects: Roles for Experts in Evaluating System Performance J. Am. Med. Inform. Assoc., January 1, 2002; 9(1): 1 - 15. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. M. Chertow, J. Lee, G. J. Kuperman, E. Burdick, J. Horsky, D. L. Seger, R. Lee, A. Mekala, J. Song, A. L. Komaroff, et al. Guided Medication Dosing for Inpatients With Renal Insufficiency JAMA, December 12, 2001; 286(22): 2839 - 2844. [Abstract] [Fu |