This Article Full Text Full Text (PDF) Submit a response Alert me when this article is cited Alert me when eLetters are posted Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Honigman, B. Articles by Bates, D. W. Search for Related Content PubMed PubMed Citation Articles by Honigman, B. Articles by Bates, D. W.

Using Computerized Data to Identify Adverse Drug Events in Outpatients

Affiliations of the authors: University of Colorado Health Sciences Center, Denver, Colorado (BH); Harvard Medical School, Boston, Massachusetts (JL, JR, TY, DWB); Post-graduate Institute for Medicine, Englewood, Colorado (PL); ProCard, Inc., Golden, Colorado (RMP).

Correspondence and reprints: Benjamin Honigman, MD, Division of Emergency Medicine, B-215, 4200 East Ninth Avenue, Denver, CO 80262; e-mail: <benjamin.honigman{at}uchsc.edu>.

Objective: To evaluate the use of a computer program to identify adverse drug events (ADEs) in the ambulatory setting and to evaluate the relative contribution of four computer search methods for identifying ADEs, including diagnosis codes, allergy rules, computer event monitoring rules, and text searching.

Design: Retrospective analysis of one year of data from an electronic medical record, including records for 23,064 patients with a primary care physician, of whom 15,665 actually came for care.

Measurement: Presence of an ADE; sensitivity and specificity of computer searches for ADE.

Results: The computer program identified 25,056 incidents, which were associated with an estimated 864 (95 percent confidence interval [CI], 750–978) ADEs. Thus, the ADE rate was 5.5 (CI, 5.2–5.9) per 100 patients coming for care. Furthermore, in 79 (CI, 68–89) ADEs, the patient required hospitalization, resulting in an estimated rate of 3.4 (CI, 2.7–4.3) admissions per 1,000 patients. The sensitivity of the search methods for identifying ADEs was estimated to be 58 (CI, 18–98) percent, and the estimated specificity was 88 (CI, 87–88) percent. The positive predictive value was 7.5 (CI, 6.5–8.5) percent, and the negative predictive value was 99.2 (CI, 95.5–99.98) percent. Compared with age and gender-matched controls with no positive screen, patients with ADEs had twice as many outpatient visits and were taking nearly three times as many drugs. Antihypertensives, ACE-inhibitors, antibiotics, and diuretics were associated with 56 (CI, 47–65) percent of ADEs. Among ADEs, 23 (CI, 16–32) percent were lifethreatening or serious, and 38 (CI, 29–47) percent were judged preventable.

Conclusion: Computerized search programs can detect ADEs, and free-text searches were especially useful. Adverse drug events were frequent, and admissions were not rare, although most hospitals today do not identify them. Thus, such detection programs demonstrate "value-added" for the electronic record and may be useful for directing and assessing the impact of quality improvement efforts.

This article has been cited by other articles:

				P D Mills, J Neily, L M Kinney, J Bagian, and W B Weeks Effective interventions and implementation strategies to reduce adverse drug events in the Veterans Affairs (VA) system Qual. Saf. Health Care, February 1, 2008; 17(1): 37 - 46. [Abstract] [Full Text] [PDF]

				L. A. Thomsen, A. G Winterstein, B. Sondergaard, L. S. Haugbolle, and A. Melander Systematic Review of the Incidence and Characteristics of Preventable Adverse Drug Events in Ambulatory Care Ann. Pharmacother., September 1, 2007; 41(9): 1411 - 1426. [Abstract] [Full Text] [PDF]

				E. J. Moskowitz and D. B. Nash The Quality and Safety of Ambulatory Medical Care: Current and Future Prospects American Journal of Medical Quality, August 1, 2007; 22(4): 274 - 288. [PDF]

				S. M. Handler, R. L. Altman, S. Perera, J. T. Hanlon, S. A. Studenski, J. E. Bost, M. I. Saul, and D. B. Fridsma A Systematic Review of the Performance Characteristics of Clinical Event Monitor Signals Used to Detect Adverse Drug Events in the Hospital Setting J. Am. Med. Inform. Assoc., July 1, 2007; 14(4): 451 - 458. [Abstract] [Full Text] [PDF]

				S. Phansalkar, J. M. Hoffman, J. R. Nebeker, and J. F. Hurdle Pharmacists versus nonpharmacists in adverse drug event detection: A meta-analysis and systematic review Am. J. Health Syst. Pharm., April 15, 2007; 64(8): 842 - 849. [Abstract] [Full Text] [PDF]

				M. N Cantor, H. J Feldman, and M. M Triola Using trigger phrases to detect adverse drug reactions in ambulatory care notes Qual. Saf. Health Care, April 1, 2007; 16(2): 132 - 134. [Abstract] [Full Text] [PDF]

				A. Turchin, N. S. Kolatkar, R. W. Grant, E. C. Makhni, M. L. Pendergrass, and J. S. Einbinder Using Regular Expressions to Abstract Blood Pressure and Treatment Intensification Information from the Text of Physician Notes J. Am. Med. Inform. Assoc., November 1, 2006; 13(6): 691 - 695. [Abstract] [Full Text] [PDF]

				B. Chaudhry, J. Wang, S. Wu, M. Maglione, W. Mojica, E. Roth, S. C. Morton, and P. G. Shekelle Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care Ann Intern Med, May 16, 2006; 144(10): 742 - 752. [Abstract] [Full Text] [PDF]

				J. J. Lin, A. Dunn, and C. Moore Follow-up of Outpatient Test Results: A Survey of House-Staff Practices and Perceptions. American Journal of Medical Quality, May 1, 2006; 21(3): 178 - 184. [Abstract] [PDF]

				D. M. Triller, S. L. Clause, and R. A. Hamilton Risk of adverse drug events by patient destination after hospital discharge Am. J. Health Syst. Pharm., September 15, 2005; 62(18): 1883 - 1889. [Abstract] [Full Text] [PDF]

				G. B. Melton and G. Hripcsak Automated Detection of Adverse Events Using Natural Language Processing of Discharge Summaries J. Am. Med. Inform. Assoc., July 1, 2005; 12(4): 448 - 457. [Abstract] [Full Text] [PDF]

				J. Horsky, G. J. Kuperman, and V. L. Patel Comprehensive Analysis of a Medication Dosing Error Related to CPOE J. Am. Med. Inform. Assoc., July 1, 2005; 12(4): 377 - 382. [Abstract] [Full Text] [PDF]

				I. S. Nash, M. Rojas, P. Hebert, S. R. Marrone, C. Colgan, L. A. Fisher, G. Caliendo, and M. R. Chassin Reducing Excessive Medication Administration in Hospitalized Adults With Renal Dysfunction American Journal of Medical Quality, March 1, 2005; 20(2): 64 - 69. [Abstract] [PDF]

				A. J. Forster, J. Andrade, and C. van Walraven Validation of a Discharge Summary Term Search Method to Detect Adverse Events J. Am. Med. Inform. Assoc., March 1, 2005; 12(2): 200 - 206. [Abstract] [Full Text] [PDF]

				A. A. Boxwala, M. Dierks, M. Keenan, S. Jackson, R. Hanscom, D. W. Bates, and L. Sato Organization and Representation of Patient Safety Data: Current Status and Issues around Generalizability and Scalability J. Am. Med. Inform. Assoc., November 1, 2004; 11(6): 468 - 478. [Abstract] [Full Text] [PDF]

				T. S. Field, J. H. Gurwitz, L. R. Harrold, J. M. Rothschild, K. Debellis, A. C. Seger, L. S. Fish, L. Garber, M. Kelleher, and D. W. Bates Strategies for Detecting Adverse Drug Events among Older Persons in the Ambulatory Setting J. Am. Med. Inform. Assoc., November 1, 2004; 11(6): 492 - 498. [Abstract] [Full Text] [PDF]

				T Morimoto, T K Gandhi, A C Seger, T C Hsieh, and D W Bates Adverse drug events and medication errors: detection and classification methods Qual. Saf. Health Care, August 1, 2004; 13(4): 306 - 314. [Abstract] [Full Text] [PDF]

				D. S. Bell, S. Cretin, R. S. Marken, and A. B. Landman A Conceptual Framework for Evaluating Outpatient Electronic Prescribing Systems Based on Their Functional Capabilities J. Am. Med. Inform. Assoc., January 1, 2004; 11(1): 60 - 70. [Abstract] [Full Text] [PDF]

				A. Frankel, T. K. Gandhi, and D. W. Bates Improving patient safety across a large integrated health care delivery system Int. J. Qual. Health Care, December 1, 2003; 15(90001): i31 - 40. [Abstract] [Full Text] [PDF]

				I. Hoch, A. D. Heymann, I. Kurman, L. J. Valinsky, G. Chodick, and V. Shalev Countrywide Computer Alerts to Community Physicians Improve Potassium Testing in Patients Receiving Diuretics J. Am. Med. Inform. Assoc., November 1, 2003; 10(6): 541 - 546. [Abstract] [Full Text] [PDF]

				D. W. Bates and A. A. Gawande Improving Safety with Information Technology N. Engl. J. Med., June 19, 2003; 348(25): 2526 - 2534. [Full Text] [PDF]

				G. D. Schiff, D. Klass, J. Peterson, G. Shah, and D. W. Bates Linking Laboratory and Pharmacy: Opportunities for Reducing Errors and Improving Care Arch Intern Med, April 28, 2003; 163(8): 893 - 900. [Abstract] [Full Text] [PDF]

				J. H. Gurwitz, T. S. Field, L. R. Harrold, J. Rothschild, K. Debellis, A. C. Seger, C. Cadoret, L. S. Fish, L. Garber, M. Kelleher, et al. Incidence and Preventability of Adverse Drug Events Among Older Persons in the Ambulatory Setting JAMA, March 5, 2003; 289(9): 1107 - 1116. [Abstract] [Full Text] [PDF]

				D. W. Bates, R. S. Evans, H. Murff, P. D. Stetson, L. Pizziferri, and G. Hripcsak Detecting Adverse Events Using Information Technology J. Am. Med. Inform. Assoc., March 1, 2003; 10(2): 115 - 128. [Abstract] [Full Text] [PDF]

				D. W. Bates, R. S. Evans, H. Murff, P. D. Stetson, L. Pizziferri, and G. Hripcsak Policy and the Future of Adverse Event Detection Using Information Technology J. Am. Med. Inform. Assoc., March 1, 2003; 10(2): 226 - 228. [Full Text] [PDF]

				J. G. Anderson, S. J. Jay, M. Anderson, and T. J. Hunt Evaluating the Capability of Information Technology to Prevent Adverse Drug Events: A Computer Simulation Approach J. Am. Med. Inform. Assoc., September 1, 2002; 9(5): 479 - 490. [Abstract] [Full Text] [PDF]