help button home button JAMIA Bigger figures
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
This Article
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Kahn, M. G.
Right arrow Articles by Dunagan, W. C.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kahn, M. G.
Right arrow Articles by Dunagan, W. C.

Journal of the American Medical Informatics Association, Vol 3, 258-269, Copyright © 1996 by American Medical Informatics Association

ARTICLES

Statistical process control methods for expert system performance monitoring

MG Kahn, TC Bailey, SA Steib, VJ Fraser and WC Dunagan
Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA.

The literature on the performance evaluation of medical expert system is extensive, yet most of the techniques used in the early stages of system development are inappropriate for deployed expert systems. Because extensive clinical and informatics expertise and resources are required to perform evaluations, efficient yet effective methods of monitoring performance during the long-term maintenance phase of the expert system life cycle must be devised. Statistical process control techniques provide a well-established methodology that can be used to define policies and procedures for continuous, concurrent performance evaluation. Although the field of statistical process control has been developed for monitoring industrial processes, its tools, techniques, and theory are easily transferred to the evaluation of expert systems. Statistical process tools provide convenient visual methods and heuristic guidelines for detecting meaningful changes in expert system performance. The underlying statistical theory provides estimates of the detection capabilities of alternative evaluation strategies. This paper describes a set of statistical process control tools that can be used to monitor the performance of a number of deployed medical expert systems. It describes how p-charts are used in practice to monitor the GermWatcher expert system. The case volume and error rate of GermWatcher are then used to demonstrate how different inspection strategies would perform.


This article has been cited by other articles:


Home page
 ANN INTERN MEDHome page
D. M. Bravata, K. M. McDonald, W. M. Smith, C. Rydzak, H. Szeto, D. L. Buckeridge, C. Haberland, and D. K. Owens
Systematic Review: Surveillance Systems for Early Detection of Bioterrorism-Related Diseases
Ann Intern Med, June 1, 2004; 140(11): 910 - 922.
[Abstract] [Full Text] [PDF]

Home page
 Arch Intern MedHome page
G. D. Schiff, D. Klass, J. Peterson, G. Shah, and D. W. Bates
Linking Laboratory and Pharmacy: Opportunities for Reducing Errors and Improving Care
Arch Intern Med, April 28, 2003; 163(8): 893 - 900.
[Abstract] [Full Text] [PDF]

Home page
 J. Am. Med. Inform. Assoc.Home page
R. B. Elson, J. G. Faughnan, and D. P. Connelly
An Industrial Process View of Information Delivery to Support Clinical Decision Making: Implications for Systems Design and Process Measures
J. Am. Med. Inform. Assoc., July 1, 1997; 4(4): 266 - 278.
[Abstract] [Full Text] [PDF]


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Copyright © 1996 by the American Medical Informatics Association.