help button home button JAMIA Bigger figures
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS

This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Campbell, J. R.
Right arrow Articles by Warren, J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Campbell, J. R.
Right arrow Articles by Warren, J.
Journal of the American Medical Informatics Association 4:238-250 (1997)
© 1997 American Medical Informatics Association


Research Paper

Phase II Evaluation of Clinical Coding Schemes

Completeness, Taxonomy, Mapping, Definitions, and Clarity

James R. Campbell, MD, Paul Carpenter, MD, Charles Sneiderman, MD, PhD, Simon Cohn, MD, Christopher G. Chute, MD, DrPH, Judith Warren, RN PhD and CPRI Work Group on Codes and Structures

Affiliations of the authors: Departments of Internal Medicine and Information Technology Services (JRC); College of Nursing and University Hospital (JW); University of Nebraska Medical Center, Omaha NE; Section of Medical Information Resources, Mayo Foundation, Rochester, MN (PC, CGC); Cognitive Science Branch, National Library of Medicine, Bethesda, MD (CS); Kaiser Permanente Medical Care Program, Oakland CA (SC).

Correspondence and reprints: James R. Campbell MD, Department of Internal Medicine, University of Nebraska MC, 600 South 42nd Street, Omaha, NE 68198-3331. E-mail: CAMPBELL{at}UNMC.EDU

Abstract Objective: To compare three potential sources of controlled clinical terminology (READ codes version 3.1, SNOMED International, and Unified Medical Language System (UMLS) version 1.6) relative to attributes of completeness, clinical taxonomy, administrative mapping, term definitions and clarity (duplicate coding rate).

Methods: The authors assembled 1929 source concept records from a variety of clinical information taken from four medical centers across the United States. The source data included medical as well as ample nursing terminology. The source records were coded in each scheme by an investigator and checked by the coding scheme owner. The codings were then scored by an independent panel of clinicians for acceptability. Codes were checked for definitions provided with the scheme. Codes for a random sample of source records were analyzed by an investigator for "parent" and "child" codes within the scheme. Parent and child pairs were scored by an independent panel of medical informatics specialists for clinical acceptability. Administrative and billing code mapping from the published scheme were reviewed for all coded records and analyzed by independent reviewers for accuracy. The investigator for each scheme exhaustively searched a sample of coded records for duplications.

Results: SNOMED was judged to be significantly more complete in coding the source material than the other schemes (SNOMED* 70%; READ 57%; UMLS 50%; *p <.00001). SNOMED also had a richer clinical taxonomy judged by the number of acceptable first-degree relatives per coded concept (SNOMED* 4.56; UMLS 3.17; READ 2.14, *p <.005). Only the UMLS provided any definitions; these were found for 49% of records which had a coding assignment. READ and UMLS had better administrative mappings (composite score: READ* 40.6%; UMLS* 36.1%; SNOMED 20.7%, *p <. 00001), and SNOMED had substantially more duplications of coding assignments (duplication rate: READ 0%; UMLS 4.2%; SNOMED* 13.9%, *p <. 004) associated with a loss of clarity.

Conclusion: No major terminology source can lay claim to being the ideal resource for a computer-based patient record. However, based upon this analysis of releases for April 1995, SNOMED International is considerably more complete, has a compositional nature and a richer taxonomy. It suffers from less clarity, resulting from a lack of syntax and evolutionary changes in its coding scheme. READ has greater clarity and better mapping to administrative schemes (ICD-10 and OPCS-4), is rapidly changing and is less complete. UMLS is a rich lexical resource, with mappings to many source vocabularies. It provides definitions for many of its terms. However, due to the varying granularities and purposes of its source schemes, it has limitations for representation of clinical concepts within a computer-based patient record.




This article has been cited by other articles:


Home page
J. Am. Med. Inform. Assoc.Home page
S. T. Rosenbloom, R. A. Miller, K. B. Johnson, P. L. Elkin, and S. H. Brown
A Model for Evaluating Interface Terminologies
J. Am. Med. Inform. Assoc., January 1, 2008; 15(1): 65 - 76.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
J. E. Andrews, R. L. Richesson, and J. Krischer
Variation of SNOMED CT Coding of Clinical Research Concepts among Coding Experts
J. Am. Med. Inform. Assoc., July 1, 2007; 14(4): 497 - 506.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
R. L. Richesson, J. E. Andrews, and J. P. Krischer
Use of SNOMED CT to Represent Clinical Research Data: A Semantic Characterization of Data Items on Case Report Forms in Vasculitis Research
J. Am. Med. Inform. Assoc., September 1, 2006; 13(5): 536 - 546.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
S. T. Rosenbloom, R. A. Miller, K. B. Johnson, P. L. Elkin, and S. H. Brown
Interface Terminologies: Facilitating Direct Entry of Clinical Data into Electronic Health Record Systems
J. Am. Med. Inform. Assoc., May 1, 2006; 13(3): 277 - 288.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
A. S. Rothschild and H. P. Lehmann
Information Retrieval Performance of Probabilistically Generated, Problem-Specific Computerized Provider Order Entry Pick-Lists: A Pilot Study
J. Am. Med. Inform. Assoc., May 1, 2005; 12(3): 322 - 330.
[Abstract] [Full Text] [PDF]


Home page
BMJHome page
P. J B Brown, V. Warmington, M. Laurence, and A T. Prevost
Randomised crossover trial comparing the performance of Clinical Terms Version 3 and Read Codes 5 byte set coding schemes in general practice
BMJ, May 22, 2003; 326(7399): 1127.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
G. Hripcsak and A. Wilcox
Reference Standards, Judges, and Comparison Subjects: Roles for Experts in Evaluating System Performance
J. Am. Med. Inform. Assoc., January 1, 2002; 9(1): 1 - 15.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
A. Coenen, H. F. Marin, H.-A. Park, and S. Bakken
Collaborative Efforts for Representing Nursing Concepts in Computer-based Systems: International Perspectives
J. Am. Med. Inform. Assoc., May 1, 2001; 8(3): 202 - 211.
[Abstract] [Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
J. J. Cimino, V. L. Patel, and A. W. Kushniruk
Studying the Human- Computer-Terminology Interface
J. Am. Med. Inform. Assoc., March 1, 2001; 8(2): 163 - 173.
[Abstract] [Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
J. Stausberg, H. Lang, U. Obertacke, and F. Rauhut
Classifications in Routine Use: Lessons from ICD-9 and ICPM in Surgical Practice
J. Am. Med. Inform. Assoc., January 1, 2001; 8(1): 92 - 100.
[Abstract] [Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
S. Bakken, K. E. Campbell, J. J. Cimino, S. M. Huff, and W. E. Hammond
Toward Vocabulary Domain Specifications for Health Level 7--coded Data Elements
J. Am. Med. Inform. Assoc., July 1, 2000; 7(4): 333 - 342.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
S. Bakken, M. S. Cashen, E. A. Mendonca, A. O'Brien, and J. Zieniewicz
Representing Nursing Activities within a Concept-oriented Terminological System: Evaluation of aType Definition
J. Am. Med. Inform. Assoc., January 1, 2000; 7(1): 81 - 90.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
M. D. White, L. M. Kolar, and S. J. Steindel
Evaluation of Vocabularies for Electronic Laboratory Reporting to Public Health Agencies
J. Am. Med. Inform. Assoc., May 1, 1999; 6(3): 185 - 194.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
E. E. Westberg and R. A. Miller
The Basis for Using the Internet to Support the Information Needs of Primary Care
J. Am. Med. Inform. Assoc., January 1, 1999; 6(1): 6 - 25.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
S. B. Henry, J. J. Warren, L. Lange, and P. Button
A Review of Major Nursing Vocabularies and the Extent to Which They Have the Characteristics Required for Implementation in Computer-based Systems
J. Am. Med. Inform. Assoc., July 1, 1998; 5(4): 321 - 328.
[Abstract] [Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
P. Button, I. Androwich, L. Hibben, V. Kern, G. Madden, K. Marek, B. Westra, C. Zingo, and C. N. Mead
Challenges and Issues Related to Implementation of Nursing Vocabularies in Computer-based Systems
J. Am. Med. Inform. Assoc., July 1, 1998; 5(4): 332 - 334.
[Abstract] [Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
E. Schulz, J. W. Barrett, and C. Price
Read Code Quality Assurance: From Simple Syntax to Semantic Stability
J. Am. Med. Inform. Assoc., July 1, 1998; 5(4): 337 - 346.
[Abstract] [Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
K. E. Campbell, D. E. Oliver, and E. H. Shortliffe
The Unified Medical Language System: Toward a Collaborative Approach for Solving Terminologic Problems
J. Am. Med. Inform. Assoc., January 1, 1998; 5(1): 12 - 16.
[Abstract] [Full Text]


Home page
J. Am. Med. Inform. Assoc.Home page
B. L. Humphreys, A. T. McCray, and M. L. Cheh
Evaluating the Coverage of Controlled Health Data Terminologies: Report on the Results of the NLM/AHCPR Large Scale Vocabulary Test
J. Am. Med. Inform. Assoc., November 1, 1997; 4(6): 484 - 500.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
W. E. Hammond
Call for a Standard Clinical Vocabulary
J. Am. Med. Inform. Assoc., May 1, 1997; 4(3): 254 - 255.
[Full Text] [PDF]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Copyright © 1997 by the American Medical Informatics Association.