help button home button JAMIA Bigger figures
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS

This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Humphreys, B. L.
Right arrow Articles by Cheh, M. L.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Humphreys, B. L.
Right arrow Articles by Cheh, M. L.
Journal of the American Medical Informatics Association 4:484-500 (1997)
© 1997 American Medical Informatics Association


Research Paper

Evaluating the Coverage of Controlled Health Data Terminologies

Report on the Results of the NLM/AHCPR Large Scale Vocabulary Test

Betsy L. Humphreys, MLS, Alexa T. McCray, PhD and May L. Cheh, MS

Affiliation of the authors: National Library of Medicine, Bethesda, MD.

Correspondence and reprints: Betsy L. Humphreys, National Library of Medicine, 8600 Rockville Pike, Bethesda, MD 20894. E-mail: blh{at}nlm.nih.gov

Abstract Objective: To determine the extent to which a combination of existing machine-readable health terminologies cover the concepts and terms needed for a comprehensive controlled vocabulary for health information systems by carrying out a distributed national experiment using the Internet and the UMLS Knowledge Sources, lexical programs, and server.

Methods: Using a specially designed Web-based interface to the UMLS Knowledge Source Server, participants searched the more than 30 vocabularies in the 1996 UMLS Metathesaurus and three planned additions to determine if concepts for which they desired controlled terminology were present or absent. For each term submitted, the interface presented a candidate exact match or a set of potential approximate matches from which the participant selected the most closely related concept. The interface captured a profile of the terms submitted by the participant and for each term searched, information about the concept (if any) selected by the participant. The term information was loaded into a database at NLM for review and analysis and was also available to be downloaded by the participant. A team of subject experts reviewed records to identify matches missed by participants and to correct any obvious errors in relationships. The editors of SNOMED International and the Read Codes were given a random sample of reviewed terms for which exact meaning matches were not found to identify exact matches that were missed or any valid combinations of concepts that were synonymous to input terms. The 1997 UMLS Metathesaurus was used in the semantic type and vocabulary source analysis because it included most of the three planned additions.

Results: Sixty-three participants submitted a total of 41,127 terms, which represented 32,679 normalized strings. More than 80% of the terms submitted were wanted for parts of the patient record related to the patient's condition. Following review, 58% of all submitted terms had exact meaning matches in the controlled vocabularies in the test, 41% had related concepts, and 1% were not found. Of the 28% of the terms which were narrower in meaning than a concept in the controlled vocabularies, 86% shared lexical items with the broader concept, but had additional modification. The percentage of exact meaning matches varied by specialty from 45% to 71%. Twenty-nine different vocabularies contained meanings for some of the 23,837 terms (a maximum of 12,707 discrete concepts) with exact meaning matches. Based on preliminary data and analysis, individual vocabularies contained <1% to 63% of the terms and <1% to 54% of the concepts. Only SNOMED International and the Read Codes had more than 60% of the terms and more than 50% of the concepts.

Conclusions: The combination of existing controlled vocabularies included in the test represents the meanings of the majority of the terminology needed to record patient conditions, providing substantially more exact matches than any individual vocabulary in the set. From a technical and organizational perspective, the test was successful and should serve as a useful model, both for distributed input to the enhancement of controlled vocabularies and for other kinds of collaborative informatics research.




This article has been cited by other articles:


Home page
J. Am. Med. Inform. Assoc.Home page
S. T. Rosenbloom, R. A. Miller, K. B. Johnson, P. L. Elkin, and S. H. Brown
A Model for Evaluating Interface Terminologies
J. Am. Med. Inform. Assoc., January 1, 2008; 15(1): 65 - 76.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
J. E. Andrews, R. L. Richesson, and J. Krischer
Variation of SNOMED CT Coding of Clinical Research Concepts among Coding Experts
J. Am. Med. Inform. Assoc., July 1, 2007; 14(4): 497 - 506.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
R. L. Richesson, J. E. Andrews, and J. P. Krischer
Use of SNOMED CT to Represent Clinical Research Data: A Semantic Characterization of Data Items on Case Report Forms in Vasculitis Research
J. Am. Med. Inform. Assoc., September 1, 2006; 13(5): 536 - 546.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
J. Y. Sun and Y. Sun
A System for Automated Lexical Mapping
J. Am. Med. Inform. Assoc., May 1, 2006; 13(3): 334 - 343.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
S. T. Rosenbloom, R. A. Miller, K. B. Johnson, P. L. Elkin, and S. H. Brown
Interface Terminologies: Facilitating Direct Entry of Clinical Data into Electronic Health Record Systems
J. Am. Med. Inform. Assoc., May 1, 2006; 13(3): 277 - 288.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
L. G. Shapiro, E. Chung, L. T. Detwiler, J. L.V. Mejino Jr., A. V. Agoncillo, J. F. Brinkley, and C. Rosse
Processes and Problems in the Formative Evaluation of an Interface to the Foundational Model of Anatomy Knowledge Base
J. Am. Med. Inform. Assoc., January 1, 2005; 12(1): 35 - 46.
[Abstract] [Full Text] [PDF]


Home page
Journal of the American Dental AssociationHome page
T. K.L. SCHLEYER
Should dentistry be part of the National Health Information Infrastructure?
J Am Dent Assoc, December 1, 2004; 135(12): 1687 - 1695.
[Abstract] [Full Text] [PDF]


Home page
BMJHome page
P. J B Brown, V. Warmington, M. Laurence, and A T. Prevost
Randomised crossover trial comparing the performance of Clinical Terms Version 3 and Read Codes 5 byte set coding schemes in general practice
BMJ, May 22, 2003; 326(7399): 1127.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
W. A. Yasnoff, J. M. Overhage, B. L. Humphreys, and M. LaVenture
A National Agenda for Public Health Informatics: Summarized Recommendations from the 2001 AMIA Spring Congress
J. Am. Med. Inform. Assoc., November 1, 2001; 8(6): 535 - 545.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
S. Bakken, K. E. Campbell, J. J. Cimino, S. M. Huff, and W. E. Hammond
Toward Vocabulary Domain Specifications for Health Level 7--coded Data Elements
J. Am. Med. Inform. Assoc., July 1, 2000; 7(4): 333 - 342.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
E. E. Westberg and R. A. Miller
The Basis for Using the Internet to Support the Information Needs of Primary Care
J. Am. Med. Inform. Assoc., January 1, 1999; 6(1): 6 - 25.
[Abstract] [Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
M. Corn
Funding for Nursing Vocabularies
J. Am. Med. Inform. Assoc., July 1, 1998; 5(4): 391 - 392.
[Full Text]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Copyright © 1997 by the American Medical Informatics Association.