Scientific article
OA Policy
English

Generating Human-Readable Labels for SNOMED CT Expressions with LLMs : A Study on Model Performance and Rater Subjectivity

Published inStudies in health technology and informatics, vol. 336, p. 944-948
Publication date2026-05-21
Abstract

Post-coordinated SNOMED CT expressions lack human-readable labels, hindering their use in analytics and representation learning. To address this issue, we evaluated labels for 100 SNOMED CT expressions generated by a large language model (LLM), which were blindly rated on semantic equivalence and phrasing quality by two clinical terminologists. While the LLM-generated labels achieved semantic equivalence comparable to official SNOMED CT terms, revealing primarily stylistic rather than conceptual errors, we found negligible interrater reliability between experts when rating novel post-coordinated expressions. This indicates that automated labeling is a viable approach, where the primary challenge is not model performance but the inherent subjectivity of the task itself. This suggests the objective could be reframed towards achieving semantic plausibility at scale, rather than replicating a single, definitive expert consensus.

Keywords
  • Large Language Model (LLM)
  • Representation Learning
  • SNOMED CT
  • Post-coordination
  • Systematized Nomenclature of Medicine
  • Semantics
  • Natural Language Processing
  • Humans
Citation (ISO format)
BENSALAH TALET, Adel Fouad et al. Generating Human-Readable Labels for SNOMED CT Expressions with LLMs : A Study on Model Performance and Rater Subjectivity. In: Studies in health technology and informatics, 2026, vol. 336, p. 944–948. doi: 10.3233/SHTI260318
Main files (1)
Article (Published version)
Identifiers
Additional URL for this publicationhttps://ebooks.iospress.nl/doi/10.3233/SHTI260318
Journal ISSN0926-9630
3views
9downloads

Technical informations

Creation01/06/2026 08:57:04
First validation01/07/2026 08:27:26
Update01/07/2026 08:27:26
Status update01/07/2026 08:27:26
Last indexation01/07/2026 08:27:27
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack