Scientific article
OA Policy
English

Impact of LLM Scale and Quantization on Information Extraction from Clinical Text

Published inStudies in health technology and informatics, vol. 336, p. 829-833
Publication date2026-05-21
Abstract

Large Language Models (LLMs) show strong potential for extracting structured information from unstructured clinical narratives. However, their adoption in healthcare is constrained by privacy requirements that necessitate local deployment, often under limited computational resources. This study systematically investigates the trade-offs between model size and numerical precision (quantization) in locally deployed, open-source LLMs applied to a clinical information extraction task. Using seven reasoning models from the Qwen3 and DeepSeek-R1 families (0.6B-70B parameters) and six quantization levels (2, 3, 4, 5, 6, and 8 bits), we evaluated performance on the classification of the modified Rankin Scale (mRS) score from 105 neurosurgery patient notes. A linear mixed-effects analysis revealed significant effects for log-scaled model size (β=-0.84, p<0.001), quantization (β=-0.12, p<0.001), and their interaction (β=0.08, p<0.001). Larger models and higher numerical precision yielded lower extraction error, but the performance plateaued at 4-5-bit precision. Our results suggest that clinically useful information extraction is achievable with moderately sized, locally deployed LLMs, supporting their feasibility for privacy-preserving healthcare applications.

Keywords
  • LLMs
  • Clinical NLP
  • Modified Rankin Scale
  • Quantization
  • Scaling law
Funding
  • European Commission - Towards GEMINI: A Generation of Multi-scale Digital Twins of Ischaemic and Haemorrhagic Stroke Patients [101136438]
Citation (ISO format)
BORNET, Alban et al. Impact of LLM Scale and Quantization on Information Extraction from Clinical Text. In: Studies in health technology and informatics, 2026, vol. 336, p. 829–833. doi: 10.3233/SHTI260295
Main files (1)
Article (Published version)
Identifiers
Additional URL for this publicationhttps://ebooks.iospress.nl/doi/10.3233/SHTI260295
Journal ISSN0926-9630
8views
4downloads

Technical informations

Creation10/06/2026 13:05:46
First validation08/07/2026 07:13:47
Update08/07/2026 07:13:47
Status update08/07/2026 07:13:47
Last indexation08/07/2026 07:13:48
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack