Scientific article
OA Policy
English

The consensus-based CINEX guideline for reporting clinical information extraction studies

First online date2026-08-08
Abstract

Objective: Information extraction (IE) from clinical texts has advanced rapidly with recent advances in natural language processing, particularly the advent of large language models (LLMs). However, inconsistent and incomplete reporting of methodologies limits reproducibility, comparability, and clinical translation. We aimed to develop a consensus-based reporting guideline tailored to clinical IE studies.

Material and methods: We developed the Clinical Information Extraction Reporting Guideline (CINEX) through a multi-phase process. The initiative was prospectively registered on the EQUATOR Network as a reporting guideline under development, and a detailed Delphi study protocol was published in advance. A scoping review informed an initial set of items, which was refined through a 3-round electronic Delphi study with 20 international experts, followed by a final consensus meeting. Items were iteratively refined based on predefined inclusion criteria and expert feedback.

Results: The final CINEX guideline comprises 29 checklist items grouped into 5 domains: information model, architecture, data, annotation, and outcomes. The 3 eDelphi rounds included 20, 15, and 12 experts, respectively. Two items were added after round one. Consensus for inclusion was reached for a 21 and additional 7 items after rounds 2 and 3, respectively.

Discussion: CINEX provides a structured framework to improve transparency, reproducibility, and interpretability in clinical IE research. By standardizing reporting of key methodological components, such as data provenance, annotation processes, and evaluation strategies, it facilitates meaningful comparison across studies and supports safer clinical implementation.

Conclusion: CINEX complements existing AI reporting standards by addressing domain-specific challenges in clinical IE.

Keywords
  • Delphi study
  • Consensus statement
  • Information extraction
  • Reporting guideline
  • Reporting quality
Citation (ISO format)
REICHENPFADER, Daniel et al. The consensus-based CINEX guideline for reporting clinical information extraction studies. In: Journal of the American Medical Informatics Association, 2026, p. ocag136. doi: 10.1093/jamia/ocag136
Main files (1)
Article (Published version)
Secondary files (2)
Supplemental data
accessLevelPublic
Supplemental data
accessLevelPublic
Identifiers
Journal ISSN1067-5027
1views
0downloads

Technical informations

Creation10/08/2026 16:37:46
First validation25/08/2026 07:11:24
Update25/08/2026 07:11:24
Status update25/08/2026 07:11:24
Last indexation25/08/2026 07:11:25
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack