Scientific article
OA Policy
English

How ChatGPT writes scientific titles in medical research : structural and content differences compared to human authors

Published inJournal of the Medical Library Association, vol. 114, no. 3, p. 222-237
Publication date2026-07-01
First online date2026-07-14
Abstract

Objective: Scientific article titles play a central role in shaping research visibility, interpretation, and discoverability. With the rise of large language models like ChatGPT, there is growing interest in using AI tools to support title generation, yet little is known about how AI-generated titles differ from those written by human authors. This study compared titles written by original authors to those generated by ChatGPT-4.0 from the same abstracts, focusing on structural and content-level differences.

Methods: Fifty research articles published in 2000, before the advent of generative AI, were randomly selected from ten high-impact general internal medicine journals. For each, the structured abstract was submitted to ChatGPT-4.0 using a standardized prompt to generate a title. Human-written and AI-generated titles were then compared using quantitative measures (word and character counts, punctuation marks) and descriptive content analysis (study design, population descriptors, outcome emphasis, public health or clinical framing, temporal context). Paired statistical tests were applied to assess differences.

Results: ChatGPT-generated titles were significantly longer than human-written titles (median 16 vs. 12.5 words, p-value<0.001) and included more characters and punctuation marks (colons in 100% vs. 30%; p-value<0.001). AI titles more often specified or clarified study design, detailed populations, emphasized outcomes, framed findings in public health or clinical terms, and incorporated temporal context.

Conclusion: ChatGPT-4.0 produces more explicit and structured titles than human authors, emphasizing methodological clarity and content completeness. These findings raise important questions about norms in scientific communication and the need for further research and ethical guidance on AI-assisted writing.

Keywords
  • AI
  • Article Title
  • Artificial Intelligence
  • ChatGPT
  • Language Model
  • Medical Publishing
  • Scientific Writing
Citation (ISO format)
SEBOE, Paul, NIE, Bing, WANG, Ting. How ChatGPT writes scientific titles in medical research : structural and content differences compared to human authors. In: Journal of the Medical Library Association, 2026, vol. 114, n° 3, p. 222–237. doi: 10.5195/jmla.2026.2266
Main files (1)
Article (Published version)
Identifiers
Additional URL for this publicationhttp://jmla.pitt.edu/ojs/jmla/article/view/2266
Journal ISSN1536-5050
1views
0downloads

Technical informations

Creation17/07/2026 11:10:19
First validation10/08/2026 13:55:56
Update10/08/2026 13:55:56
Status update10/08/2026 13:55:56
Last indexation10/08/2026 13:55:57
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack