Doctoral thesis
OA Policy
English

Evaluating Large Language Models for Low-Resource Multilingual Machine Translation in the Medical Domain

Number of pages308
Imprimatur date2026-04-17
Defense date2026-01-23
Abstract

This dissertation explores neural machine translation (NMT) in multilingual medical domain, with a focus on clinical low-resource settings. Conducted in the context of the BabelDr and PictoDr projects, which aim to support communication between patients and healthcare providers, this work addresses the translation of medical utterances across 13 language combinations, including several low-resource languages such as Tigrinya, Dari, and Tunisian Arabic. It also investigates translation into biomedical glosses (UMLS) and pictogram representations to support non-verbal communication.

We evaluate domain-adapted NMT systems trained from scratch using in-domain data, and compare them with large language models used in zero-shot, fewshot settings and fine-tuning. A multilingual evaluation framework is proposed, combining automatic metrics with expert-based human assessment focusing on adequacy, fluency, and usability in clinical scenarios. Our findings show that while general-purpose LLMs demonstrate promising capabilities, they fall short on domain-specific tasks in low-resource languages. In contrast, domain-specific NMT systems offer more reliable outputs.

This work highlights the importance of domain adaptation, evaluation, and inclusive language coverage for translation tools in multilingual healthcare environments.

Keywords
  • Multilingual Neural Machine Translation
  • Low-Resource Languages
  • Medical Dialogues
  • Large Language Models
  • Clinical Communication
  • Domain Adaptation
  • Pictogram Translation
  • UMLS Gloss Translation
  • Human Evaluation of MT
  • Healthcare Language Technologies
Citation (ISO format)
MUTAL, Jonathan David. Evaluating Large Language Models for Low-Resource Multilingual Machine Translation in the Medical Domain. Thèse, 2026. doi: 10.13097/archive-ouverte/unige:193090
Main files (1)
Secondary files (1)
Imprimatur
accessLevelPublic
Identifiers
77views
176downloads

Technical informations

Creation22/04/2026 16:00:50
First validation23/04/2026 14:06:33
Update11/05/2026 13:56:35
Status update11/05/2026 13:56:35
Last indexation11/05/2026 13:56:39
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack