Proceedings chapter
OA Policy
English

Evaluating a Multilingual Pre-trained Model for the Automatic Standard German Captioning of Swiss German TV

Presented atNeuchâtel, June 2023
Published inHatem Ghorbel, Maria Sokhn, Mark Cieliebak, Manuela Hürlimann, Emmanuel de Salis, Jonathan Guerne (Ed.), Proceedings of the 8th edition of the Swiss Text Analytics Conference, p. 14-22
PublisherNeuchâtel : Association for Computational Linguistics
Publication date2023
Abstract

In Switzerland, two thirds of the population speak Swiss German, a primarily spoken language with no standardised written form. It is widely used on Swiss TV, for example in news reports, interviews and talk shows, and captions are required for people who do not understand this spoken language. This paper focuses on the second part of a cascade approach for the automatic Standard German captioning of spoken Swiss German. We apply a multilingual pre-trained model to translate automatic speech recognition of Swiss German into Standard German suitable for captioning. Results of several evaluations, both human and automatic, show that the system succeeds in improving the content, but is currently not capable of producing entirely correct Standard German.

Keywords
  • Low-resource language
  • Captioning
  • Swiss German
  • Neural machine translation
NoteFunded by the Initiative for Media Innovation based at the EPFL’s Media Center in Lausanne, Switzerland
Research groups
Citation (ISO format)
GERLACH, Johanna et al. Evaluating a Multilingual Pre-trained Model for the Automatic Standard German Captioning of Swiss German TV. In: Proceedings of the 8th edition of the Swiss Text Analytics Conference. Hatem Ghorbel, Maria Sokhn, Mark Cieliebak, Manuela Hürlimann, Emmanuel de Salis, Jonathan Guerne (Ed.). Neuchâtel. Neuchâtel : Association for Computational Linguistics, 2023. p. 14–22.
Main files (1)
Proceedings chapter (Published version)
Identifiers
  • PID : unige:174988
Additional URL for this publicationhttps://aclanthology.org/2023.swisstext-1.2/
154views
80downloads

Technical informations

Creation20/02/2024 08:40:03
First validation20/02/2024 16:33:07
Update time13/10/2025 14:05:27
Status update26/02/2024 09:06:37
Last indexation14/11/2025 13:25:22
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack