Proceedings chapter
OA Policy
English

Assessing Human and Automated Quality Judgments in the French MT Evaluation Campaign CESTA

Presented atCopenhagen (Denmark), 10-14 September
Publication date2007
Abstract

This paper analyzes the results of the French MT Evaluation Campaign, CESTA (2003-2006). The details of the campaign are first briefly described. The paper then focuses on the results of the two runs, which used human metrics, such as fluency or adequacy, as well as automated metrics, mainly based on n-gram comparison and word error rates. The results show that the quality of the systems can be reliably compared using these metrics, and that the adaptability of some systems to a given domain – which was the focus of CESTA's second run – is not strictly related to their intrinsic performance.

Citation (ISO format)
HAMON, Olivier et al. Assessing Human and Automated Quality Judgments in the French MT Evaluation Campaign CESTA. In: Proceedings of Machine Translation Summit XI. Copenhagen (Denmark). [s.l.] : [s.n.], 2007. p. 231–238.
Main files (1)
Proceedings chapter
accessLevelPublic
Identifiers
  • PID : unige:3488
587views
366downloads

Technical informations

Creation02/10/2009 09:31:21
First validation02/10/2009 09:31:21
Update14/03/2023 15:14:59
Status update14/03/2023 15:14:59
Last indexation29/10/2024 12:19:14
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack