Proceedings chapter
OA Policy
English

Work-in-Progress project report : CESTA - Machine Translation Evaluation Campaign

Presented atGeneva (Switzerland)
Publication date2004
Abstract

CESTA, the first European Campaign dedicated to MT Evaluation, is a project labelled by the French Technolangue action. CESTA provides an evaluation of six commercial and academic MT systems using a protocol set by an international panel of experts. CESTA aims at producing reusable resources and information about reliability of the metrics. Two runs will be carried out: one using the system's basic dictionary, another after terminological adaptation. Evaluation task, test material, resources, evaluation measures, metrics, will be detailed in the full paper. The protocol is the combination of a contrastive reference to: IBM “BLEU” protocol (Papineni, K., S. Roukos, T. Ward and Z. Wei-Jing, 2001); “BLANC” protocol derived from (Hartley, Rajman, 2002).; “ROUGE” protocol (Babych, Hartley, Atwell, 2003). The results of the campaign will be published in a final report and be the object of two intermediary and final workshops.

Research groups
Citation (ISO format)
MUSTAFA EL HADI, Widad et al. Work-in-Progress project report : CESTA - Machine Translation Evaluation Campaign. In: Second International Workshop on Language Resources for Translation Work, Research and Training. Elia Yuste Rodrigo (Ed.). Geneva (Switzerland). [s.l.] : [s.n.], 2004. p. 8–17. doi: 10.3115/1708087.1708090
Main files (1)
Proceedings chapter (Published version)
accessLevelPublic
Identifiers
731views
517downloads

Technical informations

Creation29/07/2009 15:50:00
First validation29/07/2009 15:50:00
Update26/01/2026 13:20:22
Status update26/01/2026 13:20:22
Last indexation26/01/2026 13:20:38
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack