en
Proceedings chapter
Open access
English

Work-in-Progress project report : CESTA - Machine Translation Evaluation Campaign

Presented at Geneva (Switzerland)
Publication date2004
Abstract

CESTA, the first European Campaign dedicated to MT Evaluation, is a project labelled by the French Technolangue action. CESTA provides an evaluation of six commercial and academic MT systems using a protocol set by an international panel of experts. CESTA aims at producing reusable resources and information about reliability of the metrics. Two runs will be carried out: one using the system's basic dictionary, another after terminological adaptation. Evaluation task, test material, resources, evaluation measures, metrics, will be detailed in the full paper. The protocol is the combination of a contrastive reference to: IBM “BLEU” protocol (Papineni, K., S. Roukos, T. Ward and Z. Wei-Jing, 2001); “BLANC” protocol derived from (Hartley, Rajman, 2002).; “ROUGE” protocol (Babych, Hartley, Atwell, 2003). The results of the campaign will be published in a final report and be the object of two intermediary and final workshops.

Research group
Citation (ISO format)
MUSTAFA EL HADI, Widad et al. Work-in-Progress project report : CESTA - Machine Translation Evaluation Campaign. In: Second International Workshop on Language Resources for Translation Work, Research and Training. Geneva (Switzerland). [s.l.] : [s.n.], 2004. p. 8–17.
Main files (1)
Proceedings chapter (Published version)
accessLevelPublic
Identifiers
  • PID : unige:2272
642views
353downloads

Technical informations

Creation07/29/2009 3:50:00 PM
First validation07/29/2009 3:50:00 PM
Update time03/14/2023 3:09:46 PM
Status update03/14/2023 3:09:46 PM
Last indexation01/15/2024 6:38:59 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack