Proceedings chapter
OA Policy
English

Modifications of Machine Translation Evaluation Metrics by Using Word Embeddings

Presented atOsaka (Japan), 11 December 2016
Publication date2016
Abstract

Traditional machine translation evaluation metrics such as BLEU and WER have been widely used, but these metrics have poor correlations with human judgements because they badly represent word similarity and impose strict identity matching. In this paper, we propose some modifications to the traditional measures based on word embeddings for these two metrics. The evaluation results show that our modifications significantly improve their correlation with human judgements.

Citation (ISO format)
WANG, Haozhou, MERLO, Paola. Modifications of Machine Translation Evaluation Metrics by Using Word Embeddings. In: Proceedings of the Sixth Workshop on Hybrid Approaches to Translation (HyTra6). Osaka (Japan). [s.l.] : [s.n.], 2016. p. 33–41.
Main files (1)
Proceedings chapter (Published version)
Identifiers
  • PID : unige:139724
Additional URL for this publicationhttps://www.aclweb.org/anthology/W16-4505/
229views
50downloads

Technical informations

Creation14/08/2020 17:03:00
First validation14/08/2020 17:03:00
Update time15/03/2023 22:25:37
Status update15/03/2023 22:25:36
Last indexation31/10/2024 19:27:14
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack