The Effect of Simple English Wikipedia on Machine Translation Output: An Evaluation with Cloze Procedure

Diplôme Master The Effect of Simple English Wikipedia on Machine Translation Output: An Evaluation with Cloze Procedure eng 2022 author Fitzroy Kirsty 899929 director Bouillon Pierrette 0000-0002-8854-6360 26962 Simplified text is known to improve the quality of machine translation output. Wikipedia and its simplified counterpart, Simple English Wikipedia, have been used extensively in datasets designed to capitalize on this. However, Simple English Wikipedia has previously been found to be unreliable as a simplified corpus. In this work, passages from the original Wikipedia and Simple English Wikipedia were machine translated by two neural systems, Google Translate and DeepL, and the output evaluated by human judges: firstly for quality, and secondly for comprehensibility using cloze procedure, an uncommon method. No differences were found in output. A corpus analysis of the source texts yielded few signs of simplification. These findings support previous studies showing that Simple English Wikipedia cannot be relied upon as a simplified corpus. Results also showed DeepL to be the best performing system and cloze procedure to be a suitable evaluation protocol for comprehensibility. Neural machine translation Simple English Wikipedia Cloze pocedure Text simplification Google Translate DeepL Gap-filling Traduction automatique neuronale Simplification de textes Dewey 410.2 Dewey 418.02 Maîtrise universitaire en traduction et technologies Mention localisation et traduction automatique 111 Département de traduction 91 112 Département de traitement informatique multilingue 92 false a489333c-3272-4154-87b9-e5747d655775 Master thesis Public MemoireSEW-Versionfinale.pdf 1612112 application/pdf openAccess Faculté de traduction et d'interprétation / Département de traduction Faculté de traduction et d'interprétation / Département de traitement informatique multilingue

Title	Published in	Access level	OA Policy	Year	Views	Downloads

The Effect of Simple English Wikipedia on Machine Translation Output: An Evaluation with Cloze Procedure				2022	539	406

Archive ouverte UNIGE

Fitzroy, Kirsty