UNIGE document Chapitre d'actes
previous document  unige:30914  next document
add to browser collection
Title

Evaluating Appropriateness Of System Responses In A Spoken CALL Game

Authors
Published in The eighth international conference on Language Resources and Evaluation (LREC). Istanbul (Turkey) - 23-25 May 2012 - . 2012, p. 2690-2694
Abstract We describe an experiment carried out using a French version of CALL-SLT, a web-enabled CALL game in which students at each turn are prompted to give a semi-free spoken response which the system then either accepts or rejects. The central question we investigate is whether the response is appropriate; we do this by extracting pairs of utterances where both members of the pair are responses by the same student to the same prompt, and where one response is accepted and one rejected. When the two spoken responses are presented in random order, native speakers show a reasonable degree of agreement in judging that the accepted utterance is better than the rejected one. We discuss the significance of the results and also present a small study supporting the claim that native speakers are nearly always recognised by the system, while non-native speakers are rejected a significant proportion of the time.
Keywords CALLSpeech recognitionWebEvaluationFrench
Full text
Structures
Research group TIM/ISSCO
Citation
(ISO format)
RAYNER, Emmanuel, BOUILLON, Pierrette, GERLACH, Johanna. Evaluating Appropriateness Of System Responses In A Spoken CALL Game. In: The eighth international conference on Language Resources and Evaluation (LREC). Istanbul (Turkey). [s.l.] : [s.n.], 2012. p. 2690-2694. https://archive-ouverte.unige.ch/unige:30914

299 hits

125 downloads

Update

Deposited on : 2013-11-04

Export document
Format :
Citation style :