en
Proceedings chapter
Open access
English

Overview of the 2017 Spoken CALL Shared Task

Presented at Stockholm, Sweden
Publication date2017
Abstract

We present an overview of the shared task for spoken CALL. Groups competed on a prompt-response task using English-language data collected, through an online CALL game, from Swiss German teens in their second and third years of learning English. Each item consists of a written German prompt and an audio file containing a spoken response. The task is to accept linguistically correct responses and reject linguistically incorrect ones, with “linguistically correct” being defined by a gold standard derived from human annotations; scoring was performed using a metric defined as the ratio of the relative rejection rates on incorrect and correct responses. The task received twenty entries from nine different groups. We present the task itself, the results, a tentative analysis of what makes items challenging, a comparison between different metrics, and suggestions for a continuation.

Citation (ISO format)
BAUR, Claudia et al. Overview of the 2017 Spoken CALL Shared Task. In: Workshop on Speech and Language Technology in Education (SLaTE). Stockholm, Sweden. [s.l.] : [s.n.], 2017.
Main files (1)
Proceedings chapter (Published version)
accessLevelPublic
Identifiers
  • PID : unige:97428
576views
273downloads

Technical informations

Creation10/06/2017 10:34:00 AM
First validation10/06/2017 10:34:00 AM
Update time03/15/2023 2:06:23 AM
Status update03/15/2023 2:06:23 AM
Last indexation05/02/2024 7:32:43 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack