• Home
  1. Home
  2. Crowdsourcing for Affective Annotation of Video : Development of a Viewer-reported Boredom Corpus
Proceedings chapter
OA Policy
English

Crowdsourcing for Affective Annotation of Video : Development of a Viewer-reported Boredom Corpus

Contributors

Soleymani, Mohammad; Larson, Martha

Presented at

Geneva (Switzerland), 19th and 23rd of July 2010

Published in

Workshop on Crowdsourcing for Search Evaluation, SIGIR 2010

Publication date

2010

Abstract

Predictions of viewer affective response to video are an important source of information that can be used to enhance the performance of multimedia retrieval and recommendation systems. The development of algorithms for robust prediction of viewer affective response requires corpora accompanied by appropriate ground truth. We report on the development a new corpus to be used to evaluate algorithms for prediction of viewer-reported boredom.We make use of crowdsourcing in order to address two shortcomingsof previous affective video corpora: small number of annotators and gap between annotators and target viewer group. We describe the design of the Mechanical Turk setup that we used to generate the affective annotations for the corpus. We discuss specific issues that arose and how we resolve them and then present an analysis of the annotations collected. The paper closes with a list of recommended practices for the collection of self-reported affective annotations using crowdsourcing techniques and an outlookon future work.

Keywords

  • Petamedia
  • Algorithms
  • Measurement
  • Design
  • Experimentation

UNIGE affiliation entities

UNIGE research groups

Citation (ISO format)

SOLEYMANI, Mohammad, LARSON, Martha. Crowdsourcing for Affective Annotation of Video : Development of a Viewer-reported Boredom Corpus. In: Workshop on Crowdsourcing for Search Evaluation, SIGIR 2010. Geneva (Switzerland). [s.l.] : [s.n.], 2010.

Main files (1)

Proceedings chapter (Published version)

Identifiers

  • PID : unige:47650
1001views
639downloads

Technical informations

Creation

06/03/2015 17:12:05

First validation

06/03/2015 17:12:05

Update

14/03/2023 22:58:23

Status update

14/03/2023 22:58:22

Last indexation

30/10/2024 23:16:45
All rights reserved by Archive ouverte UNIGE and the University of Geneva
OpenAIRE Indexed & Validated