Proceedings chapter
OA Policy
English

A Bayesian Framework for Video Affective Representation

Presented atAmsterdam (Netherlands), 10-12 Sept. 2009
Publication date2009
Abstract

Emotions that are elicited in response to a video scene contain valuable information for multimedia tagging and indexing. The novelty of this paper is to introduce a Bayesian classification framework for affective video tagging that allows taking contextual information into account. A set of 21 full length movies was first segmented and informative content-based features were extracted from each shot and scene. Shots were then emotionally annotated, providing ground truth affect. The arousal of shots was computed using a linear regression on the content-based features. Bayesian classification based on the shots arousal and content-based features allowed tagging these scenes into three affective classes, namely calm, positive excited and negative excited. To improve classification accuracy, two contextual priors have been proposed: the movie genre prior, and the temporal dimension prior consisting of the probability of transition between emotions in consecutive scenes. The f1 classification measure of 54.9% that was obtained on three emotional classes with a nai¿ve Bayes classifier was improved to 63.4% after utilizing all the priors.

Keywords
  • Bayes methods
  • Emotion recognition
  • Feature extraction
  • Image classification
  • Image representation
  • Probability
  • Regression analysis
  • Video signal processing
Citation (ISO format)
SOLEYMANI, Mohammad et al. A Bayesian Framework for Video Affective Representation. In: 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, 2009. ACII 2009 : proceedings. Amsterdam (Netherlands). [s.l.] : [s.n.], 2009. p. 1–7. doi: 10.1109/ACII.2009.5349563
Main files (1)
Proceedings chapter (Published version)
accessLevelPublic
Identifiers
648views
744downloads

Technical informations

Creation06/03/2015 17:12:06
First validation06/03/2015 17:12:06
Update14/03/2023 22:58:28
Status update14/03/2023 22:58:28
Last indexation30/10/2024 23:16:59
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack