Proceedings chapter
OA Policy
English

Affective Characterization of Movie Scenes Based on Multimedia Content Analysis and User's Physiological Emotional Responses

Presented at

Berkeley (US), 15-17 Dec. 2008

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Publication date

2008

Abstract

In this paper, we propose an approach for affective representation of movie scenes based on the emotions that are actually felt by spectators. Such a representation can be used for characterizing the emotional content of video clips for e.g. affective video indexing and retrieval, neuromarketing studies, etc. A dataset of 64 different scenes from eight movies was shown to eight participants. While watching these clips, their physiological responses were recorded. The participants were also asked to self-assess their felt emotional arousal and valence for each scene. In addition, content-based audio- and video-based features were extracted from the movie scenes in order to characterize each one. Degrees of arousal and valence were estimated by a linear combination of features from physiological signals, as well as by a linear combination of content-based features. We showed that a significant correlation exists between arousal/valence provided by the spectator's self-assessments, and affective grades obtained automatically from either physiological responses or from audio-video features. This demonstrates the ability of using multimedia features and physiological responses to predict the expected affect of the user in response to the emotional video content.

Keywords

  • Multimedia indexing and retrieval
  • Affective computing
  • Affective personalization and characterization
  • Emotion recognition and assessment
  • Physiological signals analysis

Citation (ISO format)

SOLEYMANI, Mohammad et al. Affective Characterization of Movie Scenes Based on Multimedia Content Analysis and User’s Physiological Emotional Responses. In: Tenth IEEE International Symposium on Multimedia Multimedia, ISM 2008. Berkeley (US). [s.l.] : Institute of Electrical and Electronics Engineers (IEEE), 2008. p. 228–235. doi: 10.1109/ISM.2008.14

Main files (2)

Proceedings chapter (Published version)
Proceedings chapter (Accepted version)

Identifiers

707views
486downloads

Technical informations

Creation

06/03/2015 17:12:06

First validation

06/03/2015 17:12:06

Update

14/03/2023 22:58:33

Status update

14/03/2023 22:58:32

Last indexation

30/10/2024 23:17:28
All rights reserved by Archive ouverte UNIGE and the University of Geneva
OpenAIRE Indexed & Validated