en
Proceedings chapter
English

Continuous Emotion Detection in Response to Music Videos

Presented at Santa Barbara (US), 21-25 March 2011
PublisherInstitute of Electrical and Electronics Engineers ( IEEE )
Publication date2011
Abstract

Viewers' preference for multimedia selection depends highly on their emotional experience. In this paper, we present an emotion detection method for music videos using central and peripheral nervous system physiological signals as well as multimedia content analysis. A set of 40 music clips eliciting a broad range of emotions were first selected. After extracting the one minute long emotional highlight of each video, they were shown to 32 participants while their physiological responses were recorded. Participants self-reported their felt emotions after watching each clip by means of arousal, valence, dominance, and liking ratings. The physiological signals included electroencephalogram, galvanic skin response, respiration pattern, skin temperature, electromyograms and blood volume pulse using plethysmograph. Emotional features were extracted from the signals and the multimedia content. The emotional features were used to train a linear ridge regressor to detect emotions for each participant using a leave-one-out cross-validation strategy. The performance of the personalized emotion detection is shown to be significantly superior to a random regressor.

Keywords
  • Petamedia
  • Electrodes
  • Electroencephalography
  • Feature extraction
  • Heat rate variability
  • Multimedia communication
  • Skin
  • Videos
NoteAlso publ. in: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops, FG 2011
Citation (ISO format)
SOLEYMANI, Mohammad et al. Continuous Emotion Detection in Response to Music Videos. In: 1st International Workshop on Emotion Synthesis, rePresentation, and Analysis in Continuous spacE, EmoSPACE 2011. Santa Barbara (US). [s.l.] : Institute of Electrical and Electronics Engineers ( IEEE ), 2011. doi: 10.1109/FG.2011.5771352
Main files (1)
Proceedings chapter (Accepted version)
accessLevelRestricted
Identifiers
584views
1downloads

Technical informations

Creation03/06/2015 5:12:05 PM
First validation03/06/2015 5:12:05 PM
Update time03/14/2023 10:58:21 PM
Status update03/14/2023 10:58:20 PM
Last indexation01/16/2024 5:07:28 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack