UNIGE document Scientific Article
previous document  unige:106735  next document
add to browser collection
Title

Aesthetic Highlight Detection in Movies Based on Synchronization of Spectators' Reactions
Authors
Muszynski, Michal
Kostoulas, Theodoros
Lombardo, Patrizia
Pun, Thierry
Chanel, Guillaume
Published in ACM Transactions on Multimedia Computing, Communications, and Applications. 2018, vol. 14, no. 3, p. 1-23
Abstract Detection of aesthetic highlights is a challenge for understanding the affective processes taking place during movie watching. In this article, we study spectators' responses to movie aesthetic stimuli in a social context. Moreover, we look for uncovering the emotional component of aesthetic highlights in movies. Our assumption is that synchronized spectators' physiological and behavioral reactions occur during these highlights because: (i) aesthetic choices of filmmakers are made to elicit specific emotional reactions (e.g., special effects, empathy, and compassion toward a character) and (ii) watching a movie together causes spectators' affective reactions to be synchronized through emotional contagion. We compare different approaches to estimation of synchronization among multiple spectators' signals, such as pairwise, group, and overall synchronization measures to detect aesthetic highlights in movies. The results show that the unsupervised architecture relying on synchronization measures is able to capture different properties of spectators' synchronization and detect aesthetic highlights based on both spectators' electrodermal and acceleration signals. We discover that pairwise synchronization measures perform the most accurately independently of the category of the highlights and movie genres. Moreover, we observe that electrodermal signals have more discriminative power than acceleration signals for highlight detection.
Identifiers
Full text
Article (Accepted version) (2 MB) - public document Free access
Other version: http://dl.acm.org/citation.cfm?doid=3241977.3175497
Structures
Faculté des sciences / Département d'informatique
Centres et instituts / Centre universitaire d'informatique
Centres et instituts / Centre interfacultaire en sciences affectives
Research groups Computer Vision and Multimedia Laboratory
Multimodal Interaction Group
Project
Swiss National Science Foundation: 205121_153239
Citation
(ISO format) 		MUSZYNSKI, Michal et al. Aesthetic Highlight Detection in Movies Based on Synchronization of Spectators' Reactions. In: ACM Transactions on Multimedia Computing, Communications, and Applications, 2018, vol. 14, n° 3, p. 1-23. doi: 10.1145/3175497 https://archive-ouverte.unige.ch/unige:106735

441 hits

307 downloads

Contact an author

Update request

Update

Deposited on : 2018-07-30

Export document
Format :
Citation style :