Scientific article
Open access

Toward a Minimal Representation of Affective Gestures

Published inIEEE Transactions on Affective Computing, vol. 2, no. 2, p. 106-118
Publication date2011

This paper presents a framework for analysis of affective behavior starting with a reduced amount of visual information related to human upper-body movements. The main goal is to individuate a minimal representation of emotional displays based on nonverbal gesture features. The GEMEP (Geneva multimodal emotion portrayals) corpus was used to validate this framework. Twelve emotions expressed by 10 actors form the selected data set of emotion portrayals. Visual tracking of trajectories of head and hands were performed from a frontal and a lateral view. Postural/shape and dynamic expressive gesture features were identified and analyzed. A feature reduction procedure was carried out, resulting in a 4D model of emotion expression that effectively classified/grouped emotions according to their valence (positive, negative) and arousal (high, low). These results show that emotionally relevant information can be detected/measured/obtained from the dynamic qualities of gesture. The framework was implemented as software modules (plug-ins) extending the EyesWeb XMI Expressive Gesture Processing Library and is going to be used in user centric, networked media applications, including future mobiles, characterized by low computational resources, and limited sensor systems.

  • Feature extraction
  • Trajectory
  • Head
  • Humans
  • Visualization
  • Emotion recognition
  • Three dimensional displays
Research group
Citation (ISO format)
GLOWINSKI, Donald et al. Toward a Minimal Representation of Affective Gestures. In: IEEE Transactions on Affective Computing, 2011, vol. 2, n° 2, p. 106–118. doi: 10.1109/T-AFFC.2011.7
Main files (1)
Article (Published version)
ISSN of the journal1949-3045

Technical informations

Creation09/18/2017 3:14:00 PM
First validation09/18/2017 3:14:00 PM
Update time03/15/2023 2:02:16 AM
Status update03/15/2023 2:02:16 AM
Last indexation05/02/2024 7:30:25 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack