Proceedings chapter
OA Policy
English

Emotion Detection in the Loop from Brain Signals and Facial Images

Presented atDubrovnik (Croatia), July 17th – August 11th 2006
Publication date2006
Abstract

In this project, we intended to develop techniques for multimodal emotion detection, one modality being brain signals via fNIRS, the second modality being face video and the third modality being the scalp EEG signals. EEG andfNIRS provided us with an “internal” look at the emotion generation processes, while video sequence gave us an “external” look on the “same” phenomenon.Fusions of fNIRS with video and of EEG with fNIRS were considered. Fusion of all three modalities was not considered due to the extensive noise on the EEG signals caused by facial muscle movements, which are required for emotion detection from video sequences.Besides the techniques mentioned above, peripheral signals, namely, respiration, cardiac rate, and galvanic skin resistance were also measured from the subjects during “fNIRS + EEG” recordings. These signals provided us with extra information about the emotional state of the subjects.The critical point in the success of this project was to be able to build a “good” database. Good data acquisition means synchronous data and requires the definition of some specific experimental protocols for emotions elicitation. Thus, we devoted much of our time to data acquisition throughout the workshop, which resulted in a large enough database formaking the first analyses. Results presented in this report should be considered as preliminary. However, they are promising enough to extend the scope of the research.

Keywords
  • emotion detection
  • EEG
  • video
  • near-infrared spectroscopy
NoteFinal Project Report
Citation (ISO format)
SAVRAN, Arman et al. Emotion Detection in the Loop from Brain Signals and Facial Images. In: Proceedings of the eNTERFACE 2006 Workshop. Dubrovnik (Croatia). [s.l.] : [s.n.], 2006.
Main files (1)
Proceedings chapter (Accepted version)
accessLevelPublic
Identifiers
  • PID : unige:47926
2808views
2162downloads

Technical informations

Creation06/03/2015 17:12:24
First validation06/03/2015 17:12:24
Update14/03/2023 22:59:51
Status update14/03/2023 22:59:50
Last indexation30/10/2024 23:24:11
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack