UNIGE document Chapitre d'actes
previous document  unige:47926  next document
add to browser collection

Emotion Detection in the Loop from Brain Signals and Facial Images

Savran, Arman
Ciftci, Koray
Mota, Javier
Hong Viet, Luong
Sankur, Blent
Akarun, Lale
Caplier, Alice
show hidden authors show all authors [1 - 9]
Published in Proceedings of the eNTERFACE 2006 Workshop. Dubrovnik (Croatia) - July 17th – August 11th 2006 - . 2006
Abstract In this project, we intended to develop techniques for multimodal emotion detection, one modality being brain signals via fNIRS, the second modality being face video and the third modality being the scalp EEG signals. EEG and fNIRS provided us with an “internal” look at the emotion generation processes, while video sequence gave us an “external” look on the “same” phenomenon. Fusions of fNIRS with video and of EEG with fNIRS were considered. Fusion of all three modalities was not considered due to the extensive noise on the EEG signals caused by facial muscle movements, which are required for emotion detection from video sequences. Besides the techniques mentioned above, peripheral signals, namely, respiration, cardiac rate, and galvanic skin resistance were also measured from the subjects during “fNIRS + EEG” recordings. These signals provided us with extra information about the emotional state of the subjects. The critical point in the success of this project was to be able to build a “good” database. Good data acquisition means synchronous data and requires the definition of some specific experimental protocols for emotions elicitation. Thus, we devoted much of our time to data acquisition throughout the workshop, which resulted in a large enough database for making the first analyses. Results presented in this report should be considered as preliminary. However, they are promising enough to extend the scope of the research.
Keywords emotion detectionEEGvideonear-infrared spectroscopy
Note Final Project Report
Full text
Research groups Computer Vision and Multimedia Laboratory
Multimodal Interaction Group
(ISO format)
SAVRAN, Arman et al. Emotion Detection in the Loop from Brain Signals and Facial Images. In: Proceedings of the eNTERFACE 2006 Workshop. Dubrovnik (Croatia). [s.l.] : [s.n.], 2006. https://archive-ouverte.unige.ch/unige:47926

455 hits



Deposited on : 2015-03-06

Export document
Format :
Citation style :