UNIGE document Scientific Article
previous document  unige:80603  next document
add to browser collection

Multimodal focus attention and stress detection and feedback in an augmented driver simulator

Benoit, Alexandre
Bonnaud, Laurent
Caplier, Alice
Ngo, Phillipe
Lawson, Lionel
Trevisan, Daniela G.
Levacic, Vjekoslav
Mancas, Céline
show hidden authors show all authors [1 - 9]
Published in Personal and Ubiquitous Computing. 2009, vol. 13, no. 1, p. 33-41
Abstract This paper presents a driver simulator, which takes into account the information about the user's state of mind (level of attention, fatigue state, stress state). The user's state of mind analysis is based on video data and biological signals. Facial movements such as eyes blinking, yawning, head rotations, etc., are detected on video data: they are used in order to evaluate the fatigue and the attention level of the driver. The user's electrocardiogram and galvanic skin response are recorded and analyzed in order to evaluate the stress level of the driver. A driver simulator software is modified so that the system is able to appropriately react to these critical situations of fatigue and stress: some audio and visual messages are sent to the driver, wheel vibrations are generated and the driver is supposed to react to the alert messages. A multi-threaded system is proposed to support multi-messages sent by the different modalities. Strategies for data fusion and fission are also provided. Some of these components are integrated within the first prototype of OpenInterface: the multimodal similar platform.
Keywords Driver simulatorFacial motion analysisPhysiological signalsStressAttention levelData fusionData fissionOpenInterface
Full text
Article (Published version) (479 Kb) - document accessible for UNIGE members only Limited access to UNIGE
Other version: http://link.springer.com/10.1007/s00779-007-0173-0
Research groups Affective sciences
Computer Vision and Multimedia Laboratory
Multimodal Interaction Group
(ISO format)
BENOIT, Alexandre et al. Multimodal focus attention and stress detection and feedback in an augmented driver simulator. In: Personal and Ubiquitous Computing, 2009, vol. 13, n° 1, p. 33-41. https://archive-ouverte.unige.ch/unige:80603

165 hits



Deposited on : 2016-02-09

Export document
Format :
Citation style :