• Home
  1. Home
  2. Multimodal Focus Attention and Stress Detection and feedback in an Augmented Driver Simulator
Conference presentation
English

Multimodal Focus Attention and Stress Detection and feedback in an Augmented Driver Simulator

Contributors

Chanel, Guillaume; Benoit, Alexandre; Bonnaud, Laurent; Caplier, Alice; Ngo, Phillipe; Lawson, Lionel; Trevisan, Daniela; Levacic, Vjekoslav; Mancas, Céline

Presented at

3rd IFIP Conference on Artificial Intelligence Applications & Innovations (AIAI)), Athens (Greece), Jun 7-9

Publication date

2006

Abstract

This paper presents a driver simulator, which takes into account the information about the user's state of mind (level of attention, fatigue state, stress state). The user's state of mind analysis is based on video data and biological signals. Facial movements such as eyes blinking, yawning, head rotations, etc., are detected on video data: they are used in order to evaluate the fatigue and the attention level of the driver. The user's electrocardiogram and galvanic skin response are recorded and analyzed in order to evaluate the stress level of the driver. A driver simulator software is modified so that the system is able to appropriately react to these critical situations of fatigue and stress: some audio and visual messages are sent to the driver, wheel vibrations are generated and the driver is supposed to react to the alert messages. A multi-threaded system is proposed to support multi-messages sent by the different modalities. Strategies for data fusion and fission are also provided. Some of these components are integrated within the first prototype of OpenInterface: the multimodal similar platform.

Keywords

  • Driver simulator
  • Facial motion analysis
  • Physiological signals
  • StressAttention level
  • Data fusion
  • Data fission
  • OpenInterface

Note

Publié dans: Personal and Ubiquitous Computing, January 2009, Volume 13, Issue 1, pp 33–41

UNIGE affiliation entities

UNIGE research groups

Citation (ISO format)

CHANEL, Guillaume et al. Multimodal Focus Attention and Stress Detection and feedback in an Augmented Driver Simulator. In: 3rd IFIP Conference on Artificial Intelligence Applications & Innovations (AIAI)). Athens (Greece). 2006.

Identifiers

  • PID : unige:47700
642views
0downloads

Technical informations

Creation

06/03/2015 17:12:08

First validation

06/03/2015 17:12:08

Update

14/03/2023 22:58:44

Status update

14/03/2023 22:58:44

Last indexation

30/10/2024 23:17:59
All rights reserved by Archive ouverte UNIGE and the University of Geneva
OpenAIRE Indexed & Validated