fr
Chapitre de livre
Anglais

See ColOr: Seeing Colours with an Orchestra

Publié dansHuman Machine Interaction, Editeurs/trices Lalanne, Denis & Kohlas, Jürg, p. 251-279
Maison d'éditionBerlin : Springer
Collection
  • Lecture Notes in Computer Science; 5440
Date de publication2009
Résumé

The See Color interface transforms a small portion of a coloured video image into sound sources represented by spatialised musical instruments. Basically, the conversion of colours into sounds is achieved by quantisation of the HSL (Hue, Saturation and Luminosity) colour system. Our purpose is to provide visually impaired individuals with a capability of perception of the environment in real time. In this work we present the system's principles of design and several experiments that have been carried out by several blindfolded persons. The goal of the first experiment was to identify the colours of main features in static pictures in order to interpret the image scenes. Participants found that colours were helpful to limit the possible image interpretations. Afterwards, two experiments based on a head mounted camera have been performed. The first experiment pertains to object manipulation. It is based on the pairing of coloured socks, while the second experiment is related to outdoor navigation with the goal of following a coloured sinuous path painted on the ground. The socks experiment demonstrated that blindfolded individuals were able to accurately match pairs of coloured socks. The same participants successfully followed a red serpentine path painted on the ground for more than 80 meters. Finally, we propose an original approach for a real time alerting system, based on the detection of visual salient parts in videos. The particularity of our approach lies in the use of a new feature map constructed from the depth gradient. From the computed feature maps we infer conspicuity maps that indicate areas that are appreciably different from their surrounding. Then a specific distance function is described, which takes into account both stereoscopic camera limitations and user's choices. We also report how we automatically estimate the relative contribution of each conspicuity map, which enables the unsupervised determination of the final saliency map, indicating the visual salience of all points in the image. We demonstrate here that this additional depth-based feature map allows the system to detect salient regions with good accuracy in most situations, even in the presence of noisy disparity maps.

eng
Mots-clés
  • Salient Region
  • Depth Gradient
  • Blind User
  • Tactile Display
  • White Cane
Citation (format ISO)
DEVILLE, Benoît et al. See ColOr: Seeing Colours with an Orchestra. In: Human Machine Interaction. Berlin : Springer, 2009. p. 251–279. (Lecture Notes in Computer Science) doi: 10.1007/978-3-642-00437-7_10
Fichiers principaux (1)
Book chapter (Published version)
Identifiants
98vues
0téléchargements

Informations techniques

Création08.10.2021 09:01:00
Première validation08.10.2021 09:01:00
Heure de mise à jour16.03.2023 01:27:51
Changement de statut16.03.2023 01:27:50
Dernière indexation12.02.2024 12:11:22
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack