Scientific article
OA Policy
English

Toward local and global perception modules for vision substitution

Published inNeurocomputing, vol. 74, no. 8, p. 1182-1190
Publication date2011
Abstract

Although retinal neural implants have considerably progressed they raise a number of questions concerning user acceptance, risk rejection, and cost. For the time being we support a low cost approach based on the transmission of limited vision information by means of the auditory channel. The See ColOr mobility aid for visually impaired individuals transforms a small portion of a coloured video image into sound sources represented by spatialised musical instruments. Basically, the conversion of colours into sounds is achieved by quantisation of the HSL colour system. Our purpose is to provide blind people with a capability of perception of the environment in real time. In this work the novelty is the simultaneous sonification of colour and depth, the last parameter being coded by sound rhythm. The main drawback of our approach is that the sonification of a limited portion of a captured image involves limited perception. As a consequence, we propose to extend the local perception module by introducing a new global perception module aiming at providing the user with a clear picture of the entire scene characteristics. Finally, we present several experiments to illustrate the limited perception module, such as: (1) detecting an open door in order to go out from the office; (2) walking in a hallway and looking for a blue cabinet; (3) walking in a hallway and looking for a red tee shirt; (4) avoiding two red obstacles; (5) moving outside and avoiding a parked car. Videos of experiments are available on http://www.youtube.com/guidobologna.

Keywords
  • Sensorial substitution
  • Colour sonification
  • Mobility experiments
  • Stereo-vision
  • Sound spatialisation
Citation (ISO format)
BOLOGNA, Guido et al. Toward local and global perception modules for vision substitution. In: Neurocomputing, 2011, vol. 74, n° 8, p. 1182–1190. doi: 10.1016/j.neucom.2010.07.022
Main files (1)
Article (Accepted version)
accessLevelPublic
Identifiers
Journal ISSN0925-2312
630views
656downloads

Technical informations

Creation03/03/2015 16:36:05
First validation03/03/2015 16:36:05
Update14/03/2023 22:56:38
Status update14/03/2023 22:56:38
Last indexation30/10/2024 23:10:26
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack