UNIGE document Scientific Article
previous document  unige:47411  next document
add to browser collection

Toward local and global perception modules for vision substitution

Published in Neurocomputing. 2011, vol. 74, no. 8, p. 1182-1190
Abstract Although retinal neural implants have considerably progressed they raise a number of questions concerning user acceptance, risk rejection, and cost. For the time being we support a low cost approach based on the transmission of limited vision information by means of the auditory channel. The See ColOr mobility aid for visually impaired individuals transforms a small portion of a coloured video image into sound sources represented by spatialised musical instruments. Basically, the conversion of colours into sounds is achieved by quantisation of the HSL colour system. Our purpose is to provide blind people with a capability of perception of the environment in real time. In this work the novelty is the simultaneous sonification of colour and depth, the last parameter being coded by sound rhythm. The main drawback of our approach is that the sonification of a limited portion of a captured image involves limited perception. As a consequence, we propose to extend the local perception module by introducing a new global perception module aiming at providing the user with a clear picture of the entire scene characteristics. Finally, we present several experiments to illustrate the limited perception module, such as: (1) detecting an open door in order to go out from the office; (2) walking in a hallway and looking for a blue cabinet; (3) walking in a hallway and looking for a red tee shirt; (4) avoiding two red obstacles; (5) moving outside and avoiding a parked car. Videos of experiments are available on http://www.youtube.com/guidobologna.
Keywords Sensorial substitutionColour sonificationMobility experimentsStereo-visionSound spatialisation
Full text
Article (Accepted version) (706 Kb) - public document Free access
Research groups Computer Vision and Multimedia Laboratory
Multimodal Interaction Group
(ISO format)
BOLOGNA, Guido et al. Toward local and global perception modules for vision substitution. In: Neurocomputing, 2011, vol. 74, n° 8, p. 1182-1190. doi: 10.1016/j.neucom.2010.07.022 https://archive-ouverte.unige.ch/unige:47411

389 hits



Deposited on : 2015-03-03

Export document
Format :
Citation style :