Doctoral thesis
Open access

A computer-vision based sensory substitution device for the visually impaired (See ColOr)

DirectorsPun, Thierry
Defense date2014-02-04

Audio-based Sensory Substitution Devices (SSDs) perform adequately when sensing and mapping low-level visual features into sound. Yet, their limitations become apparent when it comes to represent high-level or conceptual information involved in vision. We introduce See ColOr as an SSD that senses color and depth to convert them into musical instrument sounds. In addition and unlike any other approach, our SSD extends beyond a sensing prototype, by integrating computer vision methods to produce reliable knowledge about the physical world (effortlessly for the user). Experiments reported in this thesis reveal that our See ColOr SSD is learnable, functional, and provides easy interaction. In moderate time, participants were able to grasp visual information from the environment out of which they could derive: spatial awareness, ability to find someone, location of daily objects, and skill to walk safely avoiding obstacles. Our encouraging results open a door towards autonomous mobility of the blind.

  • Visual Sensory Substitution
  • Computer Vision
  • Sound Spatialization
  • Neuroplasticity
  • Cross-modal Transfer
  • Blind
  • Visually Impaired
  • Sensory Substitution Devices
  • Color-to-sound Encoding
Citation (ISO format)
GOMEZ VALENCIA, Juan Diego. A computer-vision based sensory substitution device for the visually impaired (See ColOr). 2014. doi: 10.13097/archive-ouverte/unige:34568
Main files (1)

Technical informations

Creation02/25/2014 10:57:00 AM
First validation02/25/2014 10:57:00 AM
Update time03/14/2023 9:00:00 PM
Status update03/14/2023 8:59:59 PM
Last indexation01/29/2024 8:05:35 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack