Doctoral thesis
OA Policy
English

A computer-vision based sensory substitution device for the visually impaired (See ColOr)

DirectorsPun, Thierry
Defense date2014-02-04
Abstract

Audio-based Sensory Substitution Devices (SSDs) perform adequately when sensing and mapping low-level visual features into sound. Yet, their limitations become apparent when it comes to represent high-level or conceptual information involved in vision. We introduce See ColOr as an SSD that senses color and depth to convert them into musical instrument sounds. In addition and unlike any other approach, our SSD extends beyond a sensing prototype, by integrating computer vision methods to produce reliable knowledge about the physical world (effortlessly for the user). Experiments reported in this thesis reveal that our See ColOr SSD is learnable, functional, and provides easy interaction. In moderate time, participants were able to grasp visual information from the environment out of which they could derive: spatial awareness, ability to find someone, location of daily objects, and skill to walk safely avoiding obstacles. Our encouraging results open a door towards autonomous mobility of the blind.

Keywords
  • Visual Sensory Substitution
  • Computer Vision
  • Sound Spatialization
  • Neuroplasticity
  • Cross-modal Transfer
  • Blind
  • Visually Impaired
  • Sensory Substitution Devices
  • Color-to-sound Encoding
Citation (ISO format)
GOMEZ VALENCIA, Juan Diego. A computer-vision based sensory substitution device for the visually impaired (See ColOr). Doctoral Thesis, 2014. doi: 10.13097/archive-ouverte/unige:34568
Main files (1)
Thesis
accessLevelPublic
Identifiers
1684views
3712downloads

Technical informations

Creation25/02/2014 10:57:00
First validation25/02/2014 10:57:00
Update time14/03/2023 21:00:00
Status update14/03/2023 20:59:59
Last indexation30/10/2024 16:24:33
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack