UNIGE document Doctoral Thesis
previous document  unige:34568  next document
add to browser collection

A computer-vision based sensory substitution device for the visually impaired (See ColOr)

Defense Thèse de doctorat : Univ. Genève, 2014 - Sc. 4642 - 2014/02/04
Abstract Audio-based Sensory Substitution Devices (SSDs) perform adequately when sensing and mapping low-level visual features into sound. Yet, their limitations become apparent when it comes to represent high-level or conceptual information involved in vision. We introduce See ColOr as an SSD that senses color and depth to convert them into musical instrument sounds. In addition and unlike any other approach, our SSD extends beyond a sensing prototype, by integrating computer vision methods to produce reliable knowledge about the physical world (effortlessly for the user). Experiments reported in this thesis reveal that our See ColOr SSD is learnable, functional, and provides easy interaction. In moderate time, participants were able to grasp visual information from the environment out of which they could derive: spatial awareness, ability to find someone, location of daily objects, and skill to walk safely avoiding obstacles. Our encouraging results open a door towards autonomous mobility of the blind.
Keywords Visual Sensory SubstitutionComputer VisionSound SpatializationNeuroplasticityCross-modal TransferBlindVisually ImpairedSensory Substitution DevicesColor-to-sound Encoding
URN: urn:nbn:ch:unige-345689
Full text
Thesis (9.2 MB) - public document Free access
Research group Computer Vision and Multimedia Laboratory
(ISO format)
GOMEZ VALENCIA, Juan Diego. A computer-vision based sensory substitution device for the visually impaired (See ColOr). Université de Genève. Thèse, 2014. doi: 10.13097/archive-ouverte/unige:34568 https://archive-ouverte.unige.ch/unige:34568

1349 hits



Deposited on : 2014-03-03

Export document
Format :
Citation style :