Proceedings chapter
Open access

A perceptual interface for vision substitution in a color matching experiment

Presented at Hong Kong, Jun 1-8
Publication date2008

In the context of vision substitution by the auditory channel several systems have been introduced. One such system that is presented here, See ColOr, is a dedicated interface part of a mobility aid for visually impaired people. It transforms a small portion of a colored video image into spatialized instrument sounds. In this work the purpose is to verify the hypothesis that sounds from musical instruments provide an alternative way to vision for obtaining color information from the environment. We introduce an experiment in which several participants try to match pairs of colored socks by pointing a head mounted camera and by listening to the generated sounds. Our experiments demonstrated that blindfolded individuals were able to accurately match pairs of colored socks. The advantage of the See ColOr interface is that it allows the user to receive a feed-back auditory signal from the environment and its colors, promptly. Our perceptual auditory coding of pixel values opens the opportunity to achieve more complicated experiments related to vision tasks, such as perceiving the environment by interpreting its colors.

  • handicapped aids
  • image coding
  • image colour analysis
  • image matching
Citation (ISO format)
BOLOGNA, Guido et al. A perceptual interface for vision substitution in a color matching experiment. In: IEEE International Joint Conference on Neural Networks, IJCNN 2008 (IEEE World Congress on Computational Intelligence). Hong Kong. [s.l.] : IEEE, 2008. p. 1621–1628. doi: 10.1109/IJCNN.2008.4634014
Main files (2)
Proceedings chapter (Published version)
Proceedings chapter (Accepted version)

Technical informations

Creation03/06/2015 5:12:07 PM
First validation03/06/2015 5:12:07 PM
Update time03/14/2023 10:58:37 PM
Status update03/14/2023 10:58:37 PM
Last indexation01/16/2024 5:08:22 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack