Proceedings chapter
Open access

Identifying major components of pictures by audio encoding of colors

Presented at La Manga del Mar Menor (Spain), June 18-21
  • Lecture Notes in Computer Science; 4528
Publication date2007

The goal of the See ColOr project is to achieve a non-invasive mobility aid for blind users that will use the auditory pathway to represent in real-time frontal image scenes. More particularly, we have developed a prototype which transforms HSL coloured pixels into spatialized classical instrument sounds lasting for 300 ms. Hue is sonified by the timbre of a musical instrument, saturation is one of four possible notes, and luminosity is represented by bass when luminosity is rather dark and singing voice when it is relatively bright. Our first experiments are devoted to static images on the computer screen. Six participants with their eyes covered by a dark tissue were trained to associate colours with musical instruments and then asked to determine on several pictures, objects with specific shapes and colours. In order to simplify the protocol of experiments, we used a tactile tablet, which took the place of the camera. Overall, experiment participants found that colour was helpful for the interpretation of image scenes.

  • Seecolor
  • Artificial Intelligence (incl. Robotics)
  • Computation by Abstract Devices
  • Algorithm Analysis and Problem Complexity
  • Image Processing and Computer Vision
  • Pattern Recognition
  • Computational Biology/Bioinformatics
Citation (ISO format)
BOLOGNA, Guido et al. Identifying major components of pictures by audio encoding of colors. In: Proceedings of 2nd International Work-conference on the Interplay between Natural and Artificial Computation, IWINAC 2007. La Manga del Mar Menor (Spain). [s.l.] : Springer, 2007. p. 81–89. (Lecture Notes in Computer Science) doi: 10.1007/978-3-540-73055-2_10
Main files (1)
Proceedings chapter (Accepted version)

Technical informations

Creation03/06/2015 5:12:09 PM
First validation03/06/2015 5:12:09 PM
Update time03/14/2023 10:58:50 PM
Status update03/14/2023 10:58:50 PM
Last indexation01/16/2024 5:09:05 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack