Proceedings chapter
OA Policy
English

Identifying major components of pictures by audio encoding of colors

Presented at

La Manga del Mar Menor (Spain), June 18-21

Publisher

Springer

Collection

  • Lecture Notes in Computer Science; 4528

Publication date

2007

Abstract

The goal of the See ColOr project is to achieve a non-invasive mobility aid for blind users that will use the auditory pathway to represent in real-time frontal image scenes. More particularly, we have developed a prototype which transforms HSL coloured pixels into spatialized classical instrument sounds lasting for 300 ms. Hue is sonified by the timbre of a musical instrument, saturation is one of four possible notes, and luminosity is represented by bass when luminosity is rather dark and singing voice when it is relatively bright. Our first experiments are devoted to static images on the computer screen. Six participants with their eyes covered by a dark tissue were trained to associate colours with musical instruments and then asked to determine on several pictures, objects with specific shapes and colours. In order to simplify the protocol of experiments, we used a tactile tablet, which took the place of the camera. Overall, experiment participants found that colour was helpful for the interpretation of image scenes.

Keywords

  • Seecolor
  • Artificial Intelligence (incl. Robotics)
  • Computation by Abstract Devices
  • Algorithm Analysis and Problem Complexity
  • Image Processing and Computer Vision
  • Pattern Recognition
  • Computational Biology/Bioinformatics

Citation (ISO format)

BOLOGNA, Guido et al. Identifying major components of pictures by audio encoding of colors. In: Proceedings of 2nd International Work-conference on the Interplay between Natural and Artificial Computation, IWINAC 2007. La Manga del Mar Menor (Spain). [s.l.] : Springer, 2007. p. 81–89. (Lecture Notes in Computer Science) doi: 10.1007/978-3-540-73055-2_10

Main files (1)

Proceedings chapter (Accepted version)

Identifiers

736views
411downloads

Technical informations

Creation

06/03/2015 17:12:09

First validation

06/03/2015 17:12:09

Update

14/03/2023 22:58:50

Status update

14/03/2023 22:58:50

Last indexation

30/10/2024 23:18:34
All rights reserved by Archive ouverte UNIGE and the University of Geneva
OpenAIRE Indexed & Validated