Proceedings chapter
Open access

Understanding chromaesthesia by strengthening auditory-visual-emotional associations

Presented at Cambridge (United Kingdom), 2019
Publication date2019

Can cross-modal associations between notes and colours and between notes and emotions be strengthened by using an ad-hoc designed computer program? In this paper we present an experiment that we conducted to see (H1) if participants' associations between the auditory and visual senses could be strengthened through immersion in a multi-sensory program and (H2) if there was any correlation between auditory-visual and the auditory-emotion associations. In our experiment, participants were asked to use the SoundStrokes program, an application that translates notes played on an analog music instrument (i.e., a guitar) into coloured graphical shapes (i.e., rectangles). After several training sessions with the program, participants were asked to associate single music notes to colours and emotions. Applications of our work may vary from entertainment, to enrich in a systematic manner the user emotional experience in, for example, videogames or immersive experiences, to digital health, in which relatively simple tools can be developed, for example, to reduce anxiety through music.

  • Chromeasthesia
  • Cross-modal association
  • Emotion
  • Sound
  • Colour
Citation (ISO format)
O’TOOLE, Patrick, GLOWINSKI, Donald, MANCINI, Maurizio. Understanding chromaesthesia by strengthening auditory-visual-emotional associations. In: 8th International Conference on Affective Computing and Intelligent Interaction (ACII). Cambridge (United Kingdom). [s.l.] : IEEE, 2019. doi: 10.1109/ACII.2019.8925465
Main files (1)
Proceedings chapter (Published version)

Technical informations

Creation03/11/2021 5:10:00 PM
First validation03/11/2021 5:10:00 PM
Update time03/16/2023 12:14:56 AM
Status update03/16/2023 12:14:56 AM
Last indexation02/12/2024 1:24:50 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack