Scientific article
OA Policy
English

Naturalistic audiovisual illusions reveal the cortical sites involved in the multisensory processing of speech

Published inEuropean journal of neuroscience, vol. 61, no. 5, e70043
Publication date2025-03-03
First online date2025-03-03
Abstract

Audiovisual speech illusions are a spectacular illustration of the effect of visual cues on the perception of speech. Because they allow dissociating perception from the physical characteristics of the sensory inputs, these illusions are useful to investigate the cerebral processing of audiovisual speech. However, the meaningless, monosyllabic utterances typically used to induce illusions are far removed from natural communication through speech. We developed naturalistic speech stimuli that embed mismatched auditory and visual cues within grammatically correct sentences to induce illusory perceptions in controlled fashion. Using intracranial EEG, we confirmed that the cortical processing of audiovisual speech recruits an ensemble of areas, from auditory and visual cortices to multisensory and associative regions. Importantly, we were able to resolve which cortical areas are driven more by the auditory or the visual contents of the speech stimulus or by the eventual perceptual report. Our results suggest that higher order sensory and associative areas, rather than early sensory cortices, are key loci for illusory perception. Naturalistic audiovisual speech illusions represent a powerful tool to dissect the specific roles of individual cortical areas in the processing of audiovisual speech.

Keywords
  • Audiovisual speech
  • Comprehension
  • Humans
  • Intracranial electroencephalography
  • Multisensory processing
  • Speech and language
Citation (ISO format)
MEGEVAND, Pierre Bastien, THÉZÉ, Raphaël, MEHTA, Ashesh. Naturalistic audiovisual illusions reveal the cortical sites involved in the multisensory processing of speech. In: European journal of neuroscience, 2025, vol. 61, n° 5, p. e70043. doi: 10.1111/ejn.70043
Main files (2)
Article (Accepted version)
accessLevelPublic
Article (Published version)
Identifiers
Journal ISSN0953-816X
98views
107downloads

Technical informations

Creation24/02/2025 11:10:01
First validation04/03/2025 08:26:58
Update17/10/2025 15:24:09
Status update17/10/2025 15:24:09
Last indexation11/03/2026 01:17:07
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack