Scientific article
OA Policy
English

The phase of cortical oscillations determines the perceptual fate of visual cues in naturalistic audiovisual speech

Published inScience Advances, vol. 6, no. 45, eabc6348
Publication date2020
Abstract

When we see our interlocutor, our brain seamlessly extracts visual cues from their face and processes them along with the sound of their voice, making speech an intrinsically multimodal signal. Visual cues are especially important in noisy environments, when the auditory signal is less reliable. Neuronal oscillations might be involved in the cortical processing of audiovisual speech by selecting which sensory channel contributes more to perception. To test this, we designed computer-generated naturalistic audiovisual speech stimuli where one mismatched phoneme-viseme pair in a key word of sentences created bistable perception. Neurophysiological recordings (high-density scalp and intracranial electroencephalography) revealed that the precise phase angle of theta-band oscillations in posterior temporal and occipital cortex of the right hemisphere was crucial to select whether the auditory or the visual speech cue drove perception. We demonstrate that the phase of cortical oscillations acts as an instrument for sensory selection in audiovisual speech processing.

Funding
  • Swiss National Science Foundation - 167836
Citation (ISO format)
THÉZÉ, Raphaël, GIRAUD MAMESSIER, Anne-Lise, MEGEVAND, Pierre Bastien. The phase of cortical oscillations determines the perceptual fate of visual cues in naturalistic audiovisual speech. In: Science Advances, 2020, vol. 6, n° 45, p. eabc6348. doi: 10.1126/sciadv.abc6348
Main files (1)
Article (Published version)
Secondary files (1)
Identifiers
Journal ISSN2375-2548
223views
118downloads

Technical informations

Creation05/11/2020 08:27:00
First validation05/11/2020 08:27:00
Update time15/03/2023 23:22:05
Status update15/03/2023 23:22:04
Last indexation31/10/2024 20:24:01
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack