en
Scientific article
Open access
English

Audio-visual combination of syllables involves time-sensitive dynamics following from fusion failure

Published inScientific Reports, vol. 10, no. 1, 18009
Publication date2020
Abstract

In face-to-face communication, audio-visual (AV) stimuli can be fused, combined or perceived as mismatching. While the left superior temporal sulcus (LSTS) is admittedly the locus of AV integration, the process leading to is unknown. Analysing behaviour and time-/source-resolved human MEG data, we show that fusion and combination both involve early detection of AV physical features discrepancy in the LSTS, but that this initial registration is followed, in combination only, by the activation of AV asynchrony-sensitive regions (auditory and inferior frontal cortices). Based on dynamic causal modelling and neural signal decoding, we further show that AV speech integration outcome primarily depends on whether the LSTS quickly converges or not onto an existing multimodal syllable representation, and that combination results from subsequent temporal re-ordering of the discrepant AV stimuli in time-sensitive regions of the prefrontal and temporal cortices.

Citation (ISO format)
BOUTON, Sophie et al. Audio-visual combination of syllables involves time-sensitive dynamics following from fusion failure. In: Scientific Reports, 2020, vol. 10, n° 1, p. 18009. doi: 10.1101/771634
Main files (1)
Article (Published version)
Secondary files (1)
Identifiers
ISSN of the journal2045-2322
169views
133downloads

Technical informations

Creation11/01/2020 9:42:00 PM
First validation11/01/2020 9:42:00 PM
Update time03/15/2023 11:00:57 PM
Status update03/15/2023 11:00:56 PM
Last indexation02/12/2024 11:57:41 AM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack