en
Scientific article
Open access
English

Audio-visual combination of syllables involves time-sensitive dynamics following from fusion failure

Published inScientific Reports, vol. 10, no. 1, 18009
Publication date2020
Abstract

In face-to-face communication, audio-visual (AV) stimuli can be fused, combined or perceived as mismatching. While the left superior temporal sulcus (LSTS) is admittedly the locus of AV integration, the process leading to is unknown. Analysing behaviour and time-/source-resolved human MEG data, we show that fusion and combination both involve early detection of AV physical features discrepancy in the LSTS, but that this initial registration is followed, in combination only, by the activation of AV asynchrony-sensitive regions (auditory and inferior frontal cortices). Based on dynamic causal modelling and neural signal decoding, we further show that AV speech integration outcome primarily depends on whether the LSTS quickly converges or not onto an existing multimodal syllable representation, and that combination results from subsequent temporal re-ordering of the discrepant AV stimuli in time-sensitive regions of the prefrontal and temporal cortices.

Citation (ISO format)
BOUTON, Sophie et al. Audio-visual combination of syllables involves time-sensitive dynamics following from fusion failure. In: Scientific Reports, 2020, vol. 10, n° 1, p. 18009. doi: 10.1101/771634
Main files (1)
Article (Published version)
Secondary files (1)
Identifiers
ISSN of the journal2045-2322
179views
135downloads

Technical informations

Creation01.11.2020 21:42:00
First validation01.11.2020 21:42:00
Update time15.03.2023 23:00:57
Status update15.03.2023 23:00:56
Last indexation12.02.2024 11:57:41
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack