en
Scientific article
English

The effects of stereo disparity on the behavioural and electrophysiological correlates of perception of audio-visual motion in depth

Published inNeuropsychologia, vol. 78, p. 51-62
Publication date2015
Abstract

Motion is represented by low-level signals, such as size-expansion in vision or loudness changes in the auditory modality. The visual and auditory signals from the same object or event may be integrated and facilitate detection. We explored behavioural and electrophysiological correlates of congruent and incongruent audio-visual depth motion in conditions where auditory level changes, visual expansion, and visual disparity cues were manipulated. In Experiment 1 participants discriminated auditory motion direction whilst viewing looming or receding, 2D or 3D, visual stimuli. Responses were faster and more accurate for congruent than for incongruent audio-visual cues, and the congruency effect (i.e., difference between incongruent and congruent conditions) was larger for visual 3D cues compared to 2D cues. In Experiment 2, event-related potentials (ERPs) were collected during presentation of the 2D and 3D, looming and receding, audio-visual stimuli, while participants detected an infrequent deviant sound. Our main finding was that audio-visual congruity was affected by retinal disparity at an early processing stage (135-160ms) over occipito-parietal scalp. Topographic analyses suggested that similar brain networks were activated for the 2D and 3D congruity effects, but that cortical responses were stronger in the 3D condition. Differences between congruent and incongruent conditions were observed between 140-200ms, 220-280ms, and 350-500ms after stimulus onset.

Citation (ISO format)
HARRISON, Neil R et al. The effects of stereo disparity on the behavioural and electrophysiological correlates of perception of audio-visual motion in depth. In: Neuropsychologia, 2015, vol. 78, p. 51–62. doi: 10.1016/j.neuropsychologia.2015.09.023
Main files (1)
Article (Published version)
accessLevelRestricted
Identifiers
ISSN of the journal0028-3932
408views
0downloads

Technical informations

Creation03/11/2016 4:34:00 PM
First validation03/11/2016 4:34:00 PM
Update time03/15/2023 12:13:20 AM
Status update03/15/2023 12:13:19 AM
Last indexation01/16/2024 8:28:07 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack