Echoes of the mind’s eye: Reciprocal crossmodal interaction between auditory and visual processing

Read full text
Authors: Xiaoyu Tang, Ting Zhang, Jiaying Sun, Sa Lu
Cited by: 3
References: 95

Abstract

Understanding how the brain integrates information across senses is a fundamental challenge. We investigated the mechanisms underlying reciprocal yet temporally asymmetric auditory-visual interactions using high-density EEG during an auditory spatial attention task with auditory-only (A) and audiovisual (AV) stimuli. In the AV condition, sounds were paired with a central, task-irrelevant visual input. Participants attended to sounds on one side (attended) and ignored the other (unattended). Results showed that the visual input affected auditory processing through initial stimulus-driven suppression, reflected in the eliminated auditory contralateral sensory bias (selection negativity, 220-320 ms) and attenuated fronto-temporal connectivity and auditory contralateral occipital positivity (ACOP, 300-500 ms). Subsequently, auditory-to-visual cross-modal attentional spreading exhibited attention-dependent facilitation, emerging over occipital (300-600 ms) and centro-parietal (500-600 ms) regions. These findings support a competitive-facilitative framework in which stimulus-driven suppression precedes goal-driven facilitation, providing a key temporal constraint for computational and neurocognitive models of crossmodal integration.

Fields of Study & Subjects

Multisensory perception and integration Hearing Impairment and Communication Language Metaphor and Cognition

Publication details

Journal / source
iScience
Publisher
Elsevier BV
Volume
29
Issue
3
Pages
114990–114990
Publication date
13 February 2026
Language
EN