CAIR-Net: Reliability-Aware Information Routing for Robust Multimodal Object Detection Under Modality Degradation

View at publisher
Authors: Yudi Su, Jialei Ni, Tianyang Wen, Hongwei Liu, Hongtao Su, Bo Chen
Cited by: 1
References: 30

Abstract

Multimodal remote sensing combines optical and synthetic aperture radar (SAR) imagery to improve perception, yet real deployments face spatially varying degradations (e.g., clouds, low light, sensor interference) that can corrupt fusion. To make robustness measurable, we introduce a controlled mixed-severity setting in which only the optical stream is synthetically cloud-degraded while SAR remains intact, providing a standardized testbed for evaluating multimodal detection under modality imbalance. We further present CAIR-Net, a reliability–aware information routing network that follows adenoise-then-fuseprinciple: a Local Reliability Modulation (LRM) module learns soft, spatial reliability maps to suppress degraded regionsbeforecross-modal interaction, and a Global Information Selection Mechanism (GISM) performs confidence-aware expert routing across optical, fused, and SAR experts. On the mixed-severity benchmark, CAIR-Net consistently outperforms strong unimodal and fusion baselines and exhibits a substantially smaller performance drop under severe clouds (only a 7.3% AP reduction versus drops exceeding 25% for representative alternatives). These results indicate that explicit reliability modeling and quality-guided routing provide a practical path toward robust multimodal detection when one modality is partially or nearly completely occluded.

Fields of Study & Subjects

Infrared Target Detection Methodologies Remote-Sensing Image Classification Advanced Neural Network Applications

Publication details

Journal / source
IEEE Transactions on Circuits and Systems for Video Technology
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
36
Issue
6
Pages
8303–8315
Publication date
9 February 2026