MCFusion: A Lightweight RGB-T Pedestrian Detection Method with Progressive Thermal Compensation

Read full text
Authors: Haokun Li, Haodong Xu, Daheng Chen
Cited by: 1
References: 35

Abstract

RGB-T pedestrian detection remains challenging under low-light, occluded, crowded, and complex-background conditions. To improve cross-modal feature fusion while maintaining model efficiency, this paper proposes MCFusion, a lightweight RGB-T pedestrian detection method with progressive thermal compensation. MCFusion adopts a dual-branch RGB–thermal feature extraction structure and introduces a Modality-Compensated Gated Fusion (MCGF) module at the P4 and P5 semantic stages, which is implemented as a zero-initialized residual compensation mechanism. MCGF uses RGB features as the primary stream and progressively compensates them with thermal auxiliary features through a zero-initialized convolutional gate, reducing the interference caused by direct fusion. In addition, a Lightweight Shared Convolutional Detection Head (LSCD) is adopted to reduce redundant computation in multi-scale prediction. On the LLVIP dataset, MCFusion achieves 95.30% mAP50 and 60.10% mAP50:95 with 5.21 M parameters and 10.50 GFLOPs. Compared with the YOLOv11n RGB baseline, it improves mAP50 and mAP50:95 by 7.50 and 10.70 percentage points, respectively. Experiments on KAIST, ablation studies, and visualization results further demonstrate the effectiveness of the proposed method.

Fields of Study & Subjects

Advanced Neural Network Applications Video Surveillance and Tracking Methods Anomaly Detection Techniques and Applications

Publication details

Journal / source
Algorithms
Publisher
MDPI AG
Volume
19
Issue
6
Pages
468–468
Publication date
8 June 2026
Language
EN