Enhancing RGB-IR object detection: a frozen backbone approach with multi-receptive field attention

Read full text
Authors: Bingyu Lu, H. Liu, Hiroshi Watanabe
Cited by: 3
References: 46

Abstract

Recent advancements in multimodal object detection have predominantly relied on end-to-end training paradigms, which, while effective, demand substantial computational resources and risk feature degradation. To address these challenges, we propose a frozen backbone paradigm, preserving pretrained representations as stable semantic anchors for efficient multimodal fusion. Our approach introduces a lightweight multi-receptive field attention (MRFA) mechanism, enhancing feature interaction and representation diversity without exhaustive retraining. Experiments on the FLIR Aligned and M $$^3$$ FD dataset demonstrate consistent improvements over state-of-the-art end-to-end models, highlighting the potential of pretrained backbones coupled with adaptive attention mechanisms for robust multimodal object detection. The project code is released at https://github.com/LuBingyu11/MRFA .

Fields of Study & Subjects

Advanced Neural Network Applications Multimodal Machine Learning Applications Domain Adaptation and Few-Shot Learning

Publication details

Journal / source
The Visual Computer
Publisher
Springer Science and Business Media LLC
Volume
42
Issue
3
Publication date
1 February 2026
Language
EN