Multi-Scale Frequency-Aware Representation Learning for Infrared and Visible Image Fusion

Read full text
Authors: Chuanwen Hu, Zheyi Hu, Chuan Xu, Zhina Song, Liye Mei
Cited by: 1
References: 54

Abstract

Infrared and visible image fusion aims to integrate complementary information from heterogeneous sensors for remote sensing and Earth-observation applications. To achieve a better balance between global contextual modeling and local structural preservation, we propose MSF-Net, a multi-scale frequency-aware fusion network with a hierarchical design. The proposed framework consists of two main stages: multi-scale feature extraction with frequency-domain interaction and hierarchical cross-modal fusion. Specifically, a hybrid spatial-frequency encoding block (HSFEB) is designed as the basic building unit, which combines a spatial-frequency interaction module (SFIM) for global context aggregation in the frequency domain and a structure-guided feature refinement module (SGFRM) for preserving local structural details. In addition, a hierarchical feature fusion module (HFFM) is introduced to progressively integrate cross-modal and cross-scale features in a coarse-to-fine manner. A joint loss function, composed of intensity and structural constraints, is adopted to supervise the fusion process. Extensive experiments on three public benchmarks, MSRS, M3FD, and TNO, demonstrate that MSF-Net achieves superior performance over nine SOTA methods in both qualitative and quantitative evaluations. The results show that the proposed method effectively enhances thermal targets, preserves structural details, and maintains good visual naturalness under diverse remote-sensing scenarios.

Fields of Study & Subjects

Advanced Image Fusion Techniques Image Enhancement Techniques Remote-Sensing Image Classification

Publication details

Journal / source
Remote Sensing
Publisher
MDPI AG
Volume
18
Issue
8
Pages
1178–1178
Publication date
15 April 2026
Language
EN