Phase-Guided Cross-Frequency Integration Network for ISAR and Optical Image Fusion

View at publisher
Authors: Ze Wang, Lei Liu, Zhenxi Zhang, Rongzhen Du, Weiping Zhou, Man Zhou, Jingjing Cai, Feng Zhou
Cited by: 0
References: 70

Abstract

Inverse synthetic aperture radar (ISAR) and optical image fusion aims to generate a composite image that simultaneously emphasizes the prominent contours of spacecraft from optical images and preserves the rich texture information inherent in ISAR images. However, the limited receptive fields of spatial-domain methods restrict their ability to capture global contextual dependencies among strong scattering points in ISAR images and to effectively integrate complementary optical features. To tackle this challenge, we propose a phase-guided cross-frequency integration module (PGCFIM), which exploits the intrinsic global modeling capability of the frequency domain and the semantic expressiveness of the phase spectrum. Specifically, a deep Fourier transform is employed to establish an image-wide receptive field for intra-domain global modeling. Subsequently, phase components are explicitly aggregated, and a gating mechanism is introduced to guide the integration of inter-domain long-range dependencies, enabling effective learning of complementary cross-modal representations. To eliminate reliance on hand-crafted fusion strategies, we design an end-to-end network, named PGCFINet. By jointly enhancing cross-domain interaction, frequency-domain global awareness, and explicit complementary feature integration, PGCFINet significantly strengthens cross-domain and cross-modal information interaction representation. Furthermore, to mitigate the current lack of ISAR and optical image datasets, we construct a new dataset comprising various spacecraft models, offering an alternative benchmark for evaluation. Extensive experiments demonstrate show that PGCFINet achieves superior performance than state-of-the-art methods in both qualitative and quantitative assessments. Moreover, PGCFINet is extended to infrared and visible image fusion, and the favorable results further validate its robust generalization ability. The codes of our fusion method and the dataset are forthcoming at https://github.com/WangZe0622/PGCFINet.

Fields of Study & Subjects

Advanced Image Fusion Techniques Advanced SAR Imaging Techniques Image and Signal Denoising Methods

Publication details

Journal / source
IEEE Transactions on Circuits and Systems for Video Technology
Volume
36
Issue
6
Pages
8475–8490
Publication date
28 January 2026