GAFF: Global Attention Feature Flow Network for Optical and SAR Image Registration Under Geometric Transformations

Read full text
Authors: Xuecong Liu, Zixuan Sun, Hongwei Ding, Xin Song, Shuaiying Zhang, Yongsheng Sun
Cited by: 0
References: 50

Abstract

The registration of optical and synthetic aperture radar (SAR) images under geometric distortions is critical for remote sensing applications such as image fusion and visual navigation. However, this task faces significant challenges due to inherent radiometric and geometric differences, diverse terrain conditions, and distinct noise patterns between the two modalities, which compromises the accuracy, robustness, and generalization of existing registration methods. To address these limitations, this paper introduces a novel global attention feature flow (GAFF) network, which synergistically combines model-driven and data-driven methodologies. Specifically, the framework leverages a hybrid CNN-Transformer architecture, integrating modality independent region descriptors (MIRD) for feature extraction, to achieve highly generalizable and consistent feature representations across modalities. GAFF employs a global attention mechanism to establish robust feature correspondences and generate the initial feature flow. Further, we introduce a hierarchical feature flow refinement module (HFRM) and a combined weight loss function to optimize feature flow generation. Experimental results demonstrate that GAFF delivers highly accurate, robust, and generalizable optical-SAR registration under varying geometric conditions, maintaining strong generalization capabilities across OS, WHU-OPT-SAR, and OSTerrain dataset.

Fields of Study & Subjects

Advanced Image and Video Retrieval Techniques Satellite Image Processing and Photogrammetry Advanced Image Fusion Techniques

Publication details

Journal / source
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Volume
19
Pages
4629–4646
Publication date
1 January 2026