Dual-Granularity Collaborative Progressive Reasoning Network for Referring Remote Sensing Image Segmentation

Read full text
Authors: Hongtai Yao, Haifeng Wang, Qian Wei, Le Zhao, Meng Tian, Yong Jin, Lin Zhou, Chunrong Wu, Haiyang Qin
Cited by: 0
References: 53

Abstract

Referring Remote Sensing Image Segmentation (RRSIS) aims to recognize specific targets in remote sensing images based on natural language expression. However, synergy between coarse-granularity global alignment and fine-granularity local matching of image-text bimodal features is insufficient in existing methods. Furthermore, the cognitive reasoning logic of human visual perception is ignored during the processing of fine-granularity features. Consequently, the model's semantic understanding and target recognition capabilities in complex scenes are limited. To address these issues, we proposed the Dual-Granularity Collaborative Progressive Reasoning Network (DCPRNet) conforming to cognitive logic. First, dynamic extraction and alignment of multimodal features between the remote sensing image and the referring expression were performed. Multimodal representations containing global semantic information were established by the Global Context Perception Module (GCPM). Secondly, in the Fine-granularity Target Reasoning Module (FTRM), deep collaborative alignment of dual-granularity multimodal features was achieved with the injection of remote sensing priors. And the progressive reasoning on remote sensing targets was performed. Then, in the Asymptotic Feature Aggregation Module (AFAM), semantic depth conflation between features of different scales was balanced, and the feature-semantic consistency constraints were formed. Finally, specific targets were effectively recognized. We evaluated the performance of our proposed method on the public RRSIS-D and RefSegRS datasets. The performance of our method was superior to that of state-of-the-art methods in overall performance.

Fields of Study & Subjects

Multimodal Machine Learning Applications Remote-Sensing Image Classification Advanced Neural Network Applications

Publication details

Journal / source
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Volume
19
Pages
10201–10217
Publication date
1 January 2026
Language
EN