Spatial-Semantic Alignment and Change-Aware Network for Remote Sensing Image Change Captioning

View at publisher
Authors: Zhigang Yang, Huiguang Yao, Junzhen Wu, Linmao Tian, Weiping Ni, Qiang Li, Qi Wang
Cited by: 4
References: 34

Abstract

Remote sensing image change captioning aims to generate natural language descriptions of dynamic changes between bitemporal images. This task faces challenges of aligning high-level semantics with sparse change regions and modeling long-range dependencies in diverse change patterns. To alleviate these limitations, we propose the Spatial-Semantic Alignment and Change-aware Network, dubbed as SACNet. It introduces a semantic-spatial collaborative encoding module synergizing a CNN-based spatial encoder with a CLIP-based semantic encoder, using precise spatial cues to refine global semantic features. A change-driven adaptive feature calibration module emphasizes discriminative change signals via inter-temporal feature dissimilarity modeling, suppressing background noise and highlighting key changes. Additionally, a multi-path SSM-guided spatial representation module is designed to capture diverse complex spatial change topologies. Extensive experiments on the LEVIR-CC and WHU-CDC datasets demonstrate that SACNet achieves state-of-the-art performance, generating both high-precision textual descriptions and approximate change masks. Code will be available at https://github.com/CVer-Yang/SACNet.

Fields of Study & Subjects

Multimodal Machine Learning Applications Advanced Image and Video Retrieval Techniques Geographic Information Systems Studies

Publication details

Journal / source
IEEE Transactions on Geoscience and Remote Sensing
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
64
Pages
5621611–5621611
Publication date
1 January 2026