X-Change: An RGB-Inspired Spectral-Aware Framework for Multitask and Explainable Change Captioning

View at publisher
Authors: Busra Tuzlupinar, Mehmet Fatih Amasyalı, Ali Can Karaca
Cited by: 0
References: 19

Abstract

Remote sensing change captioning describes land surface changes between bi-temporal images. However, models trained on RGB inputs often underperform compared to multispectral (MS) counterparts due to limited spectral awareness. We present X-Change, an RGB-inspired spectral-aware framework that achieves MS-level descriptive quality while jointly performing multi-task segmentation to predict change, NDVI, and NDWI masks—indicatingwhereandhowchange occurs. Unlike prior RGB-based methods, X-Change employs rule-based spectral supervision from bi-temporal Sentinel-2 data, enabling its shared encoder to internalize NDVI/NDWI-related cues for both captioning and segmentation tasks. Experiments on the MOSAIC-SEN2-CC dataset show that X-Change surpasses state-of- the-art RGB-based models and matches or slightly exceeds those trained on multispectral inputs, producing spatially consistent change and index maps. Overall, X-Change bridges the gap between RGB and MS modalities, offering an interpretable and practical framework for spectral-aware, multi-task, and explainable change captioning. The codebase will be publicly released at https://github.com/ChangeCapsInRS/X-Change.

Fields of Study & Subjects

Remote-Sensing Image Classification Remote Sensing in Agriculture Remote Sensing and Land Use

Publication details

Journal / source
IEEE Geoscience and Remote Sensing Letters
Volume
23
Pages
1–5
Publication date
1 January 2026
Language
EN