Seeing through the noise: A cross-modal guided framework for hyperspectral image classification under multi-type degradations
Abstract
Recent advances in deep learning and multimodal data fusion technologies have significantly enhanced hyperspectral image (HSI) classification performance. Nevertheless, classification accuracy of hyperspectral data continues to degrade substantially under diverse degradation scenarios, such as noise interference, spectral distortion, or reduced resolution. To robustly address this challenge, this paper proposes a novel cross-modal guided classification framework that integrates active remote sensing data (e.g., LiDAR) to improve classification resilience under degraded conditions. Specifically, we introduce a Cross-Modal Feature Pyramid Guidance (CMFPG) module, which effectively utilizes cross-modal information across multiple levels and scales to guide hyperspectral feature extraction and fusion, thereby enhancing modeling stability in degraded environments. Additionally, we develop the HyperGroupMix module, which enhances cross-domain adaptability through grouping spectral bands, extracting statistical features, and transferring features across samples. Experimental results conducted under complex degradation conditions demonstrate that our proposed method exhibits stable high-level classification accuracy and robustness in overall performance. The code is accessible at: https://github.com/miliwww/CMGF
Fields of Study & Subjects
Remote-Sensing Image Classification
Image Enhancement Techniques
Visual Attention and Saliency Detection
Publication details
- Journal / source
- International Journal of Applied Earth Observation and Geoinformation
- Publisher
- Elsevier BV
- Volume
- 146
- Pages
- 105117–105117
- Publication date
- 18 January 2026
- Language
- EN