Hyperspectral image classification via Transformer-based spectral-spatial attention decoupling and adaptive gating

View at publisher
Authors: Li Guandong, Mengxia Ye
Cited by: 1
References: 21

Abstract

Deep neural networks face several challenges in hyperspectral image classification, including high-dimensional data, sparse distribution of ground objects, and spectral redundancy, which often lead to classification overfitting and limited generalisation capability. To more effectively extract and fuse spatial context with fine spectral information in hyperspectral image (HSI) classification, this paper proposes a novel network architecture called STNet. The core advantage of STNet stems from the dual innovative design of its Spatial-Spectral Transformer module: first, the fundamental explicit decoupling of spatial and spectral attention ensures targeted capture of key information in HSI; second, two functionally distinct gating mechanisms perform intelligent regulation at both the fusion level of attention flows (adaptive attention fusion gating) and the internal level of feature transformation (GFFN). This characteristic demonstrates superior feature extraction and fusion capabilities compared to traditional convolutional neural networks, while reducing overfitting risks in small-sample and high-noise scenarios. STNet enhances model representation capability without increasing network depth or width. The proposed method demonstrates superior performance on IN, UP, and KSC datasets, outperforming mainstream hyperspectral image classification approaches.

Fields of Study & Subjects

Remote-Sensing Image Classification Face and Expression Recognition Advanced Image Fusion Techniques

Publication details

Journal / source
International Journal of Image and Data Fusion
Publisher
Informa UK Limited
Volume
17
Issue
1
Publication date
13 February 2026
Language
EN