Transformers meet hyperspectral imaging: A comprehensive study of models, challenges and open problems

Read full text
Authors: Guyang Zhang, Waleed H. Abdulla
Cited by: 6
References: 163

Abstract

Transformers have become the architecture of choice for learning long-range dependencies, yet their adoption in hyperspectral imaging (HSI) is still emerging. We reviewed more than 300 papers published up to 2025 and present the first end-to-end survey dedicated to Transformer-based HSI classification. The study categorizes every stage of a typical pipeline—pre-processing, patch or pixel embedding, positional encoding, spatial–spectral feature extraction, multi-head self-attention variants, skip connections, and loss design—and contrasts alternative design choices with the unique spatial–spectral properties of HSI. We map the field’s progress against persistent obstacles: scarce labeled data, extreme spectral dimensionality, computational overhead, and limited model explainability. Finally, we outline a research agenda prioritizing valuable public data sets, lightweight on-edge models, illumination and sensor shifts robustness, and intrinsically interpretable attention mechanisms. Our goal is to guide researchers in selecting, combining, or extending Transformer components that are truly fit for purpose for next-generation HSI applications.

Fields of Study & Subjects

Optical Polarization and Ellipsometry Optical Imaging and Spectroscopy Techniques Remote-Sensing Image Classification

Publication details

Journal / source
Engineering Applications of Artificial Intelligence
Publisher
Elsevier BV
Volume
169
Pages
113947–113947
Publication date
12 February 2026
Language
EN