STRAViT: A Spatial–Temporal Feature-Reshaped Agent Vision Transformer for EEG-Based Emotion Recognition
Abstract
Emotion recognition from electroencephalogram (EEG) signals has attracted increasing interest due to its applications in affective computing and brain-computer interaction. However, effectively integrating spatial-temporal features while attending to emotionally relevant brain regions remains a significant challenge. In this article, we propose a spatial-temporal feature-reshaped agent vision transformer network (STRAViT), which fuses differential entropy (DE) and spatial connectivity matrices through a dual-branch attention-based Feature Reshaping Module (FRM), enabling refined feature integration. In addition, we introduce an Agent Vision Transformer (AViT) that utilizes learnable agent tokens to capture global-local dependencies within EEG representations efficiently. Extensive experiments conducted on the SEED and SEED-IV datasets demonstrate that the STRAViT achieves classification accuracies of 98.68% and 87.14% on SEED, 95.52% and 72.51% on SEED-IV, under subject-dependent and subject-independent strategies. The proposed network not only effectively integrates spatial-temporal features of EEG signals but also enhances the modeling of inter-regional dependencies through agent attention. Comprehensive tests confirm that the STRAViT yields excellent performance on emotion recognition tasks.
Fields of Study & Subjects
Emotion and Mood Recognition
Social Robot Interaction and HRI
Psychiatry
Mental Health
Neuroscience
Publication details
- Journal / source
- IEEE Transactions on Instrumentation and Measurement
- Volume
- 75
- Pages
- 4009815–4009815
- Publication date
- 1 January 2026
- Language
- EN