STRAViT: A Spatial–Temporal Feature-Reshaped Agent Vision Transformer for EEG-Based Emotion Recognition

Read full text
Authors: Xinyu Cui, Xiaowei Li, Jing Zhu, Bin Hu
Cited by: 0

Abstract

Emotion recognition from electroencephalogram (EEG) signals has attracted increasing interest due to its applications in affective computing and brain-computer interaction. However, effectively integrating spatial-temporal features while attending to emotionally relevant brain regions remains a significant challenge. In this article, we propose a spatial-temporal feature-reshaped agent vision transformer network (STRAViT), which fuses differential entropy (DE) and spatial connectivity matrices through a dual-branch attention-based Feature Reshaping Module (FRM), enabling refined feature integration. In addition, we introduce an Agent Vision Transformer (AViT) that utilizes learnable agent tokens to capture global-local dependencies within EEG representations efficiently. Extensive experiments conducted on the SEED and SEED-IV datasets demonstrate that the STRAViT achieves classification accuracies of 98.68% and 87.14% on SEED, 95.52% and 72.51% on SEED-IV, under subject-dependent and subject-independent strategies. The proposed network not only effectively integrates spatial-temporal features of EEG signals but also enhances the modeling of inter-regional dependencies through agent attention. Comprehensive tests confirm that the STRAViT yields excellent performance on emotion recognition tasks.

Fields of Study & Subjects

Emotion and Mood Recognition Social Robot Interaction and HRI Psychiatry Mental Health Neuroscience

Publication details

Journal / source
IEEE Transactions on Instrumentation and Measurement
Volume
75
Pages
4009815–4009815
Publication date
1 January 2026
Language
EN