MS-STGAN: A dual-branch multi-scale spatio-temporal generative adversarial framework for incomplete EEG-based emotion recognition

Read full text
Authors: Cheng Cheng, J Zhang, Yikang Cheng, Ziyu Jia, Weiqi He
Cited by: 1
References: 39

Abstract

Electroencephalography (EEG) enables high-resolution emotion recognition but often suffers from incomplete data in real-world scenarios due to sensor failures or preprocessing errors. To this end, we propose a Multi-Scale Spatio-Temporal Generative Adversarial Network (MS-STGAN). Specifically, we first apply random masking to the EEG channels data to simulate missing data conditions in practical environments. Then, we design a spatio-temporal dual-branch generator to reconstruct complete representations: the spatial branch employs graph convolutional networks (GCNs) to capture robust inter-regional dependencies, while the temporal branch leverages the BiMamba state space model to encode the dynamic evolution of emotions. To further enhance feature learning, multi-scale 2D convolution and deconvolution layers are incorporated before and after both branches, enabling the extraction of diverse spatio-temporal features. Additionally, we introduce a generative adversarial framework, where the generator restores informative features from incomplete inputs and the discriminator enforces the authenticity of reconstructed data. Finally, a fusion module integrates the outputs of both branches for downstream classification. Extensive experiments on the DEAP and SEED-IV datasets validate the effectiveness of each component and demonstrate that MS-STGAN achieves superior performance and strong generalization ability.

Fields of Study & Subjects

Emotion and Mood Recognition EEG and Brain-Computer Interfaces Face and Expression Recognition

Publication details

Journal / source
Neural Networks
Publisher
Elsevier BV
Volume
204
Pages
109203–109203
Publication date
7 June 2026
Language
EN