Surface EMG-Based Hand Gesture Recognition Using a Hybrid Multistream Deep Learning Architecture
Abstract
Surface electromyography (sEMG) enables non-invasive measurement of muscle activity for applications such as human-machine interaction, rehabilitation, and prosthesis control. However, high noise levels, inter-subject variability, and the complex nature of muscle activation hinder robust gesture classification. This study proposes a multistream hybrid deep-learning architecture for the FORS-EMG dataset to address these challenges. The model integrates Temporal Convolutional Networks (TCN), depthwise separable convolutions, bidirectional Long Short-Term Memory (LSTM)-Gated Recurrent Unit (GRU) layers, and a Transformer encoder to capture complementary temporal and spectral patterns, and an ArcFace-based classifier to enhance class separability. We evaluate the approach under three protocols: subject-wise, random split without augmentation, and random split with augmentation. In the augmented random-split setting, the model attains 96.4% accuracy, surpassing previously reported values. In the subject-wise setting, accuracy is 74%, revealing limited cross-user generalization. The results demonstrate the method's high performance and highlight the impact of data-partition strategies for real-world sEMG-based gesture recognition.
Fields of Study & Subjects
Muscle activation and electromyography studies
Advanced Sensor and Energy Harvesting Materials
Hand Gesture Recognition Systems
Publication details
- Journal / source
- Sensors
- Publisher
- MDPI AG
- Volume
- 26
- Issue
- 7
- Pages
- 2281–2281
- Publication date
- 7 April 2026
- Language
- EN