Multimodal human action recognition and personalized sports health promotion: a deep learning framework integrating wearable sensor fusion

Read full text
Authors: Ying Xi, Taibin Huang, Zhiyu Yang
Cited by: 4
References: 39

Abstract

Introduction: In real-world sports scenarios, Human Action Recognition (HAR) is often hindered by data complexity, limited dynamic adaptability, and fragmented integration of physiological and kinematic information. To address these challenges, this study proposes a multimodal HAR framework for personalized sports health promotion by integrating wearable sensor streams with deep learning architectures. Methods: The proposed system employs a robust sensing layer to capture 12-dimensional multimodal data and synchronize physiological indicators with behavioral signals in real time. A novel Transformer-GCN hybrid model was developed to extract complex spatiotemporal dependencies for accurate action recognition and dynamic state analysis. In addition, a reinforcement learning module was incorporated to generate adaptive exercise prescriptions based on user progress. The framework was deployed through a responsive interface for real-time intervention and evaluated in a 12-week randomized controlled trial. Results: max), a 99.3% improvement in muscular endurance, and a sports injury rate maintained below 15%. These findings indicate that the framework can support accurate motion analysis and safe, personalized intervention. Discussion: The proposed multimodal fusion architecture effectively bridges the gap between action recognition and personalized sports health intervention. By combining wearable sensing, hybrid deep learning, and reinforcement learning, the framework provides a practical solution for AI-driven motion analysis and adaptive health promotion in land sports scenarios.

Fields of Study & Subjects

Human Pose and Action Recognition Context-Aware Activity Recognition Systems Sports Performance and Training

Publication details

Journal / source
Frontiers in Neurorobotics
Publisher
Frontiers Media SA
Volume
20
Pages
1785114–1785114
Publication date
10 April 2026
Language
EN