Robust Human Pose Estimation and Action Recognition Utilizing Feature Extraction

Read full text Summarise with VIRAT
Authors: Sheng Luo, Rashid Abbasi, Hao Wang, Jinhua Xu, Dongyang Lyu, Aaron Zhang, Farhan Amin, Isabel de la Torre, Gerardo Mendez Mezquita, Henry Fabian Gongora
Cited by: 0
References: 20

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Human pose estimation is crucial across diverse applications, from healthcare to human–computer interaction. Integrating inertial measurement units (IMUs) with monocular vision methods holds great potential for leveraging complementary modalities; however, existing approaches are often limited by IMU drift, noise, and underutilization of visual information. To address these limitations, we propose a novel dual-stream feature extraction framework that effectively combines temporal IMU data and single-view image features for improved pose estimation. Short-term dependencies in IMU sequences are captured with convolutional layers, while a Transformer-based architecture models long-range temporal dynamics. To mitigate IMU drift and inter-sensor inconsistencies, a complementary filtering module is introduced alongside a cross-channel interaction mechanism. Features from the IMU and image streams are then fused via a dedicated fusion module and further refined utilizing a high-precision regression head for accurate pose prediction. Experimental results on benchmark datasets demonstrate that our method significantly outperforms existing techniques in terms of estimation, accuracy, and robustness, validating the effectiveness of our dual-stream architecture.

Fields of Study & Subjects

Human Pose and Action Recognition Hand Gesture Recognition Systems Context-Aware Activity Recognition Systems

Publication details

Journal / source
Computer Modeling in Engineering & Sciences
Volume
146
Issue
3
Pages
1–10
Publication date
1 January 2026
Language
EN