SkyPose: Skeleton consistency guided diffusion model for 3D human pose estimation

Read full text
Authors: Xuguang Liu, Yong Wang, Wenxiu Dan, Wenming Yang
Cited by: 0
References: 27

Abstract

Although diffusion models have demonstrated promising potential in 3D human pose estimation, existing approaches commonly adopt fixed noise variance scheduling strategies. This design overlooks the skeletal consistency constraints that should be maintained between 2D observations and 3D predictions during iterative denoising. Consequently, the generated 3D poses often exhibit geometric inconsistencies with the input 2D poses, thereby degrading the overall reconstruction quality. To address this limitation, we propose SkyPose: Skeleton Consistency Guided Diffusion Model for 3D Human Pose Estimation. The proposed method enforces skeletal consistency by reprojecting the previously generated 3D pose onto the 2D plane, decomposing it into skeletal direction and length, and comparing it with the input 2D skeletal structure to construct a dynamic skeletal consistency metric. This metric adaptively adjusts the noise variance σt during DDIM iterations, explicitly preserving skeletal structural coherence throughout the denoising process and enhancing the geometric fidelity of the generated 3D poses. Furthermore, we redesign the denoising network architecture to integrate skeletal structure features with joint coordinate features at the local joint, body-part, and full-body levels, thereby enabling joint–skeleton collaborative denoising under multi-granularity geometric constraints. Extensive experiments on the Human3.6M and MPI-INF-3DHP datasets demonstrate that our approach achieves superior accuracy compared with existing methods. The code is open-sourced at here.

Fields of Study & Subjects

Human Pose and Action Recognition Gait Recognition and Analysis Human Motion and Animation

Publication details

Journal / source
Knowledge-Based Systems
Publisher
Elsevier BV
Volume
347
Pages
116280–116280
Publication date
25 May 2026
Language
EN