Pose-based embodied interaction for digital Dunhuang dance heritage
Abstract
This study presents a real-time interactive system using pose-based recognition to support learning of Dunhuang dance, an important intangible cultural heritage. A dataset of approximately 1230 annotated images was constructed, capturing correct and incorrect executions of five representative poses. Using MediaPipe for skeletal keypoint extraction, eight machine learning algorithms were compared; Random Forest achieved 98.5% accuracy and 99.4% recall in correctness classification and over 97% accuracy in multi-class pose recognition. The system operates at 20–25 fps with latency below 100 ms, integrating tolerant real-time feedback with Dunhuang-style artefact generation to support both embodied learning and cultural mediation. Results demonstrate that lightweight models can effectively support embodied interaction in data-scarce cultural contexts. Future work will explore temporal modelling and broader deployment.
Fields of Study & Subjects
Human Motion and Animation
Human Pose and Action Recognition
Diversity and Impact of Dance
Publication details
- Journal / source
- npj Heritage Science
- Publisher
- Springer Science and Business Media LLC
- Volume
- 14
- Issue
- 1
- Publication date
- 9 April 2026
- Language
- EN