Video classification of Indonesian traditional dance using a hybrid CNN-LSTM model with pose estimation

Read full text
Authors: Candra Irawan, Heru Praomono Hadi, Cahaya Jatmoko, Mohamed Doheir
Cited by: 1

Abstract

The preservation and recognition of traditional Indonesian dances face challenges due to limited digital documentation and declining intergenerational transmission. Manual annotation of dance videos is time-consuming and prone to subjectivity, creating urgency for automated solutions. This study proposes a deep learning-based approach combining convolutional neural networks (CNN) for spatial feature extraction and long short-term memory (LSTM) for temporal modeling to recognize traditional dance movements from video sequences. The system leverages OpenPose for keypoint detection and gesture estimation, enabling frame-wise pose representation prior to classification. A hyperparameter tuning process was applied to optimize the CNN-LSTM architecture using 80% of the dataset for training and 20% for testing. Experimental results show the proposed model achieved a macro accuracy of 98.4%, with perfect precision, recall, and F1-score. This research contributes to cultural heritage digitization and intelligent video analysis by enabling accurate, real-time classification of traditional dances, providing a foundation for future systems in education, archiving, and motion-driven applications.

Fields of Study & Subjects

Human Motion and Animation Human Pose and Action Recognition Diversity and Impact of Dance

Publication details

Journal / source
Bulletin of Electrical Engineering and Informatics
Publisher
Institute of Advanced Engineering and Science
Volume
15
Issue
1
Pages
787–798
Publication date
1 February 2026