Skeleton-based estimation of interaction readiness via spatio-temporal graph convolution

Read full text
Authors: Junze Yuan, Wael M. Mohammed, Manuel Ferré, Jose Luis Martinez Lastra
Cited by: 0
References: 22

Abstract

Estimating a person’s readiness to engage is a critical prerequisite for achieving natural interactions with machines. In this work, we explore a skeleton-based approach for estimating interaction readiness from human motion. A two-stream spatio-temporal graph convolutional network is applied as backbone. We propose two design changes to the backbone: Local Dense Connection (LDC), which enhances the flow of multi-scale features, and Cross-Stream Attention (CSA) module, allowing it to effectively relate joint and bone features. Rather than classifying actions directly, a probabilistic aggregation strategy is introduced to generate a scalar measure of interaction readiness, which helps the model generalize better to real-world scenes. Experiment on the processed NTU-RGB+D 120 dataset demonstrates the proposed method achieves 82.52% top-1 accuracy, outperforming backbone model. Moreover, experiment on real-world data achieves ROC-AUC = 0.9687 in realistic conditions, indicating the robustness and generalization ability of the proposed method with lightweight parameters (8.30 M). While relatively lightweight, the method offers a practical solution for scenarios that require fast, interpretable estimation such as human–robot interaction settings.

Fields of Study & Subjects

Human Pose and Action Recognition Hand Gesture Recognition Systems Human Motion and Animation

Publication details

Journal / source
Pattern Recognition Letters
Volume
203
Pages
50–56
Publication date
1 March 2026
Language
EN