A Human Vision Aided Method for Real-Time Foot Placement Prediction on Rough Terrains

View at publisher Summarise with VIRAT
Authors: Zhaokai Chen, Hanyang Xu, Xinxing Chen, Yuxuan Wang, Chenglong Fu
Cited by: 0
References: 28

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Human vision can instantaneously reflect motion intent during the execution of complex tasks. In rough terrain locomotion, intent prediction is achieved by foot placement prediction, which obtains intermediate gait parameters that indirectly reflect upcoming locomotion mode. This paper proposes a human vision aided framework to perform real-time foot placement prediction during dynamic walking on rough terrains, while precisely extracting step length, step height and foothold slope for the next step. In this paper, 3D human gaze is estimated by a depth-inertial eye tracking system. The Gaussian distribution-based gaze attention map is then used to model the temporal and spatial decay of human attention. To precisely measure gait parameters, a robust visual-inertial odometry algorithm is also employed to continuously estimate the camera pose. The real-time performance of the system is validated using data collected from online experiments, where five subjects are required to transverse rough terrains under different experimental setup. Experimental results demonstrate that the proposed approach achieves an average 97.4% intent prediction accuracy at 35% of the swing phase, with mean errors of 6.1 cm, 1.7 cm and$\boldsymbol{2.6^\circ }$for estimating step length, step height and foothold slope, respectively. These findings indicate that the real-time system have the potential to further improve the stability and safety of the control of walking assistive robots.

Fields of Study & Subjects

Robotic Locomotion and Control Prosthetics and Rehabilitation Robotics Robotics and Sensor-Based Localization

Publication details

Journal / source
IEEE Robotics and Automation Letters
Volume
11
Issue
5
Pages
5837–5844
Publication date
19 March 2026
Language
EN