HuMam: Humanoid Motion Control via End-to-End Deep Reinforcement Learning with Mamba

Read full text
Authors: Yinuo Wang, Xiaowen Tao, Yunfeng Hu, Yang Liang, Ziyu Song, Haitao Ding, Jinzhao Zhou
Cited by: 0
References: 24

Abstract

End-to-end reinforcement learning (RL) for humanoid locomotion is appealing for its compact perception-action mapping, yet practical policies often suffer from training instability, inefficient feature fusion, and high actuation cost. We present HuMam, a state-centric end-to-end RL framework that employs a single-layer Mamba encoder to fuse robot-centric states with oriented footstep targets and a continuous phase clock. The policy outputs joint position targets tracked by a low-level PD loop and is optimized with PPO. A concise six-term reward balances contact quality, swing smoothness, foot placement, posture, and body stability while implicitly promoting energy saving. On the JVRC-1 humanoid in mc-mujoco, HuMam consistently improves learning efficiency, training stability, and overall task performance over a strong feedforward baseline, while reducing power consumption and torque peaks. To our knowledge, this is the first end-to-end humanoid RL controller that adopts Mamba as the fusion backbone, demonstrating tangible gains in efficiency, stability, and control economy.

Fields of Study & Subjects

Robotic Locomotion and Control Prosthetics and Rehabilitation Robotics Muscle activation and electromyography studies

Publication details

Journal / source
2026 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE International Conference on Robotics, Automation and Mechatronics (RAM)
Publisher
IEEE
Pages
319–324
Publication date
1 August 2026
Language
EN