A Cooperative Steering Control Strategy for Human--Machine Co-Driving Based on Stackelberg Game and Reinforcement Learning

View at publisher
Authors: Yisheng An, Haijing Ning, Herong Zhu, Yaxin Wei, Naiqi Wu, Yang Bai, Xiangmo Zhao
Cited by: 1
References: 42

Abstract

Human–machine co-driving is expected to be a long-term driving mode. However, existing cooperative steering control strategies often struggle to effectively handle human–machine interaction conflicts and dynamically allocate driving authority, making it difficult to balance safety and driver’s comfort. To address these issues, this article establishes a Stackelberg game-based model predictive control (MPC) framework and derives a human–machine optimal control strategy under the equilibrium conditions. Furthermore, a two-layer adaptive authority allocation model is developed using the deep deterministic policy gradient (DDPG) method, which comprehensively considers environmental risks, human–machine conflict, and driver’s states. This model prevents a vehicle from entering an unstable state by dynamically allocating the driving authority to both the human driver and the autonomous driving system. Results from driver-in-the-loop experiments indicate that, in obstacle avoidance scenarios, the proposed control strategy enhances vehicle driving stability by 31.49%, improves control stability by 48.11%, and reduces the driver’s burden by 42.87%, demonstrating that the proposed strategy can assist the driver in completing obstacle avoidance tasks and ensure driving safety in high-risk scenarios. In low-risk scenarios, it maintains the driver’s freedom, prevents excessive intervention from the autonomous driving system that could lead to significant human–machine conflicts, and alleviates the driver’s operational burden.

Fields of Study & Subjects

Reinforcement Learning in Robotics Autonomous Vehicle Technology and Safety Traffic control and management

Publication details

Journal / source
IEEE Transactions on Systems Man and Cybernetics Systems
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
56
Issue
8
Pages
4597–4611
Publication date
7 April 2026