Iterative Adversarial Learning With Chaser Agents for Time-Efficient Crowd-Aware Navigation

Read full text
Authors: Tianjian Yuan, Wei Dong Zhu, Mitsuhiro Hayashibe
Cited by: 1
References: 32

Abstract

This paper addresses the challenge of safe and time-efficient crowd navigation for autonomous robots in dynamic environments. Existing methods struggle in scenarios with unpredictable or obstructive pedestrian behaviors. These limitations raise serious safety and efficiency concerns in real-world deployments. To improve navigation robustness and efficiency, we propose an adversarial deep reinforcement learning (DRL) framework that simulates competitive pedestrian behaviors through a chaser agent. In addition, we further introduce an ensemble agent that dynamically selects policies based on real-time observations, enhancing generalization across diverse scenarios. Extensive simulation results demonstrate enhanced navigation performance in terms of success rate and navigation efficiency when using our framework. Additionally, the ensemble agent further improves stability and overall generalizability across various environments. Real-world experiments validate the approach and demonstrate the potential for sim-to-real transfer.

Fields of Study & Subjects

Evacuation and Crowd Dynamics Autonomous Vehicle Technology and Safety Reinforcement Learning in Robotics

Publication details

Journal / source
IEEE Robotics and Automation Letters
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
11
Issue
4
Pages
4082–4089
Publication date
16 February 2026