A Bidirectional Feedback Actor–Critic Approach for Collaborative Target Search in Heterogeneous Intelligent Agent Systems

View at publisher
Authors: Xin Cao, He Luo, Guoqiang Wang, Shan Xue, Jian Yu Yang, Amin Beheshti, Jia Wu
Cited by: 0
References: 41

Abstract

In target search tasks such as post-disaster rescue, collaboration between unmanned aerial vehicles and unmanned ground vehicles can significantly improve search efficiency. This study proposes an air–ground heterogeneous unmanned system cooperative search method termed bidirectional feedback actor–critic (BiF-AC). The key innovation lies in integrating aerial wide-area coverage with precise ground positioning to design a point-area combined search mechanism. A dynamic Voronoi-based method is further adopted to enhance collaboration within heterogeneous systems. Considering the characteristics of the target search problem, an actor–critic framework is introduced for agent training, bidirectional information interaction is employed, and a multilevel feedback reward function is constructed to ensure efficient search performance in diverse environments. Experimental results show that BiF-AC improves the target search success rates by an average of 40.3% and reduces search steps by 21.3% compared with other baseline algorithms. This research offers theoretical support and implementation paths for intelligent unmanned systems in emergency search, environmental monitoring, and related fields.

Fields of Study & Subjects

Reinforcement Learning in Robotics Distributed Control Multi-Agent Systems Robotic Path Planning Algorithms

Publication details

Journal / source
IEEE Systems Journal
Volume
20
Issue
1
Pages
123–134
Publication date
12 February 2026
Language
EN