Direction Prediction Error-Prioritized Experience Replay (DPE-PER) for Adversarial UAV Interception Under Partial Observability

View at publisher
Authors: Issaree Srisomboon, Sanghwan Lee
Cited by: 0
References: 32

Abstract

Autonomous interception of unmanned aerial vehicles (UAVs) is a critical capability in modern defense, requiring agents to navigate adversarial maneuvers under environmental uncertainty. While conventional path planning often assumes full observability and static behaviors, this study addresses the complex challenge of intercepting an evasive target within a partially observable Markov decision process (POMDP) framework. We propose a deep Q-network (DQN) framework enhanced by a novel sampling strategy: direction prediction error–prioritized experience replay (DPE-PER). Unlike standard replay mechanisms, DPE-PER utilizes an auxiliary prediction task to prioritize transitions based on direction prediction (DP) error and directional uncertainty. By emphasizing experiences where the agent’s internal model fails to anticipate target maneuvers, DPE-PER focuses learning on the most informative adversarial interactions. Extensive simulations demonstrate that our approach achieves a 48.2% improvement in target interception rates and a 25.4% increase in average return compared to standard experience replay (ER) and prioritized experience replay (PER), highlighting the effectiveness of integrating predictive signals into experience selection for robust UAV autonomy in adversarial environments.

Fields of Study & Subjects

Reinforcement Learning in Robotics Guidance and Control Systems Adaptive Dynamic Programming Control

Publication details

Journal / source
IEEE Internet of Things Journal
Volume
13
Issue
10
Pages
21938–21951
Publication date
23 February 2026
Language
EN