A Hybrid θ*-APF-Q Framework for Energy-Aware Path Planning of Unmanned Surface Vehicles Under Wind and Current

Read full text
Authors: Xiaojie Sun, ZH Dong, Xinbo Chen, Lifan Sun, Yanheng An
Cited by: 1
References: 22

Abstract

Safe and energy-aware navigation is still difficult for unmanned surface vehicles (USVs), especially in cluttered waters where obstacles, smooth motion, and wind or current effects must be considered at the same time. If these issues are handled separately, the path may become longer and the vehicle may turn more often, which raises propulsion effort and hurts stability. To reduce these problems, a hybrid path planning method called θ∗-APF-Q is proposed, and it combines global planning, learning-based decisions, and local adjustment in a three-layer structure. First, an any-angle θ∗ global planner is employed to generate a near-optimal backbone trajectory by line-of-sight pruning, thereby reducing redundant waypoints and limiting detours. Second, an enhanced tabular Q-learning model is executed in an expanded eight-direction action space, and policy learning is guided by a multi-objective reward that jointly encourages distance reduction, alignment with ocean current and wind-induced forces for energy saving, smooth heading variation to suppress excessive steering, and maintenance of a safety margin near obstacles. Third, an adaptive artificial potential field (APF) module is used for real-time local correction, providing repulsion in high-risk regions and assisting trajectory smoothing to reduce unnecessary turning operations. A decision bias strategy further couples instantaneous APF forces with long-term state-action values, while the influence weight is adaptively adjusted according to environmental complexity. The algorithm is validated on the randomly generated marine grid maps and on the real-world satellite map scenario, with comparisons against a conventional four-direction Q-learning baseline. Across randomized tests, average path length, turning frequency, and the composite energy indicator are reduced by 22.3%, 55.6%, and 26.4%, respectively, and the success rate increases by 16%. The results indicate that integrating global guidance, adaptive learning, and local reactive decision making supports practical, energy-aware USV navigation.

Fields of Study & Subjects

Maritime Navigation and Safety Robotic Path Planning Algorithms Ship Hydrodynamics and Maneuverability

Publication details

Journal / source
Sensors
Publisher
MDPI AG
Volume
26
Issue
7
Pages
2116–2116
Publication date
29 March 2026
Language
EN