A Visual Target Navigation Method for Quadrotor Based on Large Language Model in Unknown Environment

Read full text
Authors: Yunzhuo Liu, Zhaowei Ma, Jiankun Guo, Haozhe Sun, Yifeng Niu, Hong Zhang, Mengyun Wang
Cited by: 1
References: 28

Abstract

This paper proposes a novel Large Language Model (LLM)-based visual target navigation framework for quadrotors in unknown environments. Leveraging the semantic knowledge of LLMs, our method enables autonomous exploration based on natural language instructions. We design an intelligent planner using specialized prompt templates that operates in two phases: first, deriving global search sequences via probabilistic inference; second, dynamically generating sub-goal waypoints by fusing visual observations with statistical priors and LLM-derived scene relevance metrics. The quadrotor then executes a progressive search via path planning algorithms. Simulation results indicate that our fused method outperforms single-modality baselines by approximately 20%. Furthermore, physical flight experiments demonstrate success rates of 56% in Cross-layout and 48% in T-shaped layout scenarios. These results, while reflecting the inherent challenges of perceptual occlusion and planning uncertainty, validate the feasibility and potential of the proposed framework in real-world applications.

Fields of Study & Subjects

Robotic Path Planning Algorithms Multimodal Machine Learning Applications Robotics and Sensor-Based Localization

Publication details

Journal / source
Drones
Publisher
MDPI AG
Volume
10
Issue
2
Pages
134–134
Publication date
14 February 2026
Language
EN