Vision-Language Navigation for Indoor Construction Site Inspection using Quadruped Robots
Abstract
Automated inspection of indoor construction sites is pivotal for enhancing project quality management and operational safety.Mobile inspection robots possess the potential to gradually replace human workers.However, characterized by high dynamics, clutter, and visual monotony, construction environments pose severe navigational challenges.Current SLAM solutions impose heavy computational burdens and face robustness challenges in such environments.Therefore, this study proposes a Vision-Language Navigation framework tailored for indoor construction site inspection.Specifically, we leverage the robust generalization of pre-trained Vision-Language Models (VLMs) to construct a two-stage navigation agent controlling quadruped robots.In the first stage, we utilize building floor plans and scene graphs to plan movement paths within the facility, thereby generating detailed navigation sub-tasks and path descriptions.In the second stage, the navigation agent outputs the subsequent action sequence based on current sub-task information and continuously updated historical navigation memory until the navigation task is completed.The proposed framework was validated within a custom three-story educational building construction scenario simulated in the Habitat3.0simulator.Experimental results demonstrate that the path generation module achieves high semantic alignment with ground truth.Furthermore, the agent exhibits execution capabilities in challenging scenarios, such as textureless cross-room traversal and stair climbing.This work provides a new technical pathway for achieving low-cost and flexible intelligent construction inspection, advancing construction automation.
Fields of Study & Subjects
Robotics and Sensor-Based Localization
Modular Robots and Swarm Intelligence
Innovations in Concrete and Construction Materials
Publication details
- Journal / source
- Proceedings of the ... ISARC
- Publisher
- International Association for Automation and Robotics in Construction (IAARC)
- Publication date
- 22 June 2026