QDepth-VLA: Quantized Depth Prediction as Auxiliary Supervision for Vision-Language-Action Models

View at publisher
Authors: Y LI, Yuhui Chen, Mingcai Zhou, Hui Li
Cited by: 1

Abstract

Spatial perception and reasoning are crucial for Vision–Language– Action (VLA) models to accomplish fine-grained manipulation tasks. However, existing approaches often lack the ability to understand and reason over the essential 3D structures necessary for precise control. To address this limitation, we propose QDepth-VLA, a general framework that augments VLA models with an auxiliary depth prediction task. A dedicated depth expert is designed to predict quantized latent tokens of depth maps obtained from a VQ-VAE encoder, enabling the model to learn depth-aware representations that capture critical geometric cues. Experimental results on the simulation benchmarks and real-world tasks demonstrate that QDepth-VLA yields strong spatial reasoning and competitive performance on manipulation tasks.

Fields of Study & Subjects

Multimodal Machine Learning Applications Robot Manipulation and Learning Reinforcement Learning in Robotics

Publication details

Journal / source
Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems
Publisher
International Foundation for Autonomous Agents and Multiagent Systems
Publication date
24 May 2026