PEAfowl: Perception-Enhanced Multi-View Vision-Language-Action for Bimanual Manipulation

Read full text
Authors: Qingyu Fan, Zhaoxiang Li, Yi Lu, Yi Lu, Qiu Shen, Qiu Shen, Xiaoxiao Long, Yinghao Cai, Tao Lu, Shuo Wang, Xun Cao
Cited by: 0
References: 12

Abstract

Bimanual manipulation in cluttered scenes requires policies that remain stable under occlusions, viewpoint changes and scene variations. Existing vision-language-action models often lack such robustness because (i) multi-view features are fused via view-agnostic token concatenation, yielding limited cross-view spatial representations, and (ii) language is injected as global conditioning, resulting in coarse instruction grounding. In this paper, we introduce PEAfowl, a perception-enhanced multi-view VLA policy for bimanual manipulation. For spatial perception, PEAfowl predicts per-token depth distributions, performs differentiable 3D lifting, and aggregates local cross-view neighbors to form geometrically grounded, cross-view aligned representations. For language utilization, we propose to replace global conditioning with a Perceiver-style text-aware readout over frozen CLIP visual features, enabling iterative evidence accumulation. To better exploit commodity RGB-D sensing despite noisy and incomplete depth, PEAfowl's depth-distribution lifting naturally supports training-only depth distillation, where a pretrained depth teacher supervises the depth-distribution head to inject refined geometric priors without adding inference overhead. On RoboTwin 2.0 under domain-randomized setting, PEAfowl improves the strongest baseline by 23.0 pp in success rate, and physical experiments further demonstrate improved performance on the evaluated real-robot tasks. Project website: https://peafowlvla.github.io/.

Fields of Study & Subjects

Robot Manipulation and Learning Reinforcement Learning in Robotics Multimodal Machine Learning Applications

Publication details

Journal / source
IEEE Robotics and Automation Letters
Volume
11
Issue
10
Pages
11841–11848
Publication date
21 August 2026