π*₀.₆: a VLA That Learns From Experience

Read full text
Authors: Ali Amin, Raichelle J. Aniceto, Ashwin Balakrishna, Kevin Black, Ken Conley, Grace Connors, James Darpinian, Karan Dhabalia, Jared Carlo, Danny Driess, Michael Equi, A. Esmail
+43 more Yunhao Fang, Chelsea Finn, Catherine Glossop, Thomas Godden, Ivan Goryachev, Lachy Groom, Hunter Hancock, Karol Hausman, Gashon Hussein, Brian Ichter, Szymon Jakubczak, Rowan Jen, Tim Jones, Benjamin Katz, Liyiming Ke, Chandra Kuchi, Marinda Lamb, Devin LeBlanc, Sergey Levine, Adrian Li-Bell, Yao Lu, Vishnu Mano, Mohith Mothukuri, Suraj Nair, Karl Pertsch, Allen Z. Ren, Charvi Sharma, Lucy Shi, Laura Smith, Jost Tobias Springenberg, Kyle Stachowicz, Will Stoeckle, Alexander Swerdlow, James Tanner, Marcel Torne, Quan Vuong, Anna Walling, Haohuan Wang, Blake Williams, Sukwon Yoo, Lili Yu, Ury Zhilinsky, Zhiyuan Zhou
Cited by: 1

Abstract

Fig. 1: RECAP enables VLAs to improve performance during deployment.Our model incorporates advantage conditioning, allowing it to ingest diverse types of real-world experience: human demonstrations, autonomous rollouts and online corrections.Learning from real-world interaction via advantage conditioning improves the model's understanding of how actions influence performance, leading to a faster and more successful policy.Abstract-Vision-language-action (VLA) models offer a promising path toward general-purpose robots, but achieving the reliability and speed required for practical deployment remains challenging.We present a general-purpose method, RL with Experience and Corrections via Advantage-conditioned Policies (RECAP) that improves the efficiency and reliability of VLA policies by utilizing their real-world experience.Our method introduces value-based advantage conditioning during both pretraining and post-training phases, enabling VLA policies to ingest highly heterogeneous real-world experience, including human demonstrations, policy rollouts, and online correction data.We show that the ω → 0.6 model, trained with RECAP, achieves hourslong deployment of folding diverse laundry in real homes, reliably assembles boxes in a factory, and makes espresso drinks using a professional espresso machine.On some of the hardest tasks, RECAP more than doubles task throughput and roughly halves the task failure rate.

Publication details

Journal / source
Robotics: Science and Systems XXII
Publisher
Robotics: Science and Systems Foundation
Publication date
13 July 2026