Inference-Time Enhancement of Generative Robot Policies via Predictive World Modeling

View at publisher
Authors: Han Qi, Haocheng Yin, Aris Zhu, Yilun Du, Heng Yang
Cited by: 2
References: 14

Abstract

We presentgenerative predictive control(GPC), a framework forinference-timeenhancement of pretrained behavior-cloning policies. Rather than retraining or fine-tuning, GPC augments a frozen diffusion policy at deployment by coupling it with apredictive world model. Concretely, we train an action-conditioned world model on expert demonstrations and random exploration rollouts to forecast the consequences of action proposals produced by the diffusion policy, then perform lightweight online planning that ranks and refines these proposals via model-based look-ahead. This combination of a generative prior with predictive foresight enables test-time adaptation. Across diverse robotic manipulation tasks—state- and vision-based, in simulation and on real hardware—GPC consistently outperforms standard behavior cloning and compares favorably to other inference-time adaptation baselines.

Fields of Study & Subjects

Reinforcement Learning in Robotics Human Motion and Animation Generative Adversarial Networks and Image Synthesis

Publication details

Journal / source
IEEE Robotics and Automation Letters
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
11
Issue
5
Pages
5534–5541
Publication date
13 March 2026