Code underlying the publication: Trust-Region Twisted Policy Improvement

Read full text
Authors: Joery A. de Vries, Jinke He, Yaniv Oren, Matthijs T. J. Spaan
Cited by: 0

Abstract

TRT-SMC: Trust-Region Twisted Sequential Monte-Carlo — JAX implementation accompanying the ICML 2025 paper "Trust-Region Twisted Policy Improvement". Combines MCTS-inspired design choices (trust-region constrained action sampling, explicit terminal handling, improved policy/value targets) with particle filter planning to construct a GPU-efficient SMC policy improvement operator. Outperforms baseline MCTS and SMC planners in runtime and sample-efficiency across discrete and continuous RL domains. The smz module exposes a modular SMC planner accepting custom Proposal, Transition, and Target implementations, usable as a drop-in policy replacement compatible with jax.jit and jax.vmap.

Fields of Study & Subjects

Reinforcement Learning in Robotics Artificial Intelligence in Games Simulation Techniques and Applications

Publication details

Journal / source
4TU.ResearchData
Publication date
9 March 2026
Language
EN