Robo‐Saber: Generating and Simulating Virtual Reality Players

Abstract We present the first motion generation system for playtesting virtual reality (VR) games. Our player model generates VR headset and handheld controller movements from in‐game object arrangements, guided by style reference gameplay examples. We train on the large BOXRR‐23 dataset and apply our framework on the popular VR game Beat Saber . The resulting model Robo‐Saber reproduces skilled performance and captures diverse player behaviors present in the training data. Robo‐Saber demonstrates promise in synthesizing rich gameplay data for predictive applications and enabling whole‐body physics‐based VR playtesting.