Reinforcement learning in linear embedding space unlocks generalizable control across soft robot configurations

Read full text
Authors: Xinglong Zhang, C Z Li, Hangjie Mo, Yue Jiang, Wenyu Cao, Xin Xu, Wei Jiang, Zhenshan Bing, Yihe Yang, X.C. Li, Yueneng Yang, Huimin Lu
+5 more Ling‐Li Zeng, Alois Knoll, Dewen Hu, Li Wen, Wei Pan
Cited by: 1
References: 53

Abstract

Soft-bodied organisms exhibit prominent morphological adaptability, dynamically reconfiguring shape and stiffness to achieve versatile behaviors. Inspired by these systems, soft robots with diverse morphologies have emerged, yet a unified control framework that rapidly adapts across configurations remains elusive. Here, we introduce a generalizable control system that enables rapid cross-configuration adaptation via reinforcement learning in a shared linear Koopman embedding space. By encoding robot dynamics into this embedding space, our method decouples control policies from specific morphologies, allowing real-time, model-free policy adaptation without retraining from scratch. We validate our system across 33 distinct robot configurations. Our system achieves a 75 × reduction in transfer samples across configurations, while sustaining robust performance under high-speed motion, heavy payloads, and multiactuator faults, and achieving real-world skills previously unattainable in soft robotics. This work establishes an adaptable control framework for diverse soft robot configurations and may offer insights for generalizable control in complex physical systems. This work introduces a generalizable control system that enables rapid adaptation across 33 soft robot configurations via reinforcement learning in a shared Koopman embedding space, enabling real-world skills in carpentry and bartending style tasks.

Fields of Study & Subjects

Soft Robotics and Applications Micro and Nano Robotics Advanced Materials and Mechanics

Publication details

Journal / source
Nature Communications
Publisher
Springer Science and Business Media LLC
Volume
17
Issue
1
Publication date
8 June 2026
Language
EN