Deep learning–enabled versatile shape perception for soft robots via single-ended multimode fiber

Read full text
Authors: Zhaofan He, Lele Wang, Haidi Geng, Zhengyang Lu, Tiantian He, Hongkun Zhong, Hailong Zhang, Runfeng Zhu, Qingxiang Zhao, Yuan Meng, Dan Li, Ping Yan
+2 more Qiang Liu, Qirong Xiao
Cited by: 1
References: 48

Abstract

The evolution of soft robots into embodied intelligent systems relies fundamentally on precise proprioception. However, a universal solution for capturing continuous deformations during diverse interactions, particularly in spatially confined interventional scenarios, remains lacking. Here, we introduce a deep learning-enabled versatile shape perception method based on a single-ended multimode fiber (MMF). By leveraging the intrinsic integration advantages of optics, our minimalist reflective architecture physically eliminates the dependence on complex demodulation units and distal devices. Furthermore, treating chaotic optical speckle fields as data streams encoding high-dimensional shape information, reconfigurable neural decoders resolve a single physical channel into versatile perception modes tailored to heterogeneous tasks: discrete state confirmation on soft grippers (>99% accuracy), continuous shape tracking on bionic dexterous hands (~5-fold spatial resolution enhancement), and intuitive 3D morphological reconstruction of soft surgical robots (IoU>0.93). Overall, our work establishes a versatile framework for breaking hardware adaptability limits via computation, laying a solid foundation for closed-loop control in digital twins of soft robots.

Fields of Study & Subjects

Soft Robotics and Applications Advanced Sensor and Energy Harvesting Materials Advanced Materials and Mechanics

Publication details

Journal / source
Science Advances
Publisher
American Association for the Advancement of Science (AAAS)
Volume
12
Issue
24
Pages
eaef6263–eaef6263
Publication date
12 June 2026
Language
EN