From natural language to RL formulation: a digital twin–centered optimization framework for manufacturing systems

Read full text
Authors: Haolin Fan, Bingbing Li, Jiajun Ma, Edward Chow, Jerry Ying Hsi Fuh, Hongchao Zhang
Cited by: 1
References: 8

Abstract

Digital twins (DTs) are widely used in manufacturing for simulation-driven analysis and optimization. As optimization increasingly handles complex dynamics, constraints, and uncertainty, reinforcement learning (RL) becomes a natural choice. However, RL adoption in manufacturing remains limited due to the complexity and fragility of problem formulation. This paper presents a DT-centric optimization framework that enables practitioners to specify optimization intent at the process level while automatically generating executable RL formulations. An evolving playbook consolidates formulation knowledge across optimization cycles. Experiments show a 28% increase in final return, a 27% reduction in convergence time, and a stable success rate of 0.87.

Fields of Study & Subjects

Digital Transformation in Industry Flexible and Reconfigurable Manufacturing Systems Scheduling and Optimization Algorithms

Publication details

Journal / source
CIRP Annals
Publisher
Elsevier BV
Volume
75
Issue
1
Pages
161–165
Publication date
1 January 2026
Language
EN