Data-Driven Extended Reality Dashboards: Integrating Operator Training and Decision Support in Manufacturing Backed by Physics-Based Simulations
Abstract
Operator training in advanced manufacturing is constrained by potential inefficiency, risk, and limited feedback, creating a need for systems that provide interpretable, performance-driven insights. We developed an interactive Mixed Reality Training Platform (MRTP) that integrates simulation-based interaction with analytics-driven dashboards and assessed it through a case study in spatial heat control of a manufacturing process. Using MRTP, operators engage in immersive tasks, while receiving performance indicators including energy use, task duration, and zone-specific deviations from target temperatures. Two complementary dashboards support the MRTP: (1) introduces target temperature profiles; (2) visualizes performance through error heatmaps and energy consumptions. Moreover, the system provides managerial insights, enabling industry experts to track progress while evaluating workforce efficiency continuously. Results demonstrated an average 74% reduction in spatial error by users across multiple runs, while balancing time and energy demands. This new analytics-centered framework establishes a structured architecture for performance-aware mixed reality training in industrial contexts.
Fields of Study & Subjects
Augmented Reality Applications
Digital Transformation in Industry
Human-Automation Interaction and Safety
Publication details
- Journal / source
- Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Pages
- 1–7
- Publication date
- 13 April 2026