Data-Driven Extended Reality Dashboards: Integrating Operator Training and Decision Support in Manufacturing Backed by Physics-Based Simulations

Read full text
Authors: Iman Jalilvand, Bhushan Gopaluni, Abbas Sadeghzadeh Milani
Cited by: 1
References: 34

Abstract

Operator training in advanced manufacturing is constrained by potential inefficiency, risk, and limited feedback, creating a need for systems that provide interpretable, performance-driven insights. We developed an interactive Mixed Reality Training Platform (MRTP) that integrates simulation-based interaction with analytics-driven dashboards and assessed it through a case study in spatial heat control of a manufacturing process. Using MRTP, operators engage in immersive tasks, while receiving performance indicators including energy use, task duration, and zone-specific deviations from target temperatures. Two complementary dashboards support the MRTP: (1) introduces target temperature profiles; (2) visualizes performance through error heatmaps and energy consumptions. Moreover, the system provides managerial insights, enabling industry experts to track progress while evaluating workforce efficiency continuously. Results demonstrated an average 74% reduction in spatial error by users across multiple runs, while balancing time and energy demands. This new analytics-centered framework establishes a structured architecture for performance-aware mixed reality training in industrial contexts.

Fields of Study & Subjects

Augmented Reality Applications Digital Transformation in Industry Human-Automation Interaction and Safety

Publication details

Journal / source
Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Pages
1–7
Publication date
13 April 2026