Usability Study of VirtuAI: Personalized Situated Learning through Integrating VR and LLMs

This study introduces VirtuAI, a construction safety training system that integrates virtual reality (VR) and large language models (LLMs) to enhance safety education. Traditional methods lack contextual relevance and personalization, limiting effectiveness. VirtuAI addresses this by combining VR for situated learning with GPT-powered personalization. Users navigate realistic construction scenarios, identify hazards, and communicate with a virtual instructor to reinforce understanding. The system was developed in two phases: creating a VR environment and integrating GPT for personalized instruction. A pilot study on scaffolding safety showed a system usability scale (SUS) score of 74.54. Participants noted improved hazard recognition and safety practices, finding the system effective and user-friendly. Feedback highlighted areas for improvement, including movement controls and AI interaction. VirtuAI demonstrates a novel approach to safety training by merging immersive VR and adaptive AI. Future work will expand training content, refine user interaction, and assess long-term learning outcomes.