XSynth: GenAI-Empowered Shared Mental Model Building for Conceptual Design Collaboration in Extended Reality

Read full text
Authors: Yaning Li, Shumin Li, Ziyao He, Dakuo Wang
Cited by: 1
References: 118

Abstract

Effective conceptual design collaboration requires teams to build shared mental models (SMMs). Although Extended Reality (XR) technologies support design collaboration, they often lack structured cognition support for such alignment. To address this, we conducted this research within the sandbox of automotive design, and firstly identified key cognitive challenges in its collaboration. We then developed XSynth, a GenAI-powered XR system grounded in Concept–Knowledge Theory. XSynth scaffolds designers’ reasoning, externalizes individual mental models as knowledge graphs, and merges them into a unified graph to facilitate SMMs building. We evaluated XSynth in a within-subject experiment containing 10 design teams (N=30) using mixed-method approach. Results showed that XSynth significantly reduced workload, enhanced creativity support, strengthened perceived SMMs, and improved design performance. This research contributes to HCI by introducing the design and implementation of a theory-grounded, GenAI-powered, XR-based cognition support tool. It also offers empirical evidence into the effectiveness of XSynth, and design implications for future cognition support tools in collaborative settings.

Fields of Study & Subjects

Design Education and Practice Usability and User Interface Design Augmented Reality Applications

Publication details

Journal / source
Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Pages
1–24
Publication date
13 April 2026