On the promises and challenges of AI-powered XR glasses as embodied software
Abstract
AI-powered Extended Reality (XR) glasses represent the next frontier in software interface, integrating spatial computing with foundation models (FMs) to interact with physical environments in real-time. This technology promises a rich, immersive, and interactive user experience with seamless integration in real-world scenarios, while simultaneously introducing unprecedented challenges at the intersection of AI and Software Engineering (SE). This vision paper aims to catalyse the development of robust spatial software by characterising XR glasses as a distinct software paradigm through a conceptual framework and defining its advanced capabilities. We identify critical research problems, including security and privacy, validation of spatial capabilities, and explainability, while highlighting broader societal implications spanning ethics, accessibility, inclusivity, and open development ecosystems. Finally, we outline pathways for developing reliable and trustworthy XR systems in the FM era.
Fields of Study & Subjects
Augmented Reality Applications
Virtual Reality Applications and Impacts
Interactive and Immersive Displays
Publication details
- Journal / source
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York)
- Publication date
- 19 January 2026
- Language
- EN