On the promises and challenges of AI-powered XR glasses as embodied software

Read full text
Authors: Gu, R., Zhang, J., Miguel Rojas, J., Shin, D.
Cited by: 0

Abstract

AI-powered Extended Reality (XR) glasses represent the next frontier in software interface, integrating spatial computing with foundation models (FMs) to interact with physical environments in real-time. This technology promises a rich, immersive, and interactive user experience with seamless integration in real-world scenarios, while simultaneously introducing unprecedented challenges at the intersection of AI and Software Engineering (SE). This vision paper aims to catalyse the development of robust spatial software by characterising XR glasses as a distinct software paradigm through a conceptual framework and defining its advanced capabilities. We identify critical research problems, including security and privacy, validation of spatial capabilities, and explainability, while highlighting broader societal implications spanning ethics, accessibility, inclusivity, and open development ecosystems. Finally, we outline pathways for developing reliable and trustworthy XR systems in the FM era.

Fields of Study & Subjects

Augmented Reality Applications Virtual Reality Applications and Impacts Interactive and Immersive Displays

Publication details

Journal / source
White Rose Research Online (University of Leeds, The University of Sheffield, University of York)
Publication date
19 January 2026
Language
EN