Augmented Reality Visual Retrieval for Object Detection and Corpus-Guided Content Generation
Summary
No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.
Summarise with VIRAT Free to try with your Science Catalogs account.Abstract
Object detection models have recently become lightweight enough for deployment on resource-constrained devices such as smartphones and Augmented Reality (AR) headsets. Techniques such as few-shot, zero-shot, and incremental learning have moved toward lower training times and faster inference for detection models, but most frameworks still require substantial training or retraining to dynamically add new object classes in real-time for practical use with AR. In this paper, we present a novel AR-integrated object detection system that leverages Visual Retrieval Augmented Generation (ARVRag for short), eliminating much of the lengthy and expensive training processes associated with traditional object detection models. By vectorizing a smaller set of training images and conducting a local similarity search, we achieve enough accuracy for practical use with AR in significantly less time than state-of-the-art models like YOLO. Moreover, we have built this process into support systems for maintenance and industrial operations. End-users can select an object using a 2 D image capture interface that automatically retrieves semantically similar items from a local corpus (database), and the resulting detection provides metadataenhanced object-specific responses from a large language model (LLM). This work demonstrates a practical and scalable pathway for LLM-supported object detection in AR applications, especially for manufacturing and repair.
Fields of Study & Subjects
Advanced Neural Network Applications
Augmented Reality Applications
Advanced Image and Video Retrieval Techniques
Publication details
- Journal / source
- IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)
- Pages
- 48–56
- Publication date
- 26 January 2026
- Language
- EN