Augmented Reality Visual Retrieval for Object Detection and Corpus-Guided Content Generation

View at publisher Summarise with VIRAT
Authors: Alireza Taheritajar, J. L. Zhao, Jason Orlosky
Cited by: 0
References: 37

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Object detection models have recently become lightweight enough for deployment on resource-constrained devices such as smartphones and Augmented Reality (AR) headsets. Techniques such as few-shot, zero-shot, and incremental learning have moved toward lower training times and faster inference for detection models, but most frameworks still require substantial training or retraining to dynamically add new object classes in real-time for practical use with AR. In this paper, we present a novel AR-integrated object detection system that leverages Visual Retrieval Augmented Generation (ARVRag for short), eliminating much of the lengthy and expensive training processes associated with traditional object detection models. By vectorizing a smaller set of training images and conducting a local similarity search, we achieve enough accuracy for practical use with AR in significantly less time than state-of-the-art models like YOLO. Moreover, we have built this process into support systems for maintenance and industrial operations. End-users can select an object using a 2 D image capture interface that automatically retrieves semantically similar items from a local corpus (database), and the resulting detection provides metadataenhanced object-specific responses from a large language model (LLM). This work demonstrates a practical and scalable pathway for LLM-supported object detection in AR applications, especially for manufacturing and repair.

Fields of Study & Subjects

Advanced Neural Network Applications Augmented Reality Applications Advanced Image and Video Retrieval Techniques

Publication details

Journal / source
IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)
Pages
48–56
Publication date
26 January 2026
Language
EN