A Dynamic Retrieval-Augmented Generation System with Selective Memory and Remembrance

Read full text
Authors: Okan Bursa
Cited by: 0

Abstract

We introduce \emph{Adaptive RAG Memory} (ARM), a retrieval-augmented generation (RAG) framework that replaces a static vector index with a \emph{dynamic} memory substrate governed by selective remembrance and decay. Frequently retrieved items are consolidated and protected from forgetting, while rarely used items gradually decay, inspired by cognitive consolidation and forgetting principles. On a lightweight retrieval benchmark, ARM reaches near state-of-the-art performance (e.g., NDCG@5 $\approx$ 0.940, Recall@5 $=1.000$) with only $\sim$22M parameters in the embedding layer, achieving the best efficiency among ultra-efficient models ($

Fields of Study & Subjects

Information Retrieval and Search Behavior Topic Modeling Multimodal Machine Learning Applications

Publication details

Journal / source
arXiv (Cornell University)
Publication date
4 January 2026
Document type
Preprint