A Dynamic Retrieval-Augmented Generation System with Selective Memory and Remembrance
Abstract
We introduce \emph{Adaptive RAG Memory} (ARM), a retrieval-augmented generation (RAG) framework that replaces a static vector index with a \emph{dynamic} memory substrate governed by selective remembrance and decay. Frequently retrieved items are consolidated and protected from forgetting, while rarely used items gradually decay, inspired by cognitive consolidation and forgetting principles. On a lightweight retrieval benchmark, ARM reaches near state-of-the-art performance (e.g., NDCG@5 $\approx$ 0.940, Recall@5 $=1.000$) with only $\sim$22M parameters in the embedding layer, achieving the best efficiency among ultra-efficient models ($
Fields of Study & Subjects
Information Retrieval and Search Behavior
Topic Modeling
Multimodal Machine Learning Applications
Publication details
- Journal / source
- arXiv (Cornell University)
- Publication date
- 4 January 2026
- Document type
- Preprint