SRAS: A Lightweight Reinforcement Learning-based Document Selector for Edge-Native RAG Pipelines

Read full text
Authors: Rajiv Chaitanya Muttur
Cited by: 0

Abstract

Retrieval-Augmented Generation (RAG) systems often rely on fixed top-k document selection mechanisms that ignore downstream generation quality and impose computational overheads. We propose SRAS (Sparse Reward-Aware Selector), a lightweight document selector trained via reinforcement learning (RL) for edge-native RAG deployment. Unlike prior RL-based retrievers that assume large memory and latency budgets, SRAS learns a compact (~0.76MB) policy using Proximal Policy Optimization (PPO), guided by a hybrid reward signal combining Relaxed F1 and BERTScore. Our method operates under tight token and compute constraints, maintaining

Fields of Study & Subjects

Caching and Content Delivery Advanced Neural Network Applications Advanced Data Storage Technologies

Publication details

Journal / source
arXiv (Cornell University)
Publication date
5 January 2026
Document type
Preprint