Nokast-SecureRAG: An Open-Source Framework for Trusted Local AI via SLM-Driven Defense

Read full text
Authors: Abhishek Rai
Cited by: 0

Abstract

Local Retrieval-Augmented Generation (RAG) systems enable powerful AI assistants to operate over private data but inherit security risks like Indirect Prompt Injection (IPI) and retrieval poisoning. nokast-secureRAG proposes a ~1-4B-parameter SLM as a context-aware defense layer between retriever and generator, using Semantic Context Consistency to detect instruction-like content misaligned with user intent. Designed for local hardware (16GB VRAM), privacy-first deployments, and LLM-agnostic integration. This conceptual white paper outlines the problem, surveys threats (Greshake'23, AgentPoison'24), presents architecture, and specifies future evaluation. All claims framed as hypotheses.

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Security and Verification in Computing Topic Modeling

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
6 March 2026
Language
EN
Document type
Preprint