"PromptGame Dataset: Prompt Injection Attack Benchmark and Defense Evaluation Data"

Read full text
Authors: Naga Sujitha Vummaneni, Usha Ratnam Jammula
Cited by: 0

Abstract

"This dataset accompanies the paper \"Semantic Integrity Under Prompt Injection: A Game-Theoretic Analysis of Equilibria in Adversarial Natural Language Processing Systems\" published in IEEE Transactions on Information Forensics and Security.The dataset contains: (1) A comprehensive benchmark of 50 prompt injection attack types across four categories\u2014direct injection (15 types from TensorTrust), RAG poisoning (12 types from PoisonedRAG), separator\/delimiter exploits (13 types from Li et al.), and cascading agent attacks (10 types from InjecAgent)\u2014with 150 concrete attack instances; (2) Evaluation results from experiments across four LLM architectures (GPT-4o, Claude 3, LLaMA-3-70B, Mistral-7B) testing three defense mechanisms (Semantic Prompt Binding, Adaptive Risk Assessment, Randomized Token Embedding Shuffling); (3) Metrics including Attack Success Rate, Semantic Fidelity, defense overhead, and equilibrium satisfaction rates (SRE, ISE, CRE); (4) System prompts used for evaluation across 10 applic"

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Topic Modeling Security and Verification in Computing

Publication details

Journal / source
IEEE DataPort
Publication date
15 February 2026
Language
EN
Document type
Dataset