"PromptGame Dataset: Prompt Injection Attack Benchmark and Defense Evaluation Data"
Abstract
"This dataset accompanies the paper \"Semantic Integrity Under Prompt Injection: A Game-Theoretic Analysis of Equilibria in Adversarial Natural Language Processing Systems\" published in IEEE Transactions on Information Forensics and Security.The dataset contains: (1) A comprehensive benchmark of 50 prompt injection attack types across four categories\u2014direct injection (15 types from TensorTrust), RAG poisoning (12 types from PoisonedRAG), separator\/delimiter exploits (13 types from Li et al.), and cascading agent attacks (10 types from InjecAgent)\u2014with 150 concrete attack instances; (2) Evaluation results from experiments across four LLM architectures (GPT-4o, Claude 3, LLaMA-3-70B, Mistral-7B) testing three defense mechanisms (Semantic Prompt Binding, Adaptive Risk Assessment, Randomized Token Embedding Shuffling); (3) Metrics including Attack Success Rate, Semantic Fidelity, defense overhead, and equilibrium satisfaction rates (SRE, ISE, CRE); (4) System prompts used for evaluation across 10 applic"
Fields of Study & Subjects
Adversarial Robustness in Machine Learning
Topic Modeling
Security and Verification in Computing
Publication details
- Journal / source
- IEEE DataPort
- Publication date
- 15 February 2026
- Language
- EN
- Document type
- Dataset