Fact2Fiction: Targeted Poisoning Attack to Agentic Fact-checking System

Read full text
Authors: Association for Artificial Intelligence 2026, Bin Benjamin Zhu, Reynold Cheng, Haorui He, Francis Lau, Yupeng Li, Dacheng Wen
Cited by: 0

Abstract

State-of-the-art fact-checking systems combat misinformation at scale by employing autonomous LLM-based agents to decompose complex claims into smaller sub-claims, verify each sub-claim individually, and aggregate the partial results to produce verdicts with justifications (explanatory rationales for the verdicts). The security of these systems is crucial, as compromised fact-checkers, which tend to be easily underexplored, can amplify misinformation. This work introduces Fact2Fiction, the first poisoning attack framework targeting such agentic fact-checking systems. Fact2Fiction mirrors the decomposition strategy and exploits system-generated justifications to craft tailored malicious evidences that compromise sub-claim verification. Extensive experiments demonstrate that Fact2Fiction achieves 8.9\%--21.2\% higher attack success rates than state-of-the-art attacks across various poisoning budgets. Fact2Fiction exposes security weaknesses in current fact-checking systems and highlights the need for defensive countermeasures.

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Misinformation and Its Impacts Spam and Phishing Detection

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN