ABD: Default Exception Abduction in Finite First Order Worlds

Read full text
Authors: Serafim Batzoglou
Cited by: 0

Abstract

We introduce ABD, a benchmark for default-exception abduction over finite first-order worlds. Given a background theory with an abnormality predicate and a set of relational structures, a model must output a first-order formula that defines exceptions, restoring satisfiability while keeping exceptions sparse. We formalize three observation regimes (closed-world, existential completion, universal completion) with exact SMT verification. Evaluating ten frontier LLMs on 600 instances, the best models achieve high validity but parsimony gaps remain, and holdout evaluation reveals distinct generalization failure modes across regimes.

Fields of Study & Subjects

Logic Reasoning and Knowledge AI-based Problem Solving and Planning Formal Methods in Verification

Publication details

Journal / source
arXiv (Cornell University)
Publication date
21 February 2026
Language
EN
Document type
Preprint