Benchmarks-as-Contracts: A ReceiptBench Spec Template for Regimes and Closure

Read full text
Authors: Rogério Figurelli
Cited by: 0

Abstract

Benchmarks for tool-using agents are converging away from pooled scalar scores and toward regime-explicit evaluation: admissible evidence, checkable closure, and verifier-bounded verification budgets. Our prior work argued this shift is best understood as operational confirmation of Large Language Fields (LLFs): a field-level contract layer above models where meaning, evidence, and “done” are governed by reusable, versioned rules. ReceiptBench made this convergence executable by replacing single scores with typed receipts — minimal, time-scoped claims emitted by evaluators/verifiers — so that scores become explicit policy projections over receipt-space. This paper introduces a practical missing layer: a specification template that turns any benchmark into a contract artifact Π_b with declared admissibility, budgets, and closure predicates, and with mandatory receiptboard reporting that preserves subfield heterogeneity. We further show that a benchmark spec template is naturally a Metafield: a design-time contract family that instantiates benchmark contracts across tasks and domains while enforcing migration semantics to prevent silent semantic drift. The result is governance-ready evaluation: “done” becomes auditable, tail risk becomes visible through worst-subfield and closure-integrity signals, and benchmark comparability becomes a property of declared regimes rather than of leaderboard folklore.

Fields of Study & Subjects

Ethics and Social Impacts of AI Scientific Computing and Data Management Topic Modeling

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
17 February 2026
Language
EN
Document type
Preprint