PRR-1: Provenance Retention Rate — Benchmark Specification (Draft Working Specification v0.1)

Read full text
Authors: Neil Clive Tuckwell
Cited by: 2
References: 5

Abstract

PRR-1 proposes a draft benchmark protocol for measuring provenance retention across inference chains in generative reasoning systems. The specification operationalises a central claim of the companion framework paper, Provenance Collapse: Why Hallucination Is a Metadata Failure, Not Merely a Generation Failure (Zenodo, 2026), namely that generative systems fail not only by producing incorrect outputs, but by losing track of the epistemic status of claims as reasoning depth increases. The benchmark introduces a six-state provenance ontology (VERIFIED, INFERRED, SPECULATIVE, ANALOGICAL, WITHDRAWN, UNKNOWN), explicit state-transition rules, perturbation methodologies, annotator agreement protocols, and two primary metrics: Provenance Retention Rate (PRR) and Provenance Validity Accuracy (PVA). The specification also defines invalidation conditions under which the benchmark itself should be considered insufficient. PRR-1 is not an empirical benchmark result and does not claim validation. Annotation reliability, ontology completeness, metric sensitivity, realistic-task transfer, and provenance coherence under revision remain open problems requiring external review and implementation testing. The document is intended as a technical-note companion to the broader Provenance Collapse framework and as a reproducible starting point for experimental evaluation of provenance-aware reasoning architectures. Keywords: provenancehallucinationbenchmarkgenerative AIreasoning systemsepistemic trackingmetadata integrityLLM evaluationannotation reliabilityinference chainsprovenance collapsebenchmark protocolAI safetyreasoning benchmarksepistemic provenance

Fields of Study & Subjects

Scientific Computing and Data Management Research Data Management Practices Biomedical Text Mining and Ontologies

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
7 May 2026
Document type
Preprint