A Falsifiable, Anti-Goodhart Protocol for Testing Internal Objective Channels in Reinforcement Learning Agents (AILab-aligned reference implementation)

Read full text
Authors: Karel Hrubec
Cited by: 0

Abstract

This release provides a falsifiable, Anti-Goodhart evaluation protocol (“AILab”) for testing functional/autonomous intentionality claims in RL agents, together with a minimal baseline implementation and controlled ablations. The key contribution is methodological: we show how seemingly strong proxy improvements can arise without corresponding evidence of deeper, invariant structure. Across multiple controlled runs (including an explicit no-probe negative control, an alpha sweep, and T3 threshold / gate-ablation sweeps), the protocol’s gates (invariance/CCA, self-causal drop, and intervention persistence) prevent “illusion wins” and expose sensitivity to decision thresholds. In the present setup, the results do not support an ONTO-CORE / ontologically structured agent claim; instead, they document reproducible failure modes and provide a clean template for future redesigns (e.g., environments without information leakage). This Zenodo record includes: the PDF paper (protocol + baseline + controls + failure modes), an Overleaf-ready LaTeX ZIP, supporting run artifacts (decision.json summaries and bundles) enabling replication of the reported tables and verdicts. Recommended citation: use the Zenodo DOI of this record. Keywords: Anti-Goodhart, falsifiable evaluation, reinforcement learning, intentionality, invariance, causal interventions, reproducibility.

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Formal Methods in Verification Reinforcement Learning in Robotics

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
3 January 2026
Document type
Preprint