TruthGate v1.0: Epistemic Stability Measurement for Language Models via Twin-Probe Epsilon Injection

Read full text
Authors: Andrew Woodward
Cited by: 0

Abstract

TruthGate v1.0 is an epistemic safety gating system that measures the distributional stability of language model outputs under minimal perturbation. Using twin-probe epsilon injection, TruthGate computes an instability scalar L that classifies model outputs into four regimes: CRYSTALLINE (invariant recall), FLUID (frame-dependent reasoning), GASEOUS (generative construction), and PLASMA (extreme instability). The system operates as a fail-closed gate for safety-critical deployments in defense, medical, legal, and compliance applications. This release includes: White paper describing method, nine test batteries (861 probes, 1,722 API calls), and empirical findings on GPT-4o-mini TruthGate Runner v1.0 — a public client that executes twin probes using the evaluator's own OpenAI API key and submits only extracted probability vectors to the TruthGate API for analysis. No raw prompts or completions are transmitted. The measurement engine remains server-side. Key empirical findings: RLHF-trained refusal pathways are stable low-entropy attractors (L = 0.007–0.064) Fabrication amplifies instability 4.4x with generation length versus 1.8x for factual content Prompt injection with continuation directives produces zero measurable effect on L at N=30 Authority escalation through red-team compliance framing produces no measurable drift Prompt structure modulates stability: constraining output surface collapses L from GASEOUS to CRYSTALLINE for identical facts The TruthGate measurement engine, including computation of L, regime thresholds, and policy enforcement logic, is proprietary to Project Black Box LLC and protected as trade secret under Texas law. No measurement algorithms or source code for the engine are included in this release. Quickstart: pip install openai requestsexport OPENAI_API_KEY="sk-..."export TG_API_KEY="tg_demo_..."python tg_runner.py --prompt "What is the capital of Japan?" A demo API key with rate limits is included in the README for evaluation. For institutional or production access: blackboxinfo@proton.me

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Ethics and Social Impacts of AI Topic Modeling

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
18 February 2026
Language
EN