HIDEKI-SQ/cot-reliability-gating: v3.0.0 - Initial Public Release

Read full text
Authors: HIDEKI
Cited by: 0

Abstract

Initial Public Release Overview 24 final experiments with 64,004 trials 4 history experiments (7,192 trials) preserved for transparency Complete reproducibility: all notebooks, data, and results included Key Findings Consumer model determines vulnerability to misleading cues Corruption increases cue reliance (GPT-4o: 0.5% → 8.5%) Semantic corruption (especially quantity shifts) most effective Simple verification prompts eliminate vulnerability (12% → 0%) Models Tested Claude Sonnet 4 (claude-sonnet-4-20250514) GPT-4o Contents experiments/ - Final experiment results history/ - Superseded experiments (transparency) notebook/ - 29 Jupyter notebooks data/ - Shared datasets and traces figures/ - Paper figures Documentation EXPERIMENT_INDEX.md - Complete experiment catalog CHANGELOG.md - Version history docs/REPRODUCIBILITY.md - Reproduction guide

Fields of Study & Subjects

Adversarial Robustness in Machine Learning Topic Modeling Natural Language Processing Techniques

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
10 January 2026