buk81/uniformity-asymmetry: v4.0 — Paper 4: Alignment Robustness

Read full text
Authors: buk81
Cited by: 0

Abstract

Paper 4: Alignment Robustness Depends More on Training than Architecture DOI: 10.5281/zenodo.18316488 A systematic cross-vendor study examining how preference optimization (RLHF/DPO) affects attention head specialization across 8 vendor families and 25+ model variants. Key Findings | Finding | Evidence | |---------|----------| | SI Reduction Pattern | RLHF/DPO reduces SI in unprotected architectures | | SWA Protection | Sliding Window Attention correlates with SI preservation | | GQA Noise Sensitivity | ~5,800× higher PPL-slope than MHA | | Synthetic Immunity | Phi SI ≈ 0.33 across 10.8× scale | | Training Override | Qwen2 shows no recursive degradation | Robustness Hierarchy: Training Methodology > SWA > Architecture > Scale Reproducibility Package 19 A-Tier Notebooks organized by claim (A1-A5) 27 JSON Result Files with standardized schema claims.yaml — Machine-readable claim mapping verify_release.py — Package integrity checker reproduce.py — CLI reproduction tool Quick Start cd paper4 python verify_release.py 📄 Full Paper (PDF)

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
20 January 2026