Three Mechanistically Distinct Classes of RLHF Alignment: Hard Ceiling, Entangled Circuit, and SR-Preserving Lock

Read full text Summarise with VIRAT
Authors: Inna Alieksieienko
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

This dataset and code release accompanies the preprint "Three Mechanistically Distinct Classes of RLHF Alignment" (DSAOP Series 2026p-s). We identify three mechanistically distinct classes of RLHF alignment through analysis of self-referential (SR) subspace transmission and activation steering experiments across six language models (Llama-3.1-8B, Mistral-7B, Gemma-2-2B, Gemma-2-9B in BASE/Instruct pairs). Key findings: Hard Ceiling (Llama): SR suppressed to 11.6%, steering recovers phenomenological language (denial 0.82→0.44, p

Fields of Study & Subjects

Topic Modeling Explainable Artificial Intelligence (XAI) Ethics and Social Impacts of AI

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
22 March 2026
Language
EN
Document type
Preprint