LDV-LoRA: Direct Weight-Space Logic Grafting via Logical Difference Vectors

Read full text
Authors: Zhongren Wang
Cited by: 0

Abstract

Traditional alignment of large language models (LLMs) relies on backpropagation-based fine-tuning, which is computationally expensive and often yields superficial behavioral shifts. Here we introduce LDV-LoRA, a gradient-free intervention protocol that identifies a Logical Difference Vector (LDV) from latent space and directly grafts it into static weights via low-rank adaptation. Targeting the “logical phase-transition” layer (Layer 23), we achieve permanent installation of rigorous reasoning instincts. Despite an extreme L2-norm perturbation of 68.75%, structural stability is preserved, and the model transitions from probabilistic mimicry to deterministic algebraic derivation—demonstrating that logic can be surgically inscribed into weight space.

Fields of Study & Subjects

Domain Adaptation and Few-Shot Learning Topic Modeling Natural Language Processing Techniques

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
12 January 2026
Document type
Preprint