The Geometric Origin of Logic: Weight Polarization and Manifold Collapse

Read full text
Authors: Zhongren Wang
Cited by: 0

Abstract

This study explores the emergence of logical extrapolation in neural networks. By introducing a Variable Geometric Tension (VGT) framework, we demonstrate that forcing hidden representations into a low-dimensional manifold via L2-norm pressure (Geometric Collapse) enables a Transformer model to transcend statistical pattern matching. Our VGT-Pro model achieves 99.0% accuracy on 20-digit addition while only being trained on 1-6 digits, suggesting that logic is a geometric necessity squeezed out of representational redundancy.

Fields of Study & Subjects

Neural Networks and Applications Advanced Neural Network Applications Topic Modeling

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
19 January 2026
Document type
Preprint