Geometric Parsimony: Inducing Logical Skeletons via Manifold Alignment in Tiny Language Models

Read full text
Authors: Zhongren Wang
Cited by: 0

Abstract

Recent studies on Qwen3-4B suggest that logical capabilities are concentrated in a "logical skeleton" comprising specific layers and singularities. This paper investigates whether such structures can be induced in tiny models (8 layers) under extreme data scarcity (500MB). By introducing Piecewise Constrained Manifolds (PCM), we demonstrate the emergence of a robust geometric skeleton. Our results show an intra-segment cosine similarity of 1.0000 and a deliberate structural collapse at rule boundaries (Sim: -0.9086). These findings validate the theory that logic is an emergent property of geometric parsimony rather than a mere byproduct of massive scaling.

Fields of Study & Subjects

Topic Modeling Explainable Artificial Intelligence (XAI) Domain Adaptation and Few-Shot Learning

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
2 February 2026
Document type
Preprint