Geometric Parsimony: Inducing Logical Skeletons via Manifold Alignment in Tiny Language Models
Abstract
Recent studies on Qwen3-4B suggest that logical capabilities are concentrated in a "logical skeleton" comprising specific layers and singularities. This paper investigates whether such structures can be induced in tiny models (8 layers) under extreme data scarcity (500MB). By introducing Piecewise Constrained Manifolds (PCM), we demonstrate the emergence of a robust geometric skeleton. Our results show an intra-segment cosine similarity of 1.0000 and a deliberate structural collapse at rule boundaries (Sim: -0.9086). These findings validate the theory that logic is an emergent property of geometric parsimony rather than a mere byproduct of massive scaling.
Fields of Study & Subjects
Topic Modeling
Explainable Artificial Intelligence (XAI)
Domain Adaptation and Few-Shot Learning
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 2 February 2026
- Document type
- Preprint