Topological Constraints for Coherent Language Models: Why Geometry Prevents Hallucination
Abstract
Hallucination in large language models arises from unconstrained latent dynamics. We show that toroidal attention masks with explicit spectral gaps bound semantic drift. Key results: • +19.5% relative improvement on TruthfulQA (14.44% → 17.26%) • Best HaluEval performance (52.60% vs 55.00% baseline) • 40% drift reduction on Tonnetz sequences Hierarchy: mHC (Birkhoff) ⊂ ERLHS (Hamiltonian) ⊂ Karmonic (Toroidal + Spectral) Code: https://github.com/Paraxiom/topological-coherence Demo: https://huggingface.co/spaces/paraxiom-research/topological-coherence Software DOI: 10.5281/zenodo.18187835
Fields of Study & Subjects
Topic Modeling
Adversarial Robustness in Machine Learning
Natural Language Processing Techniques
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 14 January 2026
- Document type
- Preprint