Integrating the Monster Group and Leech Lattice into Transformers: Monster Leech Lila

Read full text
Authors: A. Kornienko
Cited by: 0

Abstract

We introduce Monster Leech Lila, a Transformer architecture that incorporates the 24-dimensional Leech lattice Λ24 and its connection to the Monster group M through monstrous moonshine. The model uses a fixed orthogonal kernel built from the Leech lattice to project queries and keys, and a learnable resonance based on the fine-structure constant α = 1/137. Additionally, we propose a “Monster resonance detector” that monitors the singular value spectrum of hidden states for signs of alignment with the 196883-dimensional irreducible representation of the Monster group. This work extends the geometric attention framework (E8, Leech) by adding a direct link to the largest sporadic simple group, potentially unlocking unprecedented compression and reasoning capabilities in small language models. We present the mathematical construction, architectural details, and discuss the expected behavior.

Fields of Study & Subjects

Topic Modeling Neural Networks and Applications Advanced Neural Network Applications

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
6 March 2026
Language
EN
Document type
Preprint