Geometric Dynamics in Neural Architectures: The Integration of Hyperbolic Adaptive Kuramoto Oscillators into Large Language Models

Read full text
Authors: E. G. Reis
Cited by: 0

Abstract

This work presents H-AKORN (Hyperbolic Adaptive Kuramoto Oscillatory Representational Neurons), a fully specified architecture for hyperbolic-native Large Language Models (H-LLMs).The model addresses two fundamental limitations of conventional Euclidean neural architectures: the Geometric Capacity Bottleneck, which prevents faithful representation of hierarchical structures, and the Temporal Binding Problem, which limits dynamic feature grouping in static attention mechanisms. By embedding token representations in a Lorentz hyperbolic manifold, the architecture leverages exponential volume growth to naturally encode deep semantic hierarchies without over-squashing. Static dot-product attention is replaced by a dynamic phase-synchronization process, inspired by the Kuramoto model, where attention emerges from temporal coherence between oscillatory token states. The specification provides a complete mathematical formulation of the geometric substrate, H-AKORN dynamics, tangent-space feed-forward networks, Riemannian normalization, hybrid optimization strategies, and validation criteria.This work is intended as a reproducible, falsifiable foundation for future hyperbolic-native language models and geometric deep learning research.

Fields of Study & Subjects

Neural Networks and Applications Topic Modeling Neural dynamics and brain function

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
27 January 2026
Document type
Preprint