Resonant Sparse Geometry Networks

Read full text
Authors: Hasi Hays
Cited by: 0

Abstract

We introduce Resonant Sparse Geometry Networks (RSGN), a brain-inspired architecture with self-organizing sparse hierarchical input-dependent connectivity. Unlike Transformer architectures that employ dense attention mechanisms with O(n^2) computational complexity, RSGN embeds computational nodes in learned hyperbolic space where connection strength decays with geodesic distance, achieving dynamic sparsity that adapts to each input. The architecture operates on two distinct timescales: fast differentiable activation propagation optimized through gradient descent, and slow Hebbian-inspired structural learning for connectivity adaptation through local correlation rules. We provide rigorous mathematical analysis demonstrating that RSGN achieves O(n*k) computational complexity, where k

Fields of Study & Subjects

Neural Networks and Applications Advanced Neural Network Applications Topic Modeling

Publication details

Journal / source
arXiv (Cornell University)
Publication date
26 January 2026
Document type
Preprint