Resonant Sparse Geometry Networks
Abstract
We introduce Resonant Sparse Geometry Networks (RSGN), a brain-inspired architecture with self-organizing sparse hierarchical input-dependent connectivity. Unlike Transformer architectures that employ dense attention mechanisms with O(n^2) computational complexity, RSGN embeds computational nodes in learned hyperbolic space where connection strength decays with geodesic distance, achieving dynamic sparsity that adapts to each input. The architecture operates on two distinct timescales: fast differentiable activation propagation optimized through gradient descent, and slow Hebbian-inspired structural learning for connectivity adaptation through local correlation rules. We provide rigorous mathematical analysis demonstrating that RSGN achieves O(n*k) computational complexity, where k
Fields of Study & Subjects
Neural Networks and Applications
Advanced Neural Network Applications
Topic Modeling
Publication details
- Journal / source
- arXiv (Cornell University)
- Publication date
- 26 January 2026
- Document type
- Preprint