Attractor Networks via Constraint-Induced Concentration in High-Dimensional Function Spaces
Abstract
We present AttractorNet, a neural architecture that enforces global geometric constraintsthrough exact projection onto structured manifolds in function space. Unlike soft regularization,constraints are satisfied at every forward pass, inducing concentration of representations aroundlow-complexity attractor sets. We analyze the geometric mechanism underlying this concen-tration, establish equivariance under orthogonal transformations, and show that constrainedattention leads to interpretable mode selection. Minimal experiments demonstrate improvedstability and sample efficiency relative to unconstrained baselines.
Fields of Study & Subjects
Neural Networks and Applications
Model Reduction and Neural Networks
Advanced Neural Network Applications
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 8 February 2026
- Document type
- Preprint