Axiomatic Necessity and External Structural Support in Machine Learning Systems
Abstract
Every coherent machine learning system necessarily depends on external structural elements—inductive biases, architectural priors, and optimization constraints—that cannot be derived from data alone. We formalize this dependence through the Theorem of Axiomatic Necessity (TNA), proving that "purely data-driven" systems are structurally impossible and lead to functional incoherence. The TNA reframes generalization not as an emergent statistical miracle, but as the consequence of unavoidable external axioms (aleph_1). By analyzing phenomena such as implicit bias in SGD and the double descent curve, we demonstrate that model stability beyond the interpolation threshold is sustained by these latent structural supports rather than data volume. Our results mandate a shift from the myth of ontological completeness toward "Structural Honesty," where the external axioms required for coherence are explicitly acknowledged and localized. We provide empirical validation showing that without minimal axiomatic support (F_{min}), learning collapses into stochastic noise, regardless of model scale. Short video https://vimeo.com/1158255232?share=copy&fl=sv&fe=ci
Fields of Study & Subjects
Machine Learning and Algorithms
Stochastic Gradient Optimization Techniques
Domain Adaptation and Few-Shot Learning
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 26 January 2026