Clause AI-2: The Gradient Starvation Envelope for Sparse MoE Training Dynamics

Read full text
Authors: Ryan Fields
Cited by: 0

Abstract

Executive Summary: This technical specification defines the Gradient Starvation Envelope (Eq. 114.1), a formal compliance primitive designed to stabilize the training of Sparse Mixture-of-Experts (MoE) architectures.Technical Scope: The framework utilizes a Lyapunov-style differential inequality on per-expert gradient variance to eliminate "routing collapse" and "dead experts" while ensuring training health. It provides the mathematical bridge between high-performance MoE dynamics and enterprise AI governance requirements, such as EU AI Act Article 11/53 and NIST AI 600-1.

Fields of Study & Subjects

Advanced Neural Network Applications Domain Adaptation and Few-Shot Learning Stochastic Gradient Optimization Techniques

Publication details

Journal / source
Figshare
Publication date
1 January 2026
Document type
Preprint