A Theoretical Framework for Auxiliary-Loss-Free Load Balancing of Sparse Mixture-of-Experts in Large-Scale AI Models

SSRN Electronic Journal 2026 Preprint Open access

Read full text

Authors: Xiaoqing Han, Yuan Zhong

DOI: 10.2139/ssrn.6641342

Cited by: 0

Fields of Study & Subjects

Mobile Crowdsensing and Crowdsourcing Stochastic Gradient Optimization Techniques Advanced Bandit Algorithms Research