TY - RPRT TI - Prediction Is All MoE Needs: Expert Load Distribution Goes from Fluctuating to Stabilizing AU - Peizhuang Cong AU - Aomufei Yuan AU - Shimao Chen AU - Yuxuan Tian AU - Bowen Ye AU - Tong Yang PY - 2024 UR - https://arxiv.org/abs/2404.16914 ID - 2404.16914 ER -