TY  - RPRT
TI  - Beyond Sunk Costs: Boosting LLM Pre-training Efficiency via Orthogonal Growth of Mixture-of-Experts
AU  - Ruizhe Wang
AU  - Yucheng Ding
AU  - Xiao Liu
AU  - Yaoxiang Wang
AU  - Peng Cheng
AU  - Baining Guo
AU  - Zhengjun Zha
AU  - Yeyun Gong
PY  - 2026
UR  - https://arxiv.org/abs/2510.08008
ID  - 2510.08008
ER  -