TY - RPRT TI - DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts AU - Yuchen Feng AU - Bowen Shen AU - Naibin Gu AU - Jiaxuan Zhao AU - Peng Fu AU - Zheng Lin AU - Weiping Wang PY - 2025 UR - https://arxiv.org/abs/2506.09351 ID - 2506.09351 ER -