TY - RPRT TI - Sparse Mixture-of-Experts for Compositional Generalization: Empirical Evidence and Theoretical Foundations of Optimal Sparsity AU - Jinze Zhao AU - Peihao Wang AU - Junjie Yang AU - Ruisi Cai AU - Gaowen Liu AU - Jayanth Srinivasa AU - Ramana Rao Kompella AU - Yingbin Liang AU - Zhangyang Wang PY - 2025 UR - https://arxiv.org/abs/2410.13964 ID - 2410.13964 ER -