TY - RPRT TI - MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AU - Zhitian Xie AU - Yinger Zhang AU - Chenyi Zhuang AU - Qitao Shi AU - Zhining Liu AU - Jinjie Gu AU - Guannan Zhang PY - 2024 UR - https://arxiv.org/abs/2402.00893 ID - 2402.00893 ER -