TY  - RPRT
TI  - Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models
AU  - Bowen Pan
AU  - Yikang Shen
AU  - Haokun Liu
AU  - Mayank Mishra
AU  - Gaoyuan Zhang
AU  - Aude Oliva
AU  - Colin Raffel
AU  - Rameswar Panda
PY  - 2024
UR  - https://arxiv.org/abs/2404.05567
ID  - 2404.05567
ER  -