TY  - RPRT
TI  - Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training
AU  - Zexuan Zhong
AU  - Mengzhou Xia
AU  - Danqi Chen
AU  - Mike Lewis
PY  - 2024
UR  - https://arxiv.org/abs/2405.03133
ID  - 2405.03133
ER  -