TY  - RPRT
TI  - Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy
AU  - Pingzhi Li
AU  - Zhenyu Zhang
AU  - Prateek Yadav
AU  - Yi-Lin Sung
AU  - Yu Cheng
AU  - Mohit Bansal
AU  - Tianlong Chen
PY  - 2024
UR  - https://arxiv.org/abs/2310.01334
ID  - 2310.01334
ER  -