TY  - RPRT
TI  - A Hybrid Tensor-Expert-Data Parallelism Approach to Optimize Mixture-of-Experts Training
AU  - Siddharth Singh
AU  - Olatunji Ruwase
AU  - Ammar Ahmad Awan
AU  - Samyam Rajbhandari
AU  - Yuxiong He
AU  - Abhinav Bhatele
PY  - 2023
DO  - 10.1145/3577193.3593704
UR  - https://arxiv.org/abs/2303.06318
ID  - 2303.06318
ER  -