TY - RPRT TI - DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale AU - Samyam Rajbhandari AU - Conglong Li AU - Zhewei Yao AU - Minjia Zhang AU - Reza Yazdani Aminabadi AU - Ammar Ahmad Awan AU - Jeff Rasley AU - Yuxiong He PY - 2022 UR - https://arxiv.org/abs/2201.05596 ID - 2201.05596 ER -