TY - RPRT TI - Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers AU - Tianlong Chen AU - Zhenyu Zhang AU - Ajay Jaiswal AU - Shiwei Liu AU - Zhangyang Wang PY - 2023 UR - https://arxiv.org/abs/2303.01610 ID - 2303.01610 ER -