TY - RPRT TI - MoEfication: Transformer Feed-forward Layers are Mixtures of Experts AU - Zhengyan Zhang AU - Yankai Lin AU - Zhiyuan Liu AU - Peng Li AU - Maosong Sun AU - Jie Zhou PY - 2022 UR - https://arxiv.org/abs/2110.01786 ID - 2110.01786 ER -