TY - RPRT TI - Improving the Downstream Performance of Mixture-of-Experts Transformers via Weak Vanilla Transformers AU - Xin Lu AU - Yanyan Zhao AU - Bing Qin AU - Ting Liu PY - 2025 UR - https://arxiv.org/abs/2403.01994 ID - 2403.01994 ER -