TY  - RPRT
TI  - LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training
AU  - Tong Zhu
AU  - Xiaoye Qu
AU  - Daize Dong
AU  - Jiacheng Ruan
AU  - Jingqi Tong
AU  - Conghui He
AU  - Yu Cheng
PY  - 2024
UR  - https://arxiv.org/abs/2406.16554
ID  - 2406.16554
ER  -