TY  - RPRT
TI  - Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization
AU  - Taishi Nakamura
AU  - Takuya Akiba
AU  - Kazuki Fujii
AU  - Yusuke Oda
AU  - Rio Yokota
AU  - Jun Suzuki
PY  - 2025
UR  - https://arxiv.org/abs/2502.19261
ID  - 2502.19261
ER  -