TY  - RPRT
TI  - Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging
AU  - Pierre Ablin
AU  - Angelos Katharopoulos
AU  - Skyler Seto
AU  - David Grangier
PY  - 2025
UR  - https://arxiv.org/abs/2502.01804
ID  - 2502.01804
ER  -