TY  - RPRT
TI  - Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
AU  - Samira Abnar
AU  - Harshay Shah
AU  - Dan Busbridge
AU  - Alaaeldin Mohamed Elnouby Ali
AU  - Josh Susskind
AU  - Vimal Thilak
PY  - 2025
UR  - https://arxiv.org/abs/2501.12370
ID  - 2501.12370
ER  -