TY  - RPRT
TI  - Dense vs Sparse Pretraining at Tiny Scale: Active-Parameter vs Total-Parameter Matching
AU  - Abdalrahman Wael
PY  - 2026
UR  - https://arxiv.org/abs/2605.13769
ID  - 2605.13769
ER  -