TY - RPRT TI - Where to Begin: Efficient Pretraining via Subnetwork Selection and Distillation AU - Arjun Krishnakumar AU - Rhea Sanjay Sukthanker AU - Hannan Javed Mahadik AU - Gabriela Kadlecová AU - Vladyslav Moroshan AU - Timur Carstensen AU - Frank Hutter AU - Aaron Klein PY - 2026 UR - https://arxiv.org/abs/2510.07227 ID - 2510.07227 ER -