TY - RPRT TI - Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization AU - Mohammad Samragh AU - Iman Mirzadeh AU - Keivan Alizadeh Vahid AU - Fartash Faghri AU - Minsik Cho AU - Moin Nabi AU - Devang Naik AU - Mehrdad Farajtabar PY - 2024 UR - https://arxiv.org/abs/2409.12903 ID - 2409.12903 ER -