TY  - RPRT
TI  - Pre-training Distillation for Large Language Models: A Design Space Exploration
AU  - Hao Peng
AU  - Xin Lv
AU  - Yushi Bai
AU  - Zijun Yao
AU  - Jiajie Zhang
AU  - Lei Hou
AU  - Juanzi Li
PY  - 2024
UR  - https://arxiv.org/abs/2410.16215
ID  - 2410.16215
ER  -