TY  - RPRT
TI  - A Study on Hidden Layer Distillation for Large Language Model Pre-Training
AU  - Maxime Guigon
AU  - Lucas Dixon
AU  - Michaël E. Sander
PY  - 2026
UR  - https://arxiv.org/abs/2605.11513
ID  - 2605.11513
ER  -