TY - RPRT TI - Strong Teacher Not Needed? On Distillation in LLM Pretraining AU - Taiming Lu AU - Zhuang Liu PY - 2026 UR - https://arxiv.org/abs/2605.23857 ID - 2605.23857 ER -