TY  - RPRT
TI  - An Empirical Study on Noisy Data and LLM Pretraining Loss Divergence
AU  - Qizhen Zhang
AU  - Ankush Garg
AU  - Jakob Foerster
AU  - Niladri Chatterji
AU  - Kshitiz Malik
AU  - Mike Lewis
PY  - 2026
UR  - https://arxiv.org/abs/2602.02400
ID  - 2602.02400
ER  -