TY  - RPRT
TI  - Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data
AU  - Xu Guo
AU  - Runyu Peng
AU  - Jian Tong
AU  - Yunhua Zhou
AU  - Haijun Lv
AU  - Zhihui Lu
AU  - Qipeng Guo
PY  - 2026
UR  - https://arxiv.org/abs/2605.10129
ID  - 2605.10129
ER  -