TY - RPRT TI - Demystifying Synthetic Data in LLM Pre-training: A Systematic Study of Scaling Laws, Benefits, and Pitfalls AU - Feiyang Kang AU - Newsha Ardalani AU - Michael Kuchnik AU - Youssef Emad AU - Mostafa Elhoushi AU - Shubhabrata Sengupta AU - Shang-Wen Li AU - Ramya Raghavendra AU - Ruoxi Jia AU - Carole-Jean Wu PY - 2025 UR - https://arxiv.org/abs/2510.01631 ID - 2510.01631 ER -