TY - RPRT TI - Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training AU - Shane Bergsma AU - Nolan Dey AU - Gurpreet Gosal AU - Gavia Gray AU - Daria Soboleva AU - Joel Hestness PY - 2025 UR - https://arxiv.org/abs/2505.13738 ID - 2505.13738 ER -