TY - RPRT TI - Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs AU - Shane Bergsma AU - Nolan Dey AU - Gurpreet Gosal AU - Gavia Gray AU - Daria Soboleva AU - Joel Hestness PY - 2025 UR - https://arxiv.org/abs/2502.15938 ID - 2502.15938 ER -