TY - RPRT TI - Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective AU - Kaiyue Wen AU - Zhiyuan Li AU - Jason Wang AU - David Hall AU - Percy Liang AU - Tengyu Ma PY - 2024 UR - https://arxiv.org/abs/2410.05192 ID - 2410.05192 ER -