TY - RPRT TI - Why Warmup the Learning Rate? Underlying Mechanisms and Improvements AU - Dayal Singh Kalra AU - Maissam Barkeshli PY - 2024 UR - https://arxiv.org/abs/2406.09405 ID - 2406.09405 ER -