TY - RPRT TI - Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers AU - Gavia Gray AU - Aman Tiwari AU - Shane Bergsma AU - Joel Hestness PY - 2024 UR - https://arxiv.org/abs/2411.00999 ID - 2411.00999 ER -