TY - RPRT TI - Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models AU - Frederik Kunstner AU - Robin Yadav AU - Alan Milligan AU - Mark Schmidt AU - Alberto Bietti PY - 2024 UR - https://arxiv.org/abs/2402.19449 ID - 2402.19449 ER -