TY  - RPRT
TI  - Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be
AU  - Frederik Kunstner
AU  - Jacques Chen
AU  - Jonathan Wilder Lavington
AU  - Mark Schmidt
PY  - 2023
UR  - https://arxiv.org/abs/2304.13960
ID  - 2304.13960
ER  -