TY  - RPRT
TI  - How to set AdamW's weight decay as you scale model and dataset size
AU  - Xi Wang
AU  - Laurence Aitchison
PY  - 2025
UR  - https://arxiv.org/abs/2405.13698
ID  - 2405.13698
ER  -