TY  - RPRT
TI  - Early Weight Averaging meets High Learning Rates for LLM Pre-training
AU  - Sunny Sanyal
AU  - Atula Neerkaje
AU  - Jean Kaddour
AU  - Abhishek Kumar
AU  - Sujay Sanghavi
PY  - 2023
UR  - https://arxiv.org/abs/2306.03241
ID  - 2306.03241
ER  -