TY  - RPRT
TI  - A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
AU  - Hao-Jun Michael Shi
AU  - Tsung-Hsien Lee
AU  - Shintaro Iwasaki
AU  - Jose Gallego-Posada
AU  - Zhijing Li
AU  - Kaushik Rangadurai
AU  - Dheevatsa Mudigere
AU  - Michael Rabbat
PY  - 2023
UR  - https://arxiv.org/abs/2309.06497
ID  - 2309.06497
ER  -