TY - RPRT TI - Modern Distributed Data-Parallel Large-Scale Pre-training Strategies For NLP models AU - Hao Bai PY - 2022 UR - https://arxiv.org/abs/2206.06356 ID - 2206.06356 ER -