TY - RPRT TI - A 4D Hybrid Algorithm to Scale Parallel Training to Thousands of GPUs AU - Siddharth Singh AU - Prajwal Singhania AU - Aditya K. Ranjan AU - Zack Sating AU - Abhinav Bhatele PY - 2024 UR - https://arxiv.org/abs/2305.13525 ID - 2305.13525 ER -