TY - RPRT TI - Merak: An Efficient Distributed DNN Training Framework with Automated 3D Parallelism for Giant Foundation Models AU - Zhiquan Lai AU - Shengwei Li AU - Xudong Tang AU - Keshi Ge AU - Weijie Liu AU - Yabo Duan AU - Linbo Qiao AU - Dongsheng Li PY - 2023 DO - 10.1109/tpds.2023.3247001 UR - https://arxiv.org/abs/2206.04959 ID - 2206.04959 ER -