TY - RPRT TI - Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism AU - Xupeng Miao AU - Yujie Wang AU - Youhe Jiang AU - Chunan Shi AU - Xiaonan Nie AU - Hailin Zhang AU - Bin Cui PY - 2022 DO - 10.14778/3570690.3570697 UR - https://arxiv.org/abs/2211.13878 ID - 2211.13878 ER -