TY - RPRT TI - Demystifying the Communication Characteristics for Distributed Transformer Models AU - Quentin Anthony AU - Benjamin Michalowicz AU - Jacob Hatef AU - Lang Xu AU - Mustafa Abduljabbar AU - Aamir Shafi AU - Hari Subramoni AU - Dhabaleswar Panda PY - 2024 UR - https://arxiv.org/abs/2408.10197 ID - 2408.10197 ER -