TY - RPRT TI - Ladder-residual: parallelism-aware architecture for accelerating large model inference with communication overlapping AU - Muru Zhang AU - Mayank Mishra AU - Zhongzhu Zhou AU - William Brandon AU - Jue Wang AU - Yoon Kim AU - Jonathan Ragan-Kelley AU - Shuaiwen Leon Song AU - Ben Athiwaratkun AU - Tri Dao PY - 2025 UR - https://arxiv.org/abs/2501.06589 ID - 2501.06589 ER -