TY - RPRT TI - DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving AU - Yinmin Zhong AU - Shengyu Liu AU - Junda Chen AU - Jianbo Hu AU - Yibo Zhu AU - Xuanzhe Liu AU - Xin Jin AU - Hao Zhang PY - 2024 UR - https://arxiv.org/abs/2401.09670 ID - 2401.09670 ER -