TY - RPRT TI - LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization AU - Juntao Zhao AU - Borui Wan AU - Yanghua Peng AU - Haibin Lin AU - Chuan Wu PY - 2024 UR - https://arxiv.org/abs/2403.01136 ID - 2403.01136 ER -