TY  - RPRT
TI  - Fast Distributed Inference Serving for Large Language Models
AU  - Bingyang Wu
AU  - Yinmin Zhong
AU  - Zili Zhang
AU  - Shengyu Liu
AU  - Fangyue Liu
AU  - Yuanhang Sun
AU  - Gang Huang
AU  - Xuanzhe Liu
AU  - Xin Jin
PY  - 2024
UR  - https://arxiv.org/abs/2305.05920
ID  - 2305.05920
ER  -