TY  - RPRT
TI  - BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching
AU  - Zhen Zheng
AU  - Xin Ji
AU  - Taosong Fang
AU  - Fanghao Zhou
AU  - Chuanjie Liu
AU  - Gang Peng
PY  - 2026
UR  - https://arxiv.org/abs/2412.03594
ID  - 2412.03594
ER  -