TY  - RPRT
TI  - BATON: Enhancing Batch-wise Inference Efficiency for Large Language Models via Dynamic Re-batching
AU  - Peizhuang Cong
AU  - Qizhi Chen
AU  - Haochen Zhao
AU  - Tong Yang
PY  - 2024
UR  - https://arxiv.org/abs/2410.18701
ID  - 2410.18701
ER  -