TY  - RPRT
TI  - Multi-Bin Batching for Increasing LLM Inference Throughput
AU  - Ozgur Guldogan
AU  - Jackson Kunde
AU  - Kangwook Lee
AU  - Ramtin Pedarsani
PY  - 2026
UR  - https://arxiv.org/abs/2412.04504
ID  - 2412.04504
ER  -