TY  - RPRT
TI  - Batch-Max: Higher LLM Throughput using Larger Batch Sizes and KV Cache Compression
AU  - Michael R. Metel
AU  - Boxing Chen
AU  - Mehdi Rezagholizadeh
PY  - 2025
UR  - https://arxiv.org/abs/2412.05693
ID  - 2412.05693
ER  -