TY  - RPRT
TI  - Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve
AU  - Amey Agrawal
AU  - Nitin Kedia
AU  - Ashish Panwar
AU  - Jayashree Mohan
AU  - Nipun Kwatra
AU  - Bhargav S. Gulavani
AU  - Alexey Tumanov
AU  - Ramachandran Ramjee
PY  - 2024
UR  - https://arxiv.org/abs/2403.02310
ID  - 2403.02310
ER  -