TY  - RPRT
TI  - Queue management for slo-oriented large language model serving
AU  - Archit Patke
AU  - Dhemath Reddy
AU  - Saurabh Jha
AU  - Haoran Qiu
AU  - Christian Pinto
AU  - Chandra Narayanaswami
AU  - Zbigniew Kalbarczyk
AU  - Ravishankar Iyer
PY  - 2025
DO  - 10.1145/3698038.369852
UR  - https://arxiv.org/abs/2407.00047
ID  - 2407.00047
ER  -