TY - RPRT TI - A Queueing Theoretic Perspective on Low-Latency LLM Inference with Variable Token Length AU - Yuqing Yang AU - Yuedong Xu AU - Lei Jiao PY - 2025 UR - https://arxiv.org/abs/2407.05347 ID - 2407.05347 ER -