TY - RPRT TI - Astrolabe: Balancing Load in LLM Serving with Randomized Prediction-Guided Scheduling AU - Wei Da AU - Evangelia Kalyvianaki PY - 2026 DO - 10.1145/3793230.3837768 UR - https://arxiv.org/abs/2508.03611 ID - 2508.03611 ER -