TY - RPRT TI - Saving GPU Hours in LLM Inference System Development and Online Workloads with Simulation and DBMS-Inspired Cache Replacement Policies AU - Kyoungmin Kim AU - Jiacheng Li AU - Kijae Hong AU - Qunyou Liu AU - Darong Huang AU - Anastasia Ailamaki PY - 2026 UR - https://arxiv.org/abs/2411.07447 ID - 2411.07447 ER -