TY - RPRT TI - On the Efficacy of Eviction Policy for Key-Value Constrained Generative Language Model Inference AU - Siyu Ren AU - Kenny Q. Zhu PY - 2024 UR - https://arxiv.org/abs/2402.06262 ID - 2402.06262 ER -