TY - RPRT TI - Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference AU - Yuan Feng AU - Junlin Lv AU - Yukun Cao AU - Xike Xie AU - S. Kevin Zhou PY - 2025 UR - https://arxiv.org/abs/2407.11550 ID - 2407.11550 ER -