TY - RPRT TI - KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation AU - Minsik Cho AU - Mohammad Rastegari AU - Devang Naik PY - 2024 UR - https://arxiv.org/abs/2405.05329 ID - 2405.05329 ER -