TY  - RPRT
TI  - LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management
AU  - Yi Xiong
AU  - Hao Wu
AU  - Changxu Shao
AU  - Ziqing Wang
AU  - Rui Zhang
AU  - Yuhong Guo
AU  - Junping Zhao
AU  - Ke Zhang
AU  - Zhenxuan Pan
PY  - 2024
UR  - https://arxiv.org/abs/2410.00428
ID  - 2410.00428
ER  -