TY  - RPRT
TI  - Locret: Enhancing Eviction in Long-Context LLM Inference with Trained Retaining Heads on Consumer-Grade Devices
AU  - Yuxiang Huang
AU  - Binhang Yuan
AU  - Xu Han
AU  - Chaojun Xiao
AU  - Zhiyuan Liu
PY  - 2025
UR  - https://arxiv.org/abs/2410.01805
ID  - 2410.01805
ER  -