TY  - RPRT
TI  - NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference
AU  - Xuanlin Jiang
AU  - Yang Zhou
AU  - Shiyi Cao
AU  - Ion Stoica
AU  - Minlan Yu
PY  - 2024
UR  - https://arxiv.org/abs/2411.01142
ID  - 2411.01142
ER  -