TY - RPRT TI - The CAP Principle for LLM Serving: A Survey of Long-Context Large Language Model Serving AU - Pai Zeng AU - Zhenyu Ning AU - Jieru Zhao AU - Weihao Cui AU - Mengwei Xu AU - Liwei Guo AU - Xusheng Chen AU - Yizhou Shan PY - 2024 UR - https://arxiv.org/abs/2405.11299 ID - 2405.11299 ER -