TY - RPRT TI - Edge Intelligence Optimization for Large Language Model Inference with Batching and Quantization AU - Xinyuan Zhang AU - Jiang Liu AU - Zehui Xiong AU - Yudong Huang AU - Gaochang Xie AU - Ran Zhang PY - 2024 UR - https://arxiv.org/abs/2405.07140 ID - 2405.07140 ER -