TY  - RPRT
TI  - PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
AU  - Yixin Song
AU  - Zeyu Mi
AU  - Haotong Xie
AU  - Haibo Chen
PY  - 2024
UR  - https://arxiv.org/abs/2312.12456
ID  - 2312.12456
ER  -