TY - RPRT TI - Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference? AU - Cheng Zhang AU - Jianyi Cheng AU - Ilia Shumailov AU - George A. Constantinides AU - Yiren Zhao PY - 2023 DO - 10.18653/v1/2023.emnlp-main.617 UR - https://arxiv.org/abs/2310.05079 ID - 2310.05079 ER -