TY - RPRT TI - WKVQuant: Quantizing Weight and Key/Value Cache for Large Language Models Gains More AU - Yuxuan Yue AU - Zhihang Yuan AU - Haojie Duanmu AU - Sifan Zhou AU - Jianlong Wu AU - Liqiang Nie PY - 2024 UR - https://arxiv.org/abs/2402.12065 ID - 2402.12065 ER -