TY - RPRT TI - Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases AU - Xiaoxia Wu AU - Cheng Li AU - Reza Yazdani Aminabadi AU - Zhewei Yao AU - Yuxiong He PY - 2023 UR - https://arxiv.org/abs/2301.12017 ID - 2301.12017 ER -