TY - RPRT TI - FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design AU - Haojun Xia AU - Zhen Zheng AU - Xiaoxia Wu AU - Shiyang Chen AU - Zhewei Yao AU - Stephen Youn AU - Arash Bakhtiari AU - Michael Wyatt AU - Donglin Zhuang AU - Zhongzhu Zhou AU - Olatunji Ruwase AU - Yuxiong He AU - Shuaiwen Leon Song PY - 2024 UR - https://arxiv.org/abs/2401.14112 ID - 2401.14112 ER -