TY - RPRT TI - MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models AU - Elias Frantar AU - Roberto L. Castro AU - Jiale Chen AU - Torsten Hoefler AU - Dan Alistarh PY - 2024 UR - https://arxiv.org/abs/2408.11743 ID - 2408.11743 ER -