TY - RPRT TI - Mélange: Cost Efficient Large Language Model Serving by Exploiting GPU Heterogeneity AU - Tyler Griggs AU - Xiaoxuan Liu AU - Jiaxiang Yu AU - Doyoung Kim AU - Wei-Lin Chiang AU - Alvin Cheung AU - Ion Stoica PY - 2024 UR - https://arxiv.org/abs/2404.14527 ID - 2404.14527 ER -