TY - RPRT TI - LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale AU - Jaehong Cho AU - Minsu Kim AU - Hyunmin Choi AU - Guseul Heo AU - Jongse Park PY - 2024 DO - 10.1109/iiswc63097.2024.00012 UR - https://arxiv.org/abs/2408.05499 ID - 2408.05499 ER -