TY - RPRT TI - Task Scheduling for Efficient Inference of Large Language Models on Single Moderate GPU Systems AU - Wenxiang Lin AU - Xinglin Pan AU - Shaohuai Shi AU - Xuan Wang AU - Xiaowen Chu PY - 2024 UR - https://arxiv.org/abs/2411.15715 ID - 2411.15715 ER -