TY - RPRT TI - S2D: Sorted Speculative Decoding For More Efficient Deployment of Nested Large Language Models AU - Parsa Kavehzadeh AU - Mohammadreza Pourreza AU - Mojtaba Valipour AU - Tinashu Zhu AU - Haoli Bai AU - Ali Ghodsi AU - Boxing Chen AU - Mehdi Rezagholizadeh PY - 2024 UR - https://arxiv.org/abs/2407.01955 ID - 2407.01955 ER -