TY - RPRT TI - The Synergy of Speculative Decoding and Batching in Serving Large Language Models AU - Qidong Su AU - Christina Giannoula AU - Gennady Pekhimenko PY - 2023 UR - https://arxiv.org/abs/2310.18813 ID - 2310.18813 ER -