TY - RPRT TI - SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills AU - Amey Agrawal AU - Ashish Panwar AU - Jayashree Mohan AU - Nipun Kwatra AU - Bhargav S. Gulavani AU - Ramachandran Ramjee PY - 2023 UR - https://arxiv.org/abs/2308.16369 ID - 2308.16369 ER -