TY  - RPRT
TI  - SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices
AU  - Ruslan Svirschevski
AU  - Avner May
AU  - Zhuoming Chen
AU  - Beidi Chen
AU  - Zhihao Jia
AU  - Max Ryabinin
PY  - 2024
UR  - https://arxiv.org/abs/2406.02532
ID  - 2406.02532
ER  -