TY  - RPRT
TI  - MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding
AU  - Ranajoy Sadhukhan
AU  - Jian Chen
AU  - Zhuoming Chen
AU  - Vashisth Tiwari
AU  - Ruihang Lai
AU  - Jinyuan Shi
AU  - Ian En-Hsu Yen
AU  - Avner May
AU  - Tianqi Chen
AU  - Beidi Chen
PY  - 2025
UR  - https://arxiv.org/abs/2408.11049
ID  - 2408.11049
ER  -