TY - RPRT TI - PromptDistill: Query-based Selective Token Retention in Intermediate Layers for Efficient Large Language Model Inference AU - Weisheng Jin AU - Maojia Song AU - Tej Deep Pala AU - Yew Ken Chia AU - Amir Zadeh AU - Chuan Li AU - Soujanya Poria PY - 2025 UR - https://arxiv.org/abs/2503.23274 ID - 2503.23274 ER -