TY - RPRT TI - On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention AU - Yeonju Ro AU - Zhenyu Zhang AU - Souvik Kundu AU - Zhangyang Wang AU - Aditya Akella PY - 2025 UR - https://arxiv.org/abs/2506.09316 ID - 2506.09316 ER -