TY  - RPRT
TI  - Attention Sink Forges Native MoE in Attention Layers: Sink-Aware Training to Address Head Collapse
AU  - Zizhuo Fu
AU  - Wenxuan Zeng
AU  - Runsheng Wang
AU  - Meng Li
PY  - 2026
UR  - https://arxiv.org/abs/2602.01203
ID  - 2602.01203
ER  -