TY  - RPRT
TI  - Learning Less Is More: Premature Upper-Layer Attention Specialization Hurts Language Model Pretraining
AU  - Jinchang Zhu
AU  - Jindong Li
AU  - Yuwen Hao
AU  - Chengyu Zou
AU  - Rong Fu
AU  - Menglin Yang
PY  - 2026
UR  - https://arxiv.org/abs/2605.10504
ID  - 2605.10504
ER  -