TY  - RPRT
TI  - When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models
AU  - Sunny Sanyal
AU  - Ravid Shwartz-Ziv
AU  - Alexandros G. Dimakis
AU  - Sujay Sanghavi
PY  - 2026
UR  - https://arxiv.org/abs/2404.08634
ID  - 2404.08634
ER  -