TY  - RPRT
TI  - Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs
AU  - Tianyu Guo
AU  - Druv Pai
AU  - Yu Bai
AU  - Jiantao Jiao
AU  - Michael I. Jordan
AU  - Song Mei
PY  - 2024
UR  - https://arxiv.org/abs/2410.13835
ID  - 2410.13835
ER  -