TY  - RPRT
TI  - Stabilizing Transformer Training by Preventing Attention Entropy Collapse
AU  - Shuangfei Zhai
AU  - Tatiana Likhomanenko
AU  - Etai Littwin
AU  - Dan Busbridge
AU  - Jason Ramapuram
AU  - Yizhe Zhang
AU  - Jiatao Gu
AU  - Josh Susskind
PY  - 2023
UR  - https://arxiv.org/abs/2303.06296
ID  - 2303.06296
ER  -