TY  - RPRT
TI  - Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation
AU  - Bobby He
AU  - James Martens
AU  - Guodong Zhang
AU  - Aleksandar Botev
AU  - Andrew Brock
AU  - Samuel L Smith
AU  - Yee Whye Teh
PY  - 2023
UR  - https://arxiv.org/abs/2302.10322
ID  - 2302.10322
ER  -