TY  - RPRT
TI  - Weight decay induces low-rank attention layers
AU  - Seijin Kobayashi
AU  - Yassir Akram
AU  - Johannes Von Oswald
PY  - 2024
UR  - https://arxiv.org/abs/2410.23819
ID  - 2410.23819
ER  -