TY  - RPRT
TI  - Transformers Are Born Biased: Structural Inductive Biases at Random Initialization and Their Practical Consequences
AU  - Siquan Li
AU  - Yao Tong
AU  - Haonan Wang
AU  - Tianyang Hu
PY  - 2026
UR  - https://arxiv.org/abs/2602.05927
ID  - 2602.05927
ER  -