TY  - RPRT
TI  - Born a Transformer -- Always a Transformer? On the Effect of Pretraining on Architectural Abilities
AU  - Mayank Jobanputra
AU  - Yana Veitsman
AU  - Yash Sarrof
AU  - Aleksandra Bakalova
AU  - Vera Demberg
AU  - Ellie Pavlick
AU  - Michael Hahn
PY  - 2025
UR  - https://arxiv.org/abs/2505.21785
ID  - 2505.21785
ER  -