TY - RPRT TI - Is Random Attention Sufficient for Sequence Modeling? Disentangling Trainable Components in the Transformer AU - Yihe Dong AU - Lorenzo Noci AU - Mikhail Khodak AU - Mufan Li PY - 2025 UR - https://arxiv.org/abs/2506.01115 ID - 2506.01115 ER -