TY  - RPRT
TI  - What One Cannot, Two Can: Two-Layer Transformers Provably Represent Induction Heads on Any-Order Markov Chains
AU  - Chanakya Ekbote
AU  - Marco Bondaschi
AU  - Nived Rajaraman
AU  - Jason D. Lee
AU  - Michael Gastpar
AU  - Ashok Vardhan Makkuva
AU  - Paul Pu Liang
PY  - 2025
UR  - https://arxiv.org/abs/2508.07208
ID  - 2508.07208
ER  -