TY - RPRT TI - Positional versus Symbolic Attention Heads: Learning Dynamics, RoPE Geometry, and Length Generalization AU - Felipe Urrutia AU - Juan José Alegría AU - Cinthia Sanchez Macias AU - Jorge Salas AU - Cristian B. Calderon AU - Cristobal Rojas PY - 2026 UR - https://arxiv.org/abs/2605.31558 ID - 2605.31558 ER -