TY - RPRT TI - Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis AU - Hongkang Li AU - Meng Wang AU - Shuai Zhang AU - Sijia Liu AU - Pin-Yu Chen PY - 2024 UR - https://arxiv.org/abs/2406.17167 ID - 2406.17167 ER -