TY  - RPRT
TI  - Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective
AU  - Fanqi Yan
AU  - Huy Nguyen
AU  - Pedram Akbarian
AU  - Nhat Ho
AU  - Alessandro Rinaldo
PY  - 2025
UR  - https://arxiv.org/abs/2502.00281
ID  - 2502.00281
ER  -