TY  - RPRT
TI  - Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers
AU  - Tim Tsz-Kit Lau
AU  - Weijie Su
PY  - 2026
UR  - https://arxiv.org/abs/2605.18106
ID  - 2605.18106
ER  -