TY  - RPRT
TI  - Align Attention Heads Before Merging Them: An Effective Way for Converting MHA to GQA
AU  - Qingyun Jin
AU  - Xiaohui Song
AU  - Feng Zhou
AU  - Zengchang Qin
PY  - 2025
UR  - https://arxiv.org/abs/2412.20677
ID  - 2412.20677
ER  -