TY  - RPRT
TI  - DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion
AU  - Yilong Chen
AU  - Linhao Zhang
AU  - Junyuan Shang
AU  - Zhenyu Zhang
AU  - Tingwen Liu
AU  - Shuohuan Wang
AU  - Yu Sun
PY  - 2024
UR  - https://arxiv.org/abs/2406.06567
ID  - 2406.06567
ER  -