TY  - RPRT
TI  - GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
AU  - Joshua Ainslie
AU  - James Lee-Thorp
AU  - Michiel de Jong
AU  - Yury Zemlyanskiy
AU  - Federico Lebrón
AU  - Sumit Sanghai
PY  - 2023
UR  - https://arxiv.org/abs/2305.13245
ID  - 2305.13245
ER  -