TY  - RPRT
TI  - MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts
AU  - Xi Victoria Lin
AU  - Akshat Shrivastava
AU  - Liang Luo
AU  - Srinivasan Iyer
AU  - Mike Lewis
AU  - Gargi Ghosh
AU  - Luke Zettlemoyer
AU  - Armen Aghajanyan
PY  - 2024
UR  - https://arxiv.org/abs/2407.21770
ID  - 2407.21770
ER  -