TY - RPRT TI - Are Pre-trained Convolutions Better than Pre-trained Transformers? AU - Yi Tay AU - Mostafa Dehghani AU - Jai Gupta AU - Dara Bahri AU - Vamsi Aribandi AU - Zhen Qin AU - Donald Metzler PY - 2022 UR - https://arxiv.org/abs/2105.03322 ID - 2105.03322 ER -