TY  - RPRT
TI  - METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
AU  - Payal Bajaj
AU  - Chenyan Xiong
AU  - Guolin Ke
AU  - Xiaodong Liu
AU  - Di He
AU  - Saurabh Tiwary
AU  - Tie-Yan Liu
AU  - Paul Bennett
AU  - Xia Song
AU  - Jianfeng Gao
PY  - 2022
UR  - https://arxiv.org/abs/2204.06644
ID  - 2204.06644
ER  -