TY  - RPRT
TI  - Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, and Better Transferability
AU  - Ruifei He
AU  - Shuyang Sun
AU  - Jihan Yang
AU  - Song Bai
AU  - Xiaojuan Qi
PY  - 2022
UR  - https://arxiv.org/abs/2203.05180
ID  - 2203.05180
ER  -