TY  - RPRT
TI  - A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models
AU  - Hayeon Lee
AU  - Rui Hou
AU  - Jongpil Kim
AU  - Davis Liang
AU  - Sung Ju Hwang
AU  - Alexander Min
PY  - 2023
UR  - https://arxiv.org/abs/2305.18239
ID  - 2305.18239
ER  -