TY - RPRT TI - How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives AU - Xinpeng Wang AU - Leonie Weissweiler AU - Hinrich Schütze AU - Barbara Plank PY - 2023 UR - https://arxiv.org/abs/2305.15032 ID - 2305.15032 ER -