TY - RPRT TI - Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget AU - Minh Duc Bui AU - Fabian David Schmidt AU - Goran Glavaš AU - Katharina von der Wense PY - 2024 UR - https://arxiv.org/abs/2404.19319 ID - 2404.19319 ER -