TY - RPRT TI - When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale AU - Max Marion AU - Ahmet Üstün AU - Luiza Pozzobon AU - Alex Wang AU - Marzieh Fadaee AU - Sara Hooker PY - 2023 UR - https://arxiv.org/abs/2309.04564 ID - 2309.04564 ER -