TY  - RPRT
TI  - D4: Improving LLM Pretraining via Document De-Duplication and Diversification
AU  - Kushal Tirumala
AU  - Daniel Simig
AU  - Armen Aghajanyan
AU  - Ari S. Morcos
PY  - 2023
UR  - https://arxiv.org/abs/2308.12284
ID  - 2308.12284
ER  -