TY - RPRT TI - Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing AU - Richard Diehl Martinez AU - Zebulon Goriely AU - Andrew Caines AU - Paula Buttery AU - Lisa Beinborn PY - 2024 UR - https://arxiv.org/abs/2410.11462 ID - 2410.11462 ER -