TY - RPRT TI - Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck AU - Nathan Godey AU - Éric de la Clergerie AU - Benoît Sagot PY - 2024 UR - https://arxiv.org/abs/2404.07647 ID - 2404.07647 ER -