TY - RPRT TI - Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes AU - Kosuke Nishida AU - Kyosuke Nishida AU - Kuniko Saito PY - 2024 UR - https://arxiv.org/abs/2410.05052 ID - 2410.05052 ER -