TY - RPRT TI - Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training AU - Hong Liu AU - Zhiyuan Li AU - David Hall AU - Percy Liang AU - Tengyu Ma PY - 2024 UR - https://arxiv.org/abs/2305.14342 ID - 2305.14342 ER -