TY - RPRT TI - Investigating Low-Rank Training in Transformer Language Models: Efficiency and Scaling Analysis AU - Xiuying Wei AU - Skander Moalla AU - Razvan Pascanu AU - Caglar Gulcehre PY - 2024 UR - https://arxiv.org/abs/2407.09835 ID - 2407.09835 ER -