TY  - RPRT
TI  - Efficient Pre-Training of LLMs through Truncated SVD Representations
AU  - Kaivan Kamali
AU  - Kajetan Schweighofer
AU  - Hormoz Shahrzad
AU  - Olivier Francon
AU  - Babak Hodjat
AU  - Risto Miikkulainen
PY  - 2026
UR  - https://arxiv.org/abs/2605.28573
ID  - 2605.28573
ER  -