TY - RPRT TI - Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers AU - Siddharth Singh AU - Prajwal Singhania AU - Aditya Ranjan AU - John Kirchenbauer AU - Jonas Geiping AU - Yuxin Wen AU - Neel Jain AU - Abhimanyu Hans AU - Manli Shu AU - Aditya Tomar AU - Tom Goldstein AU - Abhinav Bhatele PY - 2025 UR - https://arxiv.org/abs/2502.08145 ID - 2502.08145 ER -