TY - RPRT TI - Demystifying AI Platform Design for Distributed Inference of Next-Generation LLM models AU - Abhimanyu Bambhaniya AU - Ritik Raj AU - Geonhwa Jeong AU - Souvik Kundu AU - Sudarshan Srinivasan AU - Suvinay Subramanian AU - Midhilesh Elavazhagan AU - Madhu Kumar AU - Tushar Krishna PY - 2025 UR - https://arxiv.org/abs/2406.01698 ID - 2406.01698 ER -