TY - RPRT TI - Krutrim LLM: A Novel Tokenization Strategy for Multilingual Indic Languages with Petabyte-Scale Data Processing AU - Rahul Kumar AU - Shubham Kakde AU - Divyansh Rajput AU - Daud Ibrahim AU - Rishabh Nahata AU - Pidathala Sowjanya AU - Deepak Kumarr AU - Gautam Bhargava AU - Chandra Khatri PY - 2025 UR - https://arxiv.org/abs/2407.12481 ID - 2407.12481 ER -