SearcharxivSearch

arXiv subjects

Bhavika Jalli

Publications and source records attributed to Bhavika Jalli.

4 recordsLinked to original sources

A Picture is Worth a Thousand Tokens: How Vision Language Models Cut AI Energy Costs While Improving Accuracy

LLM inference accounts for over 90% of AI operational energy, scaling directly with input token count---a critical inefficiency for telecom network analytics and numerical time-series data analysis (NTSDA), where raw multivariate KPI windows from 4G/5G cell sites expand into thousands of floating-point tokens. Vision-Language Models (VLMs) eliminate this mismatch by encoding time-series as 2D plots, achieving 3.6-10.4x input token reduction across Llama-3.2-90B, Qwen2.5-VL-72B, and Pixtral-12B architectures. This translates to 1.8-2.5x measured inference energy reduction, saving approximately 7.2 MJ/day at telecom edge deployments and CloudRAN that monitor 200 cells per 15-minute interval. Critically, efficiency gains do not sacrifice accuracy: a fine-tuned Llama-3.2-90B-Vision VLM achieves 220.7% higher precision than its text-only counterpart and outperforms LSTM and ARIMA baselines by over 144% on telecom anomaly detection. On public benchmarks, Pixtral-12B achieves a 20.6x improvement in J/F1 score at mean F1 = 0.82. At 24 KPIs, text representations exceed the 128K context window of most production LLMs, rendering text-only processing infeasible without truncation, while visual representations remain within standard limits. These results establish VLMs as an energy-efficient and accuracy-superior modality for numerical time-series workloads, providing empirical grounding for AI inference systems that treat energy consumption as a first-class engineering constraint.

cs.AI

Leveraging Multi-Agent System (MAS) and Fine-Tuned Small Language Models (SLMs) for Automated Telecom Network Troubleshooting

Telecom networks are rapidly growing in scale and complexity, making effective management, operation, and optimization increasingly challenging. Although Artificial Intelligence (AI) has been applied to many telecom tasks, existing models are often narrow in scope, require large amounts of labeled data, and struggle to generalize across heterogeneous deployments. Consequently, network troubleshooting continues to rely heavily on Subject Matter Experts (SMEs) to manually correlate various data sources to identify root causes and corrective actions. To address these limitations, we propose a Multi-Agent System (MAS) that employs an agentic workflow, with Large Language Models (LLMs) coordinating multiple specialized tools for fully automated network troubleshooting. Once faults are detected by AI/ML-based monitors, the framework dynamically activates agents such as an orchestrator, solution planner, executor, data retriever, and root-cause analyzer to diagnose issues and recommend remediation strategies within a short time frame. A key component of this system is the solution planner, which generates appropriate remediation plans based on internal documentation. To enable this, we fine-tuned a Small Language Model (SLM) on proprietary troubleshooting documents to produce domain-grounded solution plans. Experimental results demonstrate that the proposed framework significantly accelerates troubleshooting automation across both Radio Access Network (RAN) and Core network domains.

cs.AI

Edge-Deployable LLM Fine-Tuning on a Single GPU for Telecom Network Troubleshooting

Telecom troubleshooting at edge sites requires low-latency model responses and localized model adaptation to satisfy operational and data sovereignty requirements. However, deploying large language models (LLMs) at telecom edge sites is constrained by limited power, cooling, space, and weight budgets for GPU infrastructure. These challenges are further amplified by human-patterned Radio Access Network (RAN) traffic that often results in low GPU utilization and poor return on investment, as well as by architectural mismatches between deterministic ASIC-based telecom processing and GPU-oriented AI workloads. Consequently, single-GPU fine-tuning becomes a practical requirement for scalable edge AI deployment rather than merely a resource limitation. This paper presents a GPU profiling study of LLM fine-tuning using the Unsloth framework on a single edge-class accelerator. We systematically analyze the effects of maximum sequence length, GPU memory utilization, Low-Rank Adaptation (LoRA) rank, and generation count on training stability and resource efficiency. We further investigate trade-offs in KV cache usage, activation memory overhead, and runtime stability under inductor compilation. In addition, we show that reasoning and non-reasoning model architectures exhibit substantially different behaviors during supervised fine-tuning (SFT) and reinforcement fine-tuning (RFT) because of differences in chat template structures, reasoning tags, and control flags. Experiments are conducted on a telecom troubleshooting dataset consisting of question-answer pairs augmented with top-3 retrieved contextual documents. The results provide practical configuration guidelines for stable, efficient, and resource-aware LLM fine-tuning in telecom edge environments.

cs.DC

Think Less, Label Better: Multi-Stage Domain-Grounded Synthetic Data Generation for Fine-Tuning Large Language Models in Telecommunications

The success of large language models (LLMs) depends heavily on large-scale, high-quality instruction-following and reinforcement datasets. However, generating such data through human annotation is prohibitively time-consuming particularly for domain-specific tasks like telecom network troubleshooting, where accurate responses require deep technical expertise and contextual understanding. In this paper, we present a fully automated, retrieval-augmented pipeline for generating synthetic question-answer (QA) pairs grounded in structured domain knowledge. Our multi-stage framework integrates a retriever, base generator, and refinement model to synthesize and enhance QA pairs using documents retrieved from a domain-specific knowledge graph. To ensure data quality, we employ customized RAGAS-based scoring to filter low-quality samples, producing a high-quality dataset suitable for reinforcement fine-tuning (RFT). We demonstrate our approach in a real-world telecom scenario focused on radio access network (RAN) troubleshooting. The resulting pipeline generates complex, context-rich troubleshooting solution plans without human intervention. This work offers a scalable solution for building instruction and reinforcement datasets in specialized domains, significantly reducing dependence on manual labeling while maintaining high technical fidelity.

cs.CL