Searcharxiv⌕ Search

arXiv subjects

Anand Kumar Singh

Publications and source records attributed to Anand Kumar Singh.

2 recordsLinked to original sources

VelServe: Taming Decode Jitters in LLM Inference with Tail-Calibrated Scheduling

Interactive LLM services must meet latency service-level objectives (SLOs) for the time to first token (TTFT) and the time between tokens (TBT), as streaming and soft real-time applications require predictable token delivery. We identify decode jitters in both aggregated and disaggregated serving. A jitter delays every request in the batch, and long responses span hundreds of steps, so even rare overruns cause many SLO violations. In aggregated serving, SLO-aware schedulers set each step's prefill budget until its predicted latency just meets the TBT target, leaving no room for mispredictions or host stalls. Disaggregation meets average TBT targets at a cost in capacity, yet the steps that admit new requests still run late. We present \sysname, a scheduler that calibrates how much prefill work each decode step carries using the measured tail of its own iteration latency. The SLO determines how rare a late step must be, and \sysname leaves enough headroom in each iteration to prevent overruns and meet the target decode latency. This headroom slows prefill, so \sysname serves the shortest waiting prompt first. When TTFT deadlines grow with prompt length, the long prompts it delays have the most time to spare. Under disaggregation, it spaces admissions so that no request waits on more slow admission steps than its P99 target allows. On three attention families and varying workloads, \sysname sustains 2.4--2.9$\times$ the SLO goodput of the strongest baseline on Qwen3-8B and DeepSeek-V4-Flash, and at least 4.4$\times$ on DeepSeek-V2-Lite. With prefill and decode disaggregated on eight GPUs, \sysname meets the SLO for more than twice as many requests as state-of-the-art baselines.

cs.AI↗

Low-Latitude Auroras: Insights from 23 April 2023 Solar Storm

In April 2023, low-latitude aurora observation by the all-sky camera at Hanle, Ladakh, India ($33^{\circ} {} N $ geographic latitude (GGLat)) was reported, which stimulated a lot of discussion among scientists as well as masses across the globe. The reported observation was intriguing as the solar storm that triggered this aurora was moderate and the first such observation from Indian region in the space-era. In this communication, we investigate such a unique modern-day observation of low-latitude auroral sighting occurring during the passage of sheath-region of Interplanetary-Coronal-Mass-Ejection, utilizing in situ multi-spacecraft particle measurements along with geomagnetic-field observations by ground and satellite-based magnetometers. Auroral observations at Hanle coincided with the intense substorm occurrences. It is unequivocally found that the aurora didnt reach India, rather the equatorward boundary of the aurora was beyond $ 50^{\circ} {}N $ GGLat. The multi-instrumental observations enabled us to estimate the altitude of the red auroral emissions accurately. The increased flux of low-energy electrons ($<$100 eV) precipitating at $\sim 54^{\circ}N$ GGLat causing red-light emissions at higher altitudes ($\sim$700-950 km) can be visible from Hanle. The observed low-latitude red aurora from India resulted from two factors: emissions at higher altitudes in the auroral oval and a slight expansion of the auroral oval towards the equator. The precipitating low-energy particles responsible for red auroral emissions mostly originate from the plasma sheet. These particles precipitate due to wave-particle interactions enhanced by strong compression of the magnetosphere during high solar wind pressure. This study using multi-point observations holds immense importance in providing a better understanding of low-latitude auroras.

physics.space-ph↗