Searcharxiv⌕ Search
Home/Archive/arXiv

arXiv · 2610.11703

How Much Does Submitting a Burst of Jobs Impact Waiting Time? An Analysis of the Jean Zay Workload Trace

Marius Garénaux·François Bodin
View original source ↗Read source document ↗Export metadata ↓

Abstract

This paper examines job waiting times on the Jean Zay supercomputer at IDRIS (Institut du D{é}veloppement et des Ressources en Informatique Scientifique http://www.idris.fr/), driven by the need to improve scheduling strategies for crossfacility scientific workflows. Drawing on large workload traces, we show that job waiting times are not independent of one another but are instead correlated through job bursts-batches of identical jobs submitted together, also called ``flurries''. We introduce a method for quantifying the effect of these bursts on waiting times, and find a strong Pearson correlation between waiting time and a job's rank within its burst. This correlation is above 0.8 for more than 40% of the jobs. We further derive an exact formula for the Slurm fairshare factor based on a convolution product, showing that the burst penalty operates on a much shorter timescale than fairshare itself-pointing to a distinct throttling mechanism specifically targeting bulk submissions. Once burst effects are accounted for, we use Welch's t-test to find that partition occupancy and number of requested cores have a significant effect on waiting time, though the effect is not significant for all partitions.

Explore related subjects

stat.AP

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Marius Garénaux, François Bodin. 2026-10-08. How Much Does Submitting a Burst of Jobs Impact Waiting Time? An Analysis of the Jean Zay Workload Trace. https://arxiv.org/abs/2610.11703

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Beyond Sustainable Development Goal (SDG) Accelerators: Directed Evidence for Adaptive Sustainability Portfolios

Governments and development partners often seek Sustainable Development Goal (SDG) "accelerators" whose progress can propagate gains across human well-being, institutions, resources, and environmental priorities. Such claims require evidence on direction, timing, robustness, and trade-offs, not only network connectivity. We map directed SDG interdependence using a balanced panel of 114 countries observed annually from 2000 to 2024. Because the goal series are persistent, trending, and cross-sectionally dependent, we combine Dumitrescu-Hurlin panel Granger non-causality tests on first-differenced series with false-discovery control across 272 directed goal pairs, and panel local projections with Driscoll-Kraay standard errors for 31 theory-derived indicator linkages. We find 84 directed linkages after correction: 40 synergies and 44 trade-offs. This dense structure does not support a universal accelerator. Driver-receiver rankings are fragile across lag orders, centrality metrics, bootstrap resampling, and alternative dependence controls; only peace and strong institutions as a net receiver and poverty reduction as an effect-size-weighted driver are distinguishable in the bootstrap screen. Two local-projection pathways are supported, both leading to lower child mortality, and the education-child-health association is corroborated in independent World Development Indicators data across 183 countries. The policy implication is not to abandon SDG integration, but to replace fixed global accelerator rankings with adaptive portfolios built around supported, time-lagged linkages and monitored constituent indicators.

stat.AP↗
arXiv2026

The long shadow of pandemic: Understanding the lingering effects of cause-specific mortality shocks

In the aftermath of the COVID-19 pandemic, empirical data have revealed that large-scale health crises not only cause immediate disruptions in mortality dynamics but also have persistent effects that may last for several years. Existing mortality models largely assume that mortality shocks are transitory and overlook how their effects can be long-lasting and heterogeneous across age groups and causes of death. In response to this limitation, we propose a novel stochastic mortality model that captures age- and cause-specific long-lasting effects of mortality jumps through a gamma-density-like decay function, estimated via a customized conditional maximum likelihood algorithm. Applying the model to recent U.S. mortality data, we reveal divergent persistence patterns across demographic groups and provide key insights into the tail risk profiles of life insurance and annuity products. Our scenario-based analyses further show that neglecting persistent shock effects can lead to suboptimal hedging, while the proposed model enables what-if testing to analyze such effects under potential future health crises.

stat.AP↗
arXiv2026

Simulation Based Inference of a Simple Neural Network Structure

Neurophysiologists are nowadays able to record from a large number of extracellular electrodes and to extract, from the raw data, the sequences of action potentials or spikes generated by many neurons. Unfortunately these ''many neurons'' still represent only a tiny fraction of the neuronal population that constitutes the network. Using association statistics such as the estimation of the cross-correlation functions, they are trying to infer the structure of the network formed by the recorded neurons. But this inference is compromised by the tremendous under-sampling of the neuronal population. We propose to focus instead on simple spike train statistics, like the empirical spikes frequency, or the interspike interval distribution. Their sampling distributions can be estimated by simulations, and, given a few observed spike train statistics, they provide enough information to infer the structure of the underlying network. We show that, on a ''toy model'', our method gives significantly better results than the sub-network reconstruction method with regards to the inference of the connection probability of the original network.

stat.AP↗