Tuning the CMS Coffea-casa facility for 200 Gbps Challenge

Sam Albin; Garhan Attebury; Kenneth Bloom; Brian Paul Bockelman; Benjamin Tovar Lopez; Carl Lundstedt; Oksana Shadura; John Thiltges; Derek Weitzel; Andrew Wightman

arXiv · 2503.12991

Tuning the CMS Coffea-casa facility for 200 Gbps Challenge

Sam Albin·Garhan Attebury·Kenneth Bloom·Brian Paul Bockelman·Benjamin Tovar Lopez·Carl Lundstedt·Oksana Shadura·John Thiltges·Derek Weitzel·Andrew Wightman

View original source ↗Read source document ↗Export metadata ↓

Abstract

As a part of the IRIS-HEP "Analysis Grand Challenge" activities, the Coffea-casa AF team executed a "200 Gbps Challenge". One of the goals of this challenge was to provide a setup for execution of a test notebook-style analysis on the facility that could process a 200 TB CMS NanoAOD dataset in 20 minutes. We describe the solutions we deployed at the facility to execute the challenge tasks. The facility was configured to provide 2000+ cores for quick turn-around, low-latency analysis. To reach the highest event processing rates we tested different scaling backends, both scaling over HTCondor and Kubernetes resources and using Dask and Taskvine schedulers. This configuration also allowed us to compare two different services for managing Dask clusters, Dask labextention, and Dask Gateway server, under extreme conditions. A robust set of XCache servers with a redirector were deployed in Kubernetes to cache the dataset to minimize wide-area network traffic. The XCache servers were backed with solid-state NVME drives deployed within the Kubernetes cluster nodes. All data access was authenticated using scitokens and was transparent to the user. To ensure we could track and measure data throughput precisely, we used our existing Prometheus monitoring stack to monitor the XCache pod throughput on the Kubernetes network layer. Using the rate query across all of the 8 XCache pods we were able to view a stacked cumulative graph of the total throughput for each XCache. This monitoring setup allowed us to ensure uniform data rates across all nodes while verifying we had reached the 200 Gbps benchmark.

Explore related subjects

hep-ex

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Sam Albin, Garhan Attebury, Kenneth Bloom, Brian Paul Bockelman, Benjamin Tovar Lopez, Carl Lundstedt, Oksana Shadura, John Thiltges, Derek Weitzel, Andrew Wightman. 2025-03-17. Tuning the CMS Coffea-casa facility for 200 Gbps Challenge. https://arxiv.org/abs/2503.12991

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Production of Light Nuclei and Hypernuclei in Heavy-Ion Collisions

We review recent STAR and ALICE measurements of light-nucleus and hypernucleus yields, femtoscopic correlations, and collective flow presented at SQM 2026. Statistical-hadronization calculations provide a useful baseline for integrated yields but do not simultaneously describe all measured light-nucleus ratios across collision energies and system sizes. For bound states with mass number $A<4$, current coalescence calculations provide a broadly consistent description of yields, femtoscopic correlations, and collective flow, although the quantitative hypertriton comparison depends on the assumed few-body wave function. The suppressed production of resonant $^{4}$Li relative to compact $^{4}$He indicates an effect of nuclear structure and late-stage dynamics. However, the quantitative model comparison also depends on the treatment of feed-down from unstable states. In high-multiplicity $p$+$p$ collisions, pion-deuteron femtoscopy further indicates that most observed (anti)deuterons are formed through nucleon fusion after strong decays of short-lived resonances. Taken together, these measurements show that production chronology and internal nuclear structure leave measurable imprints on the physics observables.

hep-ex↗

arXiv2026

Search for the process $e^+e^-\to f_1(1285)$ at the SND detector

In the experiment with the SND detector at the VEPP-2000 $e^+e^-$ collider, a search is performed for the direct production of the $C$-even $f_1(1285)$ resonance in $e^+e^-$ collisions. The analysis is based on data with an integrated luminosity of about 200 pb$^{-1}$, accumulated in the center-of-mass energy range of 1.14--1.46 GeV, of which about 72 pb$^{-1}$ were recorded near the maximum of the $f_1(1285)$ resonance. The $f_1(1285)$ production cross section at the resonance maximum $\sigma(e^+e^-\to f_1)=(31\pm 13\pm 2)$ pb and the branching fraction $B(f_1(1285)\to e^+e^-)=(3.5\pm 1.4\pm 0.3)\times 10^{-9}$ have been measured. The significance of the observation of the $e^+e^-\to f_1(1285)$ process is $2.5\sigma$. Since the significance is low, we also present the upper limits at the 90% confidence level: $\sigma(e^+e^-\to f_1)<48\mbox{ pb}$ and $B(f_1(1285)\to e^+e^-)<5.4\times 10^{-9}$.

hep-ex↗

arXiv2026

Projected Sensitivity to Slow Muonphilic Dark Matter with Accelerator Muon Beams

The nature of dark matter (DM) remains one of the most enduring open questions in modern physics, and muonphilic DM has emerged as a promising scenario that complements traditional DM candidates. Following the recently established cosmic-ray muon scattering approach, we investigate the sensitivity for probing slow muonphilic DM with accelerator muon beams. A Geant4-based simulation framework is developed, incorporating the detector geometry from the PKMu muon tomography system and a dedicated elastic $\mu$-DM scattering process. The projected sensitivity is found to be largely insensitive to both the beam energy and the transverse beam size when the beam is fully contained within the detector acceptance. For a benchmark beam intensity of $10^5/\rm{s}$, the simulated pure-muon beam surpasses the existing cosmic-ray limit of $1.61\times10^{-17}$ cm$^2$ at $m_{\rm DM}=1$ GeV within approximately 11 seconds. A realistic muon beam phase-space distribution based on simulations for the High Intensity heavy-ion Accelerator Facility (HIAF) is also implemented, yielding projected limits that improve upon the cosmic-ray results by nearly two orders of magnitude in a one-day exposure. These results demonstrate that a beam-muon scattering experiment offers a robust and promising route toward significantly improved sensitivity to slow muonphilic DM.

hep-ex↗