Searcharxiv⌕ Search

arXiv · 2609.26899

Towards Foundation Models on Hardware Accelerators for Particle Physics

Abstract

Bandwidth constraints require many particle physics experiments to make real-time decisions on custom hardware or firmware running simplified algorithms, unlike offline analysis, where latency is usually not a limiting factor. For example, for particle jet tagging at colliders, state-of-the-art performance is achieved by foundation models with hundreds of millions of parameters pre-trained with billions of jets. We use knowledge distillation to transfer what such models have learned into efficient networks towards deployment in hardware accelerators. The teacher is the OmniLearned foundation model fine-tuned on top quark jet tagging; the student is an attention-free Deep Sets network. We demonstrate three ways the student's performance improves: adding a message-passing layer to the Deep Sets architecture, training on the teacher's soft labels rather than on ground-truth labels alone, and distilling from a pretrained teacher rather than from the same architecture trained from scratch. In each case the gain is largest in the background rejection at low signal efficiency, the regime that is most relevant for a trigger.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Maya Benyas, Julia Gonski, Qibin Liu, P. Alex May, Vinicius Mikuni, Benjamin Nachman, Tanvi Wamorkar, Liangyu Wu. 2026-09-22. Towards Foundation Models on Hardware Accelerators for Particle Physics. https://arxiv.org/abs/2609.26899

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Pomeron Weights in QCD Processes at High Energy and the $S$-Matrix Unitarity Constraint

The pomeron topological cross-section is derived for the eikonal and the $U$-matrix unitarization schemes using a generalized representation of the scattering amplitude at high energy in an effort to examine pomeron characteristics, namely the multiplicity distribution, fluctuation, and correlation, and to reveal the impact of pomeron weights on the $pp$ multiplicity distribution. The results demonstrate that the $U$-matrix inherently incorporates a larger amount of diffraction production into the multi-pomeron vertices, yielding a larger pomerons' variability regardless of the energy range, while such fluctuations become significant only beyond a specific high-energy threshold in eikonal-like schemes. Most importantly, our findings indicate that within the $U$-matrix scheme, an increase in exchanged pomerons results in more pronounced pomeron correlations and that this correlated resummation plays a key role in enhancing multi-parton collisions. We argue that the choice of unitarization scheme is not arbitrary, as it directly dictates the statistical structure of multi-reggeon exchanges. By reflecting the composite nature of hadrons, rational alternatives to eikonal-like schemes, such as the $U$-matrix, offer a compelling theoretical foundation for modeling high-energy hadronic collisions, provided that specific formulations can be identified that strictly satisfy all mathematical and physical constraints.

hep-ph↗

Two-loop renormalisation of quark and gluon fields in the SMEFT

We compute the contributions of CP-conserving operators in the dimension-six SMEFT to the two-loop renormalisation constants of quark and gluon fields in the $\overline{\textrm{MS}}$-scheme. Specifically, we consider the top-quark chromomagnetic operator and the triple gluon operator. We work with the background-field method, which allows us to extract the contribution of these operators to the two-loop running of the top mass and the strong coupling constant. We discuss in detail the mixing with the unphysical operators required for the renormalisation, and we present analytic results for the renormalisation constants of all relevant operators.

hep-ph↗

Two-loop renormalisation of quark and gluon fields in the SMEFT in the on-shell scheme

We compute the contributions of CP-conserving dimension-six SMEFT operators to the two-loop renormalisation constants of quark and gluon fields in the on-shell scheme. Specifically, we consider the top-quark chromomagnetic operator and the triple gluon operator. We also compute the contribution of four-quark operators to the gluon renormalisation constant and discuss the implications for the running of the strong coupling constant.

hep-ph↗