SearcharxivSearch

arXiv subjects

Tommaso Dorigo

Publications and source records attributed to Tommaso Dorigo.

At least 19 recordsLinked to original sources

Coverage Is Not Ordering: Ancillary Leakage and Representation Dependence in Covariance-Based Inference

A covariance matrix is often used as a compact surrogate for the statistical model of a measurement. We show that this replacement can change not only a fitted value or its uncertainty, but also the likelihood-ratio ordering of the experiment itself. In a tractable correlated-measurement model, the data separate into an informative component and an ancillary residual disagreement. Exact likelihood inference therefore does not use that disagreement, whereas data-dependent covariance matrices and Gaussian reconstructions after nonlinear transformations can reintroduce it into parameter inference. We quantify the resulting change by the probability mass of the symmetric difference of equally calibrated acceptance regions - the fraction of repeated experiments for which the confidence decision about a tested parameter value changes. In the small-uncertainty regime the ordering discrepancy is generically first order in the total relative uncertainty, whereas conventional and ancillary-conditioned coverage defects begin at second order. At 'coverage-blind' points the leading coverage difference vanishes while the ordering discrepancy remains nonzero. In a representative blind case with 10% total relative uncertainty, about 7.6% of experiments change their confidence decision despite exact calibration of both procedures. The same mechanism connects Peelle's Pertinent Puzzle to the classical literature on ancillarity and relevant subsets: a covariance approximation can manufacture inferential relevance for a goodness-of-fit statistic that is ancillary in the true model. We show directly how this changes the confidence interval reported for the same informative content, and extend the analysis beyond equal statistical uncertainties and beyond the two-measurement case.

hep-ex

Exploring the limits of high-energy proton-pion separation in granular calorimeters

Highly granular calorimeters provide detailed information about hadronic-shower development that may enable particle identification beyond their conventional role in energy measurement. We investigate how well this information can distinguish protons from positively charged pions and how the achievable discrimination depends on detector segmentation and particle energy. The study uses Geant4 simulations of isolated particles with energies from 10 to 100 GeV in a homogeneous lead-tungstate calorimeter. A Deep Sets model operating directly on cell positions and detected energy and time outperforms a boosted decision tree based on reconstructed shower observables. With cells measuring $3 \times 3 \times 6$ mm$^3$, Deep Sets achieves an accuracy of 93.8% at 10 GeV, decreasing to 67.2% at 100 GeV. Shower topology is independently informative, deposited energy provides the largest additional contribution, and timing supplies complementary information. Coarser segmentation reduces discrimination, with performance more sensitive to longitudinal than transverse granularity. These results provide an encouraging benchmark for calorimeter-based hadron identification and motivate its inclusion among the optimization targets for future highly granular calorimeters.

hep-ex

The Greedy Bump Bias: Local Profiling Geometry and the Look-Elsewhere Effect

When fitting a localized signal whose position or shape is not known in advance, one typically allows these parameters to vary together with the signal amplitude and chooses the values that maximize the likelihood. This freedom has two related statistical consequences. If a genuine signal is present, its fitted amplitude will be affected by a positive bias; otherwise, the same freedom increases the chance of finding an unusually signal-like background fluctuation, giving rise to the look-elsewhere effect. We show that these two effects can be understood as consequences of the same local geometry of the family of signal templates. We study this connection in a Gaussian matched-filter model, where a smooth D-dimensional family of normalized templates describes the unknown signal location or shape. In the normalized matched-filter problem, the curvature of a genuine signal peak and the fluctuations that determine the curvature of a high background peak are governed by the same template metric. This allows us to derive an explicit asymptotic relation. We then follow the problem away from the strong-signal and high-threshold limits. Separating the signal-associated maximum from the best competing maximum gives an exact decomposition of the global bias into a local profiling contribution and a contribution from remote-peak competition. In a one-dimensional Gaussian example, the second factorial cumulant accounts for most of this correction, while the third brings the prediction into close agreement with simulation. A two-point Kac--Rice calculation reproduces the second cumulant and reveals a quartic short-distance suppression of nearby maxima. The resulting picture separates the roles of local dimension, model-dependent curvature, and global extremal competition within a common framework.

physics.data-an

On the Codesign of Scientific Experiments and Industrial Systems

The optimization of large experiments in fundamental science, such as detectors for subnuclear physics at particle colliders, shares with the optimization of complex systems for industrial or societal applications the common issue of addressing the inter-relation between parameters describing the hardware used in data production and parameters used to analyse those data. While in many cases this coupling can be ignored -- when the problem can be successfully factored into simpler sub-tasks and the latter addressed serially -- there are situations in which that approach fails to converge to the absolute maximum of expected performance, as it results in a mis-alignment of the optimized hardware and software solutions. In this work we consider a few use cases of interest in fundamental science collected primarily from particle physics and related areas, and a pot-pourri of industrial and societal applications where the matter is similarly of relevance. We discuss the emergence of strong hardware-software coupling in some of those systems, as well as co-design procedures that may be deployed to identify the global maximum of their relevant utility functions. We observe how numerous opportunities exist to advance methods and tools for hardware-software co-design optimization, bridging fundamental science and industry through application- and challenge-driven projects, and shaping the future of scientific experiments and industrial systems.

physics.ins-det

Differentiable Surrogate for Detector Simulation and Design with Diffusion Models

In this work, we present a conditional denoising-diffusion surrogate for electromagnetic calorimeter showers that is trained to generate high-fidelity energy-deposition maps conditioned on key detector and beam parameters. The model employs efficient inference using Denoising Diffusion Implicit Model sampling and is pre-trained on GEANT4 simulations before being adapted to a new calorimeter geometry through Low-Rank Adaptation, requiring only a small post-training dataset. We evaluate physically meaningful observables, including total deposited energy, energy-weighted radius, and shower dispersion, obtaining relative root mean square error values below 2% for representative high-energy cases. This is in line with state-of-the-art calorimeter surrogates which report comparable fidelity on high-level observables. Furthermore, we compare gradients of a reconstruction-based utility function with respect to design parameters between the surrogate and finite-difference references. The diffusion surrogate reproduces the qualitative structure and directional trends of the true utility landscape, providing usable sensitivities for gradient-based optimization. These results show that diffusion-based surrogates can accelerate simulation-driven detector design while enabling differentiable, gradient-informed analysis.

physics.ins-det

Learning the Standard Model Manifold: Bayesian Latent Diffusion for Collider Anomaly Detection

We propose a physics-informed anomaly detection framework for collider data based on a Bayesian latent diffusion model. Our method combines a probabilistic encoder with diffusion dynamics in the latent space, allowing for stable and flexible density estimation while explicitly enforcing physics constraints, such as mass decorrelation and regularization of latent correlations. We train and test the model on simulated LHC jet data and evaluate its performance using seed-averaged ROC curves together with discovery-oriented metrics. Through a series of ablation studies, we show that the diffusion process, Bayesian regularization, and physics-motivated loss terms each contribute in a complementary way: they help stabilize training and improve generalization, even when the gains in peak performance are moderate. Overall, our results emphasize the importance of incorporating both uncertainty estimates and physics consistency when building reliable anomaly detection methods for new Physics searches in high-energy physics.

physics.data-an

Trustworthy scientific inference with generative models

Generative artificial intelligence (AI) excels at producing complex data structures (text, images, videos) by learning patterns from training examples. Across scientific disciplines, researchers are now applying generative models to "inverse problems" to directly predict hidden parameters from observed data along with measures of uncertainty. While these predictive or posterior-based methods can handle intractable likelihoods and large-scale studies, they can also produce biased or overconfident conclusions even without model misspecifications. We present a solution with Frequentist-Bayes (FreB), a mathematically rigorous protocol that reshapes AI-generated posterior probability distributions into (locally valid) confidence regions that consistently include true parameters with the expected probability, while achieving minimum size when training and target data align. We demonstrate FreB's effectiveness by tackling diverse case studies in the physical sciences: identifying unknown sources under dataset shift, reconciling competing theoretical models, and mitigating selection bias and systematics in observational studies. By providing validity guarantees with interpretable diagnostics, FreB enables trustworthy scientific inference across fields where direct likelihood evaluation remains impossible or prohibitively expensive.

stat.ML

TAMBO: A Deep-Valley Neutrino Observatory

Although the field of neutrino astronomy has blossomed in the last decade, physicists have struggled to fully map the high-energy neutrino sky. TAMBO, a mountain-based neutrino observatory, aims to solve that issue -- and find clues of new physics along the way.

astro-ph.HE

Toward the End-To-End Optimization of the SWGO Array Layout

In this document we consider the problem of finding the optimal layout for the array of water Cherenkov detectors proposed by the SWGO collaboration to study very-high-energy gamma rays in the southern hemisphere. We develop a continuous model of the secondary particles produced by atmospheric showers initiated by high-energy gamma rays and protons, and build an optimization pipeline capable of identifying the most promising configuration of the detector elements. The pipeline employs stochastic gradient descent to maximize a utility function aligned with the scientific goals of the experiment. We demonstrate how the software is capable of finding the global maximum in the high-dimensional parameter space, and discuss its performance and limitations.

astro-ph.IM

Strategic White Paper on AI Infrastructure for Particle, Nuclear, and Astroparticle Physics: Insights from JENA and EuCAIF

Artificial intelligence (AI) is transforming scientific research, with deep learning methods playing a central role in data analysis, simulations, and signal detection across particle, nuclear, and astroparticle physics. Within the JENA communities-ECFA, NuPECC, and APPEC-and as part of the EuCAIF initiative, AI integration is advancing steadily. However, broader adoption remains constrained by challenges such as limited computational resources, a lack of expertise, and difficulties in transitioning from research and development (R&D) to production. This white paper provides a strategic roadmap, informed by a community survey, to address these barriers. It outlines critical infrastructure requirements, prioritizes training initiatives, and proposes funding strategies to scale AI capabilities across fundamental physics over the next five years.

astro-ph.IM

End-to-End Detector Optimization with Diffusion models: A Case Study in Sampling Calorimeters

Recent advances in machine learning have opened new avenues for optimizing detector designs in high-energy physics, where the complex interplay of geometry, materials, and physics processes has traditionally posed a significant challenge. In this work, we introduce the $\textit{end-to-end}$ AI Detector Optimization framework (AIDO) that leverages a diffusion model as a surrogate for the full simulation and reconstruction chain, enabling gradient-based design exploration in both continuous and discrete parameter spaces. Although this framework is applicable to a broad range of detectors, we illustrate its power using the specific example of a sampling calorimeter, focusing on charged pions and photons as representative incident particles. Our results demonstrate that the diffusion model effectively captures critical performance metrics for calorimeter design, guiding the automatic search for layer arrangement and material composition that aligns with known calorimeter principles. The success of this proof-of-concept study provides a foundation for future applications of end-to-end optimization to more complex detector systems, offering a promising path toward systematically exploring the vast design space in next-generation experiments.

physics.ins-det

Neuromorphic Readout for Hadron Calorimeters

We simulate hadrons impinging on a homogeneous lead-tungstate (PbWO4) calorimeter to investigate how the resulting light yield and its temporal structure, as detected by an array of light-sensitive sensors, can be processed by a neuromorphic computing system. Our model encodes temporal photon distributions as spike trains and employs a fully connected spiking neural network to estimate the total deposited energy, as well as the position and spatial distribution of the light emissions within the sensitive material. The extracted primitives offer valuable topological information about the shower development in the material, achieved without requiring a segmentation of the active medium. A potential nanophotonic implementation using III-V semiconductor nanowires is discussed. It can be both fast and energy efficient.

hep-ex

Hadron Identification Prospects With Granular Calorimeters

In this work we consider the problem of determining the identity of hadrons at high energies based on the topology of their energy depositions in dense matter, along with the time of the interactions. Using GEANT4 simulations of a homogeneous lead tungstate calorimeter with high transverse and longitudinal segmentation, we investigated the discrimination of protons, positive pions, and positive kaons at 100 GeV. The analysis focuses on the impact of calorimeter granularity by progressively merging detector cells and extracting features like energy deposition patterns andtiming information. Two machine learning approaches, XGBoost and fully connected deep neural networks, were employed to assess the classification performance across particle pairs. The results indicate that fine segmentation improves particle discrimination, with higher granularity yielding more detailed characterization of energy showers. Additionally, the results highlight the importance of shower radius, energy fractions, and timing variables in distinguishing particle types. The XGBoost model demonstrated computational efficiency and interpretability advantages over deep learning for tabular data structures, while achieving similar classification performance. This motivates further work required to combine high- and low-level feature analysis, e.g., using convolutional and graph-based neural networks, and extending the study to a broader range of particle energies and types.

physics.ins-det

Unsupervised Particle Tracking with Neuromorphic Computing

We study the application of a neural network architecture for identifying charged particle trajectories via unsupervised learning of delays and synaptic weights using a spike-time-dependent plasticity rule. In the considered model, the neurons receive time-encoded information on the position of particle hits in a tracking detector for a particle collider, modeled according to the geometry of the Compact Muon Solenoid Phase II detector. We show how a spiking neural network is capable of successfully identifying in a completely unsupervised way the signal left by charged particles in the presence of conspicuous noise from accidental or combinatorial hits. These results open the way to applications of neuromorphic computing to particle tracking, motivating further studies into its potential for real-time, low-power particle tracking in future high-energy physics experiments.

hep-ex

On the Utility Function of Experiments in Fundamental Science

The majority of experiments in fundamental science today are designed to be multi-purpose: their aim is not simply to measure a single physical quantity or process, but rather to enable increased precision in the measurement of a number of different observable quantities of a natural system, to extend the search for new phenomena, or to exclude a larger phase space of candidate theories. Most of the time, a combination of the above goals is pursued; this breadth of scope adds a layer of complexity to the already demanding task of designing the measurement apparatus in an optimal way, by defining suitable geometries and choosing the most advantageous materials and appropriate detection technologies. The precise definition of a global optimality criterion may then require experimentalists to find a consensus on the relative scientific worth of those goals. In this work, we discuss the problem of formulating a utility function for multipurpose experiments, as an enabling step to employ artificial intelligence tools to explore the design space and assist humans in finding solutions at the Pareto front.

hep-ex

TomOpt: Differential optimisation for task- and constraint-aware design of particle detectors in the context of muon tomography

We describe a software package, TomOpt, developed to optimise the geometrical layout and specifications of detectors designed for tomography by scattering of cosmic-ray muons. The software exploits differentiable programming for the modeling of muon interactions with detectors and scanned volumes, the inference of volume properties, and the optimisation cycle performing the loss minimisation. In doing so, we provide the first demonstration of end-to-end-differentiable and inference-aware optimisation of particle physics instruments. We study the performance of the software on a relevant benchmark scenario and discuss its potential applications. Our code is available on Github.

physics.ins-det

Efficient Forward-Mode Algorithmic Derivatives of Geant4

We have applied an operator-overloading forward-mode algorithmic differentiation tool to the Monte-Carlo particle simulation toolkit Geant4. Our differentiated version of Geant4 allows computing mean pathwise derivatives of user-defined outputs of Geant4 applications with respect to user-defined inputs. This constitutes a major step towards enabling gradient-based optimization techniques in high-energy physics, as well as other application domains of Geant4. This is a preliminary report on the technical aspects of applying operator-overloading AD to Geant4, as well as a first analysis of some results obtained by our differentiated Geant4 prototype. We plan to follow up with a more refined analysis.

physics.comp-ph

Classification under Nuisance Parameters and Generalized Label Shift in Likelihood-Free Inference

An open scientific challenge is how to classify events with reliable measures of uncertainty, when we have a mechanistic model of the data-generating process but the distribution over both labels and latent nuisance parameters is different between train and target data. We refer to this type of distributional shift as generalized label shift (GLS). Direct classification using observed data $\mathbf{X}$ as covariates leads to biased predictions and invalid uncertainty estimates of labels $Y$. We overcome these biases by proposing a new method for robust uncertainty quantification that casts classification as a hypothesis testing problem under nuisance parameters. The key idea is to estimate the classifier's receiver operating characteristic (ROC) across the entire nuisance parameter space, which allows us to devise cutoffs that are invariant under GLS. Our method effectively endows a pre-trained classifier with domain adaptation capabilities and returns valid prediction sets while maintaining high power. We demonstrate its performance on two challenging scientific problems in biology and astroparticle physics with data from realistic mechanistic models.

stat.ML