Searcharxiv⌕ Search

arXiv subjects

Nadezhda Dobreva

Publications and source records attributed to Nadezhda Dobreva.

5 recordsLinked to original sources

AlphaHits: Full-Event Tracking and Reconstruction Towards a Hit-Level Foundation Model

We introduce AlphaHits, a Transformer-based approach towards hit-level foundation models for LHC physics, building on the TrackFormer and HiggsFormer architectures. AlphaHits operates directly on detector hits and demonstrates scalable full-event charged-particle reconstruction and multi-task event reconstruction and classification from low-level detector information. AlphaHits-TrackFormer reconstructs the full charged-particle content of complete TrackML events without imposing a transverse-momentum selection on the target tracks. It processes both pixel and strip hits in events containing up to $1.5\times10^5$ hits under HL-LHC-like pileup conditions and assigns hits to individual reconstructed trajectories across its kinematic range. This includes the challenging low-$p_T$ population down to approximately $150\,\mathrm{MeV}$ in TrackML samples. It achieves a TrackML score of 0.959 over all reconstructable tracks, representing, to our knowledge, the highest reported TrackML score for full-detector, inclusive charged-particle reconstruction. Building on the TrackFormer architecture, AlphaHits is pretrained on charged-particle tracking and fine-tuned for multi-task reconstruction and classification. From a shared hit-level representation, it predicts tracks, jets, jet flavour, and event-level observables. AlphaHits achieves an AUC of 0.944 for Higgs event classification, with performance comparable to a Particle Transformer (ParT) baseline using fully reconstructed inputs. It also achieves performance comparable to Delphes-based baselines for jet reconstruction, jet flavour classification, and missing transverse momentum regression. These results highlight the potential for scalable full-event tracking and multi-task learning directly from detector hits, representing a promising step towards transferable hit-level representations and general-purpose foundation models for LHC physics.

hep-ex↗

Reconfiguration of pivoting cube ensembles under local sensing constraints using geometric deep learning

We demonstrate that local sensing is sufficient for effective global reconfiguration of homogeneous pivoting cube modular robots in two dimensions. While cube selection (i.e., which cube executes a movement) is assumed to be globally coordinated, each cube in the ensemble is controlled by a neural network that only gains information from other cubes in its local neighbourhood, trained using reinforcement learning. Furthermore, we study the effect of including grid symmetries of the cube ensemble (rotation and mirroring) in the neural network architecture. We find that even the most localised versions succeed in reconfiguring to the target shape, although reconfiguration happens faster the more information about the whole ensemble is available to individual cubes. Near-optimal reconfiguration is achieved with only nearest neighbour interactions by using multiple information passing between cubes, allowing them to accumulate more global information about the ensemble. Compared to standard neural network architectures, including grid symmetries provides only minor benefits during training, but allows for reduced model sizes. The presented approach is transferable to other space-relevant systems with different action spaces, such as sliding cube modular robots and CubeSat swarms.

cs.NE↗

TrackFormers Part 2: Enhanced Transformer-Based Models for High-Energy Physics Track Reconstruction

High-Energy Physics experiments are rapidly escalating in generated data volume, a trend that will intensify with the upcoming High-Luminosity LHC upgrade. This surge in data necessitates critical revisions across the data processing pipeline, with particle track reconstruction being a prime candidate for improvement. In our previous work, we introduced "TrackFormers", a collection of Transformer-based one-shot encoder-only models that effectively associate hits with expected tracks. In this study, we extend our earlier efforts by conducting detailed investigations into more custom Transformer attention mechanisms, a new design combining geometric projection and lightweight clustering, and a joint model conditioning classification on a regressor's predictions. Furthermore, we discuss new datasets that allow the training on hit level for a range of physics processes. These developments collectively aim to boost both the accuracy and potentially the efficiency of our tracking models, offering a robust solution to meet the demands of next-generation high-energy physics experiments.

hep-ex↗

TrackFormers: In Search of Transformer-Based Particle Tracking for the High-Luminosity LHC Era

High-Energy Physics experiments are facing a multi-fold data increase with every new iteration. This is certainly the case for the upcoming High-Luminosity LHC upgrade. Such increased data processing requirements forces revisions to almost every step of the data processing pipeline. One such step in need of an overhaul is the task of particle track reconstruction, a.k.a., tracking. A Machine Learning-assisted solution is expected to provide significant improvements, since the most time-consuming step in tracking is the assignment of hits to particles or track candidates. This is the topic of this paper. We take inspiration from large language models. As such, we consider two approaches: the prediction of the next word in a sentence (next hit point in a track), as well as the one-shot prediction of all hits within an event. In an extensive design effort, we have experimented with three models based on the Transformer architecture and one model based on the U-Net architecture, performing track association predictions for collision event hit points. In our evaluation, we consider a spectrum of simple to complex representations of the problem, eliminating designs with lower metrics early on. We report extensive results, covering both prediction accuracy (score) and computational performance. We have made use of the REDVID simulation framework, as well as reductions applied to the TrackML data set, to compose five data sets from simple to complex, for our experiments. The results highlight distinct advantages among different designs in terms of prediction accuracy and computational performance, demonstrating the efficiency of our methodology. Most importantly, the results show the viability of a one-shot encoder-classifier based Transformer solution as a practical approach for the task of tracking.

hep-ex↗

Novel Approaches for ML-Assisted Particle Track Reconstruction and Hit Clustering

Track reconstruction is a vital aspect of High-Energy Physics (HEP) and plays a critical role in major experiments. In this study, we delve into unexplored avenues for particle track reconstruction and hit clustering. Firstly, we enhance the algorithmic design effort by utilising a simplified simulator (REDVID) to generate training data that is specifically composed for simplicity. We demonstrate the effectiveness of this data in guiding the development of optimal network architectures. Additionally, we investigate the application of image segmentation networks for this task, exploring their potential for accurate track reconstruction. Moreover, we approach the task from a different perspective by treating it as a hit sequence to track sequence translation problem. Specifically, we explore the utilisation of Transformer architectures for tracking purposes. Our preliminary findings are covered in detail. By considering this novel approach, we aim to uncover new insights and potential advancements in track reconstruction. This research sheds light on previously unexplored methods and provides valuable insights for the field of particle track reconstruction and hit clustering in HEP.

hep-ex↗