arXiv · 2412.07867
Bumblebee: Foundation Model for Particle Physics Discovery
Abstract
Bumblebee is a foundation model for particle physics discovery, inspired by BERT. By removing positional encodings and embedding particle 4-vectors, Bumblebee captures both generator- and reconstruction-level information while ensuring sequence-order invariance. Pre-trained on a masked task, it improves dileptonic top quark reconstruction resolution by 10-20% and excels in downstream tasks, including toponium discrimination (AUROC 0.877) and initial state classification (AUROC 0.625). The flexibility of Bumblebee makes it suitable for a wide range of particle physics applications, especially the discovery of new particles.
Explore related subjects
Keep this discovery
Andrew J. Wildridge, Jack P. Rodgers, Ethan M. Colbert, Yao yao, Andreas W. Jung, Miaoyuan Liu. 2024-12-10. Bumblebee: Foundation Model for Particle Physics Discovery. https://arxiv.org/abs/2412.07867
Cite the original work for its findings. Save a collection to share your selection of sources.