arXiv · 2505.08562
Pinpoint resource allocation for GPU batch applications
Abstract
With the increasing usage of Machine Learning (ML) in High energy physics (HEP), there is a variety of new analyses with a large spread in compute resource requirements, especially when it comes to GPU resources. For institutes, like the Karlsruhe Institute of Technology (KIT), that provide GPU compute resources to HEP via their batch systems or the Grid, a high throughput, as well as energy efficient usage of their systems is essential. With low intensity GPU analyses specifically, inefficiencies are created by the standard scheduling, as resources are over-assigned to such workflows. An approach that is flexible enough to cover the entire spectrum, from multi-process per GPU, to multi-GPU per process, is necessary. As a follow-up to the techniques presented at ACAT 2022, this time we study NVIDIA's Multi-Process Service (MPS), its ability to securely distribute device memory and its interplay with the KIT HTCondor batch system. A number of ML applications were benchmarked using this approach to illustrate the performance implications in terms of throughput and energy efficiency.
Explore related subjects
Keep this discovery
Tim Voigtländer, Manuel Giffels, Günter Quast, Matthias Schnepf, Roger Wolf. 2025-05-13. Pinpoint resource allocation for GPU batch applications. https://arxiv.org/abs/2505.08562
Cite the original work for its findings. Save a collection to share your selection of sources.