arXiv · 2604.00377
Reclaiming Idle CPU Cycles on Kubernetes: Sparse-Domain Multiplexing for Concurrent MPI-CFD Simulations
Abstract
When simulations parallelized with the Message Passing Interface (MPI) run on shared Kubernetes clusters, conventional CPU scheduling leaves most provisioned cycles idle at synchronization barriers. This paper presents a multiplexing framework that reclaims this idle capacity by co-locating multiple simulations on the same cluster. Profiling through the MPI profiling interface quantifies per-rank idle fractions; proportional CPU allocation then lets a second simulation run concurrently with minimal overhead, yielding 1.77x throughput. A sweep to eight concurrent simulations locates the capacity boundary: throughput rises to 4.09x at N=6, where pod count equals cluster vCPU count, then collapses to 0.50x at N=8 as busy-wait MPI progress threads displace useful computation. A single-parameter analytical model fitted on one mesh reproduces all twelve concurrent configurations, measured across a 4x range of mesh sizes, within 6.4%, including the boundary point within 0.8%. Four NAS Parallel Benchmarks kernels (1.92-1.99x at N=2), a half-size cluster (1.68x), and per-pod memory accounting confirm generality across workloads, cluster sizes, and resource dimensions. A dynamic controller automates profiling, In-Place Pod Vertical Scaling (KEP-1287), packing, and fairness monitoring, achieving 3.25x throughput for four simulations with zero pod restarts, the first CPU application of in-place resize to running MPI processes.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Tianfang Xie. 2026-04-01. Reclaiming Idle CPU Cycles on Kubernetes: Sparse-Domain Multiplexing for Concurrent MPI-CFD Simulations. https://arxiv.org/abs/2604.00377
Cite the original work for its findings. Save a collection to share your selection of sources.