arXiv · 2206.03564
A Locality-Aware Bruck Allgather
Abstract
Collective algorithms are an essential part of MPI, allowing application programmers to utilize underlying optimizations of common distributed operations. The MPI_Allgather gathers data, which is originally distributed across all processes, so that all data is available to each process. For small data sizes, the Bruck algorithm is commonly implemented to minimize the maximum number of messages communicated by any process. However, the cost of each step of communication is dependent upon the relative locations of source and destination processes, with non-local messages, such as inter-node, significantly more costly than local messages, such as intra-node. This paper optimizes the Bruck algorithm with locality-awareness, minimizing the number and size of non-local messages to improve performance and scalability of the allgather operation
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Amanda Bienz, Shreeman Gautam, Amun Kharel. 2022-08-23. A Locality-Aware Bruck Allgather. https://arxiv.org/abs/2206.03564
Cite the original work for its findings. Save a collection to share your selection of sources.