SearcharxivSearch

arXiv subjects

Riley Shipley

Publications and source records attributed to Riley Shipley.

3 recordsLinked to original sources

The Researcher's Guide to HPC Networks

Networks are critical infrastructure in nearly every computing system, but they are particularly important in High Performance Computing (HPC) systems, where users tackle problems at massive scale. Unfortunately, many of the hardware and software technologies that comprise supercomputer and datacenter networks are not widely taught in classes, nor are they extensively covered by textbooks or other educational documents outside of their primary sources. The purpose of this document is to provide a starting point to learn about these technologies by lowering the barrier to understanding and providing an abundance of references for further research. Covered topics include all levels of communication and network programming APIs, network control plane technologies, physical interconnects, and link-layer devices which are then brought to life in discussion of the architecture of El Capitan, a leadership class supercomputer created by Lawrence Livermore National Laboratory.

cs.CE

Leveraging Caliper and Benchpark to Analyze MPI Communication Patterns: Insights from AMG2023, Kripke, and Laghos

We introduce ``communication regions'' into the widely used Caliper HPC profiling tool. A communication region is an annotation enabling capture of metrics about the data being communicated (including statistics of these metrics), and metrics about the MPI processes involved in the communications, something not previously possible in Caliper. We explore the utility of communication regions with three representative modeling and simulation applications, AMG2023, Kripke, and Laghos, all part of the comprehensive Benchpark suite that includes Caliper annotations. Enhanced Caliper reveals detailed communication behaviors. Using Caliper and Thicket in tandem, we create new visualizations of MPI communication patterns, including halo exchanges. Our findings reveal communication bottlenecks and detailed behaviors, indicating significant utility of the special-regions addition to Caliper. The comparative scaling behavior of both CPU and GPU oriented systems are shown; we are able to look at different regions within a given application, and see how scalability and message-traffic metrics differ.

cs.DC

MPI Implementation Profiling for Better Application Performance

While application profiling has been a mainstay in the HPC community for years, profiling of MPI and other communication middleware has not received the same degree of exploration. This paper adds to the discussion of MPI profiling, contributing two general-purpose profiling methods as well as practical applications of these methods to an existing implementation. The ability to detect performance defects in MPI codes using these methods increases the potential of further research and development in communication optimization.

cs.DC