SearcharxivSearch

arXiv subjects

Reuben D. Budiardja

Publications and source records attributed to Reuben D. Budiardja.

17 recordsLinked to original sources

GenASiS: General Astrophysical Simulation System. II. Self-gravitating Baryonic Matter

GenASiS (General Astrophysical Simulation System) is a code being developed initially and primarily, though not exclusively, for the simulation of core-collapse supernovae on the world's leading capability supercomputers. This paper -- the second in a series -- documents capabilities for Newtonian self-gravitating fluid dynamics, including tabulated microphysical equations of state treating nuclei and nuclear matter (`baryonic matter'). Computation of the gravitational potential of a spheroid, and simulation of the gravitational collapse of dust and of an ideal fluid, provide tests of self-gravitation against known solutions. In multidimensional computations of the adiabatic collapse, bounce, and explosion of spherically symmetric pre-supernova progenitors -- which we propose become a standard benchmark for code comparisons -- we find that the explosions are prompt and remain spherically symmetric (as expected), with an average shock expansion speed and total kinetic energy that are inversely correlated with the progenitor mass at the onset of collapse and the compactness parameter.

astro-ph.HE

Dynamical Dark Energy Imprints in the Lyman-Alpha Forest

The nature of dark energy (DE) remains elusive, even though it constitutes the dominant energy-density component of the Universe and drives the late-time acceleration of cosmic expansion. By combining measurements of the expansion history from baryon acoustic oscillations, supernova surveys, and cosmic microwave background data, the Dark Energy Spectroscopic Instrument (DESI) Collaboration has inferred that the DE equation of state may evolve over time. The profound implications of a time-variable, ``dynamical" DE (DDE) that departs from a cosmological constant motivate the need for independent observational tests. In this work, we use cosmological hydrodynamical simulations of structure formation to investigate how DDE affects the properties of the Lyman-Alpha ``forest'' of absorption features produced by neutral hydrogen in the cosmic web. We find that DDE models consistent with the DESI constraints induce a spectral tilt in the forest transmitted flux power spectrum, imprinting a scale- and redshift-dependent signature relative to standard Lambda-CDM cosmologies. These models also yield higher intergalactic medium temperatures and reduced Lyman-Alpha opacity compared to Lambda-CDM. We discuss the observational implications of these trends as potential avenues for independent confirmation of DDE.

astro-ph.CO

MFC 5.0: An exascale many-physics flow solver

Many problems of interest in engineering, medicine, and the fundamental sciences rely on high-fidelity flow simulation, making performant computational fluid dynamics solvers a mainstay of the open-source software community. Previous work, MFC 3.0, was published, documented, and made open-source by Bryngelson et al. CPC (2021) features numerous physical features, numerical methods, and scalable infrastructure. MFC 5.0 is a significant update to MFC 3.0, featuring a broad set of well-established and novel physical models and numerical methods, as well as the introduction of GPU and APU (or superchip) acceleration. We exhibit state-of-the-art performance and ideal scaling on the first two exascale supercomputers, OLCF's Frontier and LLNL's El Capitan. Combined with MFC's single-accelerator performance, MFC achieves exascale computation in practice and has achieved the largest-to-date public CFD simulation at 200 trillion grid points, earning it a 2025 ACM Gordon Bell Prize finalist. New physical features include the immersed boundary method, $N$-fluid phase change, Euler-Euler and Euler-Lagrange sub-grid bubble models, fluid-structure interaction, hypo- and hyper-elastic materials, chemically reacting flow, two-material surface tension, magnetohydrodynamics (MHD), and more. Numerical techniques now represent the current state-of-the-art, including general relaxation characteristic boundary conditions, WENO variants, Strang splitting for stiff sub-grid flow features, and low Mach number treatments. Weak scaling to tens of thousands of GPUs on OLCF's Summit and Frontier, and LLNL's El Capitan, achieves efficiencies within 5% of ideal to over 90% of their respective system sizes. Strong scaling results for a 16-fold increase in device count show parallel efficiencies exceeding 90% on OLCF Frontier.

physics.flu-dyn

OpenACC offloading of the MFC compressible multiphase flow solver on AMD and NVIDIA GPUs

GPUs are the heart of the latest generations of supercomputers. We efficiently accelerate a compressible multiphase flow solver via OpenACC on NVIDIA and AMD Instinct GPUs. Optimization is accomplished by specifying the directive clauses 'gang vector' and 'collapse'. Further speedups of six and ten times are achieved by packing user-defined types into coalesced multidimensional arrays and manual inlining via metaprogramming. Additional optimizations yield seven-times speedup in array packing and thirty-times speedup of select kernels on Frontier. Weak scaling efficiencies of 97% and 95% are observed when scaling to 50% of Summit and 95% of Frontier. Strong scaling efficiencies of 84% and 81% are observed when increasing the device count by a factor of 8 and 16 on V100 and MI250X hardware. The strong scaling efficiency of AMD's MI250X increases to 92% when increasing the device count by a factor of 16 when GPU-aware MPI is used for communication.

physics.flu-dyn

Experiences Readying Applications for Exascale

The advent of exascale computing invites an assessment of existing best practices for developing application readiness on the world's largest supercomputers. This work details observations from the last four years in preparing scientific applications to run on the Oak Ridge Leadership Computing Facility's (OLCF) Frontier system. This paper addresses a range of topics in software including programmability, tuning, and portability considerations that are key to moving applications from existing systems to future installations. A set of representative workloads provides case studies for general system and software testing. We evaluate the use of early access systems for development across several generations of hardware. Finally, we discuss how best practices were identified and disseminated to the community through a wide range of activities including user-guides and trainings. We conclude with recommendations for ensuring application readiness on future leadership computing systems.

cs.DC

GenASiS Basics: Object-oriented utilitarian functionality for large-scale physics simulations (Version 4)

GenASiS Basics provides modern Fortran classes furnishing extensible object-oriented utilitarian functionality for large-scale physics simulations on distributed memory supercomputers. This functionality includes physical units and constants; display to the screen or standard output device; message passing; I/O to disk; and runtime parameter management and usage statistics. This revision -- Version 4 of GenASiS Basics -- includes a name change and additions to functionality, including the facilitation of direct communication between GPUs.

astro-ph.IM

Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

NVIDIA has been the main provider of GPU hardware in HPC systems for over a decade. Most applications that benefit from GPUs have thus been developed and optimized for the NVIDIA software stack. Recent exascale HPC systems are, however, introducing GPUs from other vendors, e.g. with the AMD GPU-based OLCF Frontier system just becoming available. AMD GPUs cannot be directly accessed using the NVIDIA software stack, and require a porting effort by the application developers. This paper provides an overview of our experience porting and optimizing the CGYRO code, a widely-used fusion simulation tool based on FORTRAN with OpenACC-based GPU acceleration. While the porting from the NVIDIA compilers was relatively straightforward using the CRAY compilers on the AMD systems, the performance optimization required more fine-tuning. In the optimization effort, we uncovered code sections that had performed well on NVIDIA GPUs, but were unexpectedly slow on AMD GPUs. After AMD-targeted code optimizations, performance on AMD GPUs has increased to meet our expectations. Modest speed improvements were also seen on NVIDIA GPUs, which was an unexpected benefit of this exercise.

cs.DC

Chimera: A massively parallel code for core-collapse supernova simulation

We provide a detailed description of the Chimera code, a code developed to model core collapse supernovae in multiple spatial dimensions. The core collapse supernova explosion mechanism remains the subject of intense research. Progress to date demonstrates that it involves a complex interplay of neutrino production, transport, and interaction in the stellar core, three-dimensional stellar core fluid dynamics and its associated instabilities, nuclear burning, and the foundational physics of the neutrino-stellar core weak interactions and the equations of state of all stellar core constituents -particularly, the nuclear equation of state associated with nucleons, both free and bound in nuclei. Chimera, by incorporating detailed neutrino transport, realistic neutrino-matter interactions, three-dimensional hydrodynamics, realistic nuclear, leptonic, and photonic equations of state, and a nuclear reaction network, along with other refinements, can be used to study the role of neutrino radiation, hydrodynamic instabilities, and a variety of input physics in the explosion mechanism itself. It can also be used to compute observables such as neutrino signatures, gravitational radiation, and the products of nucleosynthesis associated with core collapse supernovae. The code contains modules for neutrino transport, multidimensional compressible hydrodynamics, nuclear reactions, a variety of neutrino interactions, equations of state, and modules to provide data for post-processing observables such as the products of nucleosynthesis, and gravitational radiation. Chimera is an evolving code, being updated periodically with improved input physics and numerical refinements. We detail here the current version of the code, from which future improvements will stem, which can in turn be described as needed in future publications.

astro-ph.IM

Targeting GPUs with OpenMP Directives on Summit: A Simple and Effective Fortran Experience

We use OpenMP to target hardware accelerators (GPUs) on Summit, a newly deployed supercomputer at the Oak Ridge Leadership Computing Facility (OLCF), demonstrating simplified access to GPU devices for users of our astrophysics code GenASiS and useful speedup on a sample fluid dynamics problem. We modify our workhorse class for data storage to include members and methods that significantly streamline the persistent allocation of and association to GPU memory. Users offload computational kernels with OpenMP target directives that are rather similar to constructs already familiar from multi-core parallelization. In this initial example we ask, "With a given number of Summit nodes, how fast can we compute with and without GPUs?", and find total wall time speedups of $\sim 12\mathrm{X}$. We also find reasonable weak scaling up to 8000 GPUs (1334 Summit nodes). We make available the source code from this work at https://github.com/GenASiS/GenASiS_Basics.

physics.comp-ph

GenASiS Mathematics: Object-oriented manifolds, operations, and solvers for large-scale physics simulations

The large-scale computer simulation of a system of physical fields governed by partial differential equations requires some means of approximating the mathematical limit of continuity. For example, conservation laws are often treated with a `finite-volume' approach in which space is partitioned into a large number of small `cells,' with fluxes through cell faces providing an intuitive discretization modeled on the mathematical definition of the divergence operator. Here we describe and make available Fortran 2003 classes furnishing extensible object-oriented implementations of simple meshes and the evolution of generic conserved currents thereon, along with individual `unit test' programs and larger example problems demonstrating their use. These classes inaugurate the Mathematics division of our developing astrophysics simulation code GenASiS (General Astrophysical Simulation System), which will be expanded over time to include additional meshing options, mathematical operations, solver types, and solver variations appropriate for many multiphysics applications.

physics.comp-ph

Stochasticity and efficiency of simplified core-collapse supernova explosions

We present an initial report on 160 simulations of a highly simplified model of the post-bounce core-collapse supernova environment in three spatial dimensions (3D). We set different values of a parameter characterizing the impact of nuclear dissociation at the stalled shock in order to regulate the post-shock fluid velocity, thereby determining the relative importance of convection and the stationary accretion shock instability (SASI). While our convection-dominated runs comport with the paradigmatic notion of a `critical neutrino luminosity' for explosion at a given mass accretion rate (albeit with a nontrivial spread in explosion times just above threshold), the outcomes of our SASI-dominated runs are much more stochastic: a sharp threshold critical luminosity is `smeared out' into a rising probability of explosion over a $\sim 20\%$ range of luminosity. We also find that the SASI-dominated models are able to explode with 3 to 4 times less efficient neutrino heating, indicating that progenitor properties, and fluid and neutrino microphysics, conducive to the SASI would make the neutrino-driven explosion mechanism more robust.

astro-ph.HE

Accelerating Our Understanding of Supernova Explosion Mechanism via Simulations and Visualizations with GenASiS

Core-collapse supernovae are among the most powerful explosions in the Universe, releasing about $10^{53}~\mbox{erg}$ of energy on timescales of a few tens of seconds. These explosion events are also responsible for the production and dissemination of most of the heavy elements, making life as we know it possible. Yet exactly how they work is still unresolved. One reason for this is the sheer complexity and cost of a self-consistent, multi-physics, and multi-dimensional core-collapse supernova simulation, which is impractical, and often impossible, even on the largest supercomputers we have available today. To advance our understanding we instead must often use simplified models, teasing out the most important ingredients for successful explosions, while helping us to interpret results from higher fidelity multi-physics models. In this paper we investigate the role of instabilities in the core-collapse supernova environment. We present here simulation and visualization results produced by our code GenASiS.

astro-ph.IM

GenASiS: General Astrophysical Simulation System. II. Nonrelativistic Hydrodynamics

In this paper, the second in a series, we document the algorithms and solvers for compressible nonrelativistic hydrodynamics implemented in GenASiS (General Astrophysical Simulation System)---a new code being developed initially and primarily, though by no means exclusively, for the simulation of core-collapse supernovae. In the Mathematics division of GenASiS we introduce Solvers, which includes finite-volume updates for generic hyperbolic BalanceEquations and ordinary differential equation integration Steps. We also introduce the Physics division of GenASiS; this extends the Manifolds division of Mathematics into physical Spaces, defines StressEnergies, and combines these into Universes. We benchmark the hydrodynamics capabilities of GenASiS against many standard test problems; the results illustrate the basic competence of our implementation, demonstrate the manifest superiority of the HLLC over the HLL Riemann solver in a number of interesting cases, and provide preliminary indications of the code's ability to scale and to function with cell-by-cell fixed-mesh refinement.

astro-ph.IM

GenASiS: General Astrophysical Simulation System. I. Refinable Mesh and Nonrelativistic Hydrodynamics

GenASiS (General Astrophysical Simulation System) is a new code being developed initially and primarily, though by no means exclusively, for the simulation of core-collapse supernovae on the world's leading capability supercomputers. This paper---the first in a series---demonstrates a centrally refined coordinate patch suitable for gravitational collapse and documents methods for compressible nonrelativistic hydrodynamics. We benchmark the hydrodynamics capabilities of GenASiS against many standard test problems; the results illustrate the basic competence of our implementation, demonstrate the strengths and limitations of the HLLC relative to the HLL Riemann solver in a number of interesting cases, and provide preliminary indications of the code's ability to scale and to function with cell-by-cell fixed-mesh refinement.

astro-ph.IM

Turbulent Magnetic Field Amplification from Spiral SASI Modes: Implications for Core-Collapse Supernovae and Proto-Neutron Star Magnetization

We extend our investigation of magnetic field evolution in three-dimensional flows driven by the stationary accretion shock instability (SASI) with a suite of higher-resolution idealized models of the post-bounce core-collapse supernova environment. Our magnetohydrodynamic simulations vary in initial magnetic field strength, rotation rate, and grid resolution. Vigorous SASI-driven turbulence inside the shock amplifies magnetic fields exponentially; but while the amplified fields reduce the kinetic energy of small-scale flows, they do not seem to affect the global shock dynamics. The growth rate and final magnitude of the magnetic energy are very sensitive to grid resolution, and both are underestimated by the simulations. Nevertheless our simulations suggest that neutron star magnetic fields exceeding $10^{14}$ G can result from dynamics driven by the SASI, \emph{even for non-rotating progenitors}.

astro-ph.SR

Parallel FFT-based Poisson Solver for Isolated Three-dimensional Systems

We describe an implementation to solve Poisson's equation for an isolated system on a unigrid mesh using FFTs. The method solves the equation globally on mesh blocks distributed across multiple processes on a distributed-memory parallel computer. Test results to demonstrate the convergence and scaling properties of the implementation are presented. The solver is offered to interested users as the library PSPFFT.

physics.comp-ph

Generation of Magnetic Fields by the Stationary Accretion Shock Instability

We begin an exploration of the capacity of the stationary accretion shock instability (SASI) to generate magnetic fields by adding a weak, stationary, and radial (but bipolar) magnetic field, and in some cases rotation, to an initially spherically symmetric fluid configuration that models a stalled shock in the post-bounce supernova environment. In axisymmetric simulations we find that cycles of latitudinal flows into and radial flows out of the polar regions amplify the field parallel to the symmetry axis, typically increasing the total magnetic energy by about two orders of magnitude. Nonaxisymmetric calculations result in fundamentally different flows and a larger magnetic energy increase: shearing associated with the SASI spiral mode contributes to a widespread and turbulent field amplification mechanism, boosting the magnetic energy by almost four orders of magnitude (a result which remains very sensitive to the spatial resolution of the numerical simulations). While the SASI may contribute to neutron star magnetization, these simulations do not show qualitatively new features in the global evolution of the shock as a result of SASI-induced magnetic field amplification.

astro-ph