arXiv subjects

Liwei Ji

Publications and source records attributed to Liwei Ji.

7 recordsLinked to original sources

arXiv2026

Accelerating Numerical Relativity Simulations with New Multistep Fourth-Order Runge-Kutta Methods

Many HPC applications that solve differential equations rely on the Runge-Kutta family of methods for time integration. Among these methods, the fourth-order accurate RK4 scheme is especially popular. This time integration scheme requires applications to evaluate four intermediate stages to take one time step. Depending on the complexity of the problem being solved, the evaluation of these intermediate stages can be computationally expensive. In this paper we develop explicit fourth-order accurate Multistep Runge-Kutta (MSRK) methods. The advantage of such methods is that they re-use data from previous time steps, thus requiring fewer intermediate stage evaluations and potentially speeding up applications. We outline a procedure to obtain and tune the method's coefficients by adjusting their stability regions in an attempt to maximize the size that a time step can take. We validate and evaluate our new methods in the context of Numerical Relativity applications using the EinsteinToolkit. We believe, however, that these methods and results should generalize to other applications using explicit Runge-Kutta methods.

gr-qc↗

arXiv2025

GPU-accelerated Subcycling Time Integration with the Einstein Toolkit

Adaptive Mesh Refinement (AMR) with subcycling in time enables different grid levels to advance using their own time steps, ensuring finer grids employ smaller steps for accuracy while coarser grids take larger steps to improve computational efficiency. We present the development, validation, and performance analysis of a subcycling in time algorithm implemented within the CarpetX driver in the Einstein Toolkit framework. This new approach significantly improves upon the previous subcycling implementation in the Carpet driver by achieving higher-order convergence -- fourth order in time instead of second order -- and enhanced scaling performance. The key innovation lies in optimizing the exchange of ghost points at refinement boundaries, limiting it to the same number as those at inter-process boundaries using dense output from coarser levels, thereby reducing computational and communication overhead compared to the implementation in Carpet, which required a larger number of buffer zones. To validate the algorithm, we first demonstrate its fourth-order convergence using a scalar wave test. We then apply the algorithm to binary black hole (BBH) simulations, confirming its robustness and accuracy in a realistic astrophysical scenario. The results show excellent agreement with the well-established LazEv code. Scaling tests on CPU (Frontera) and GPU (Vista) clusters reveal significant performance gains, with the new implementation achieving improved speed and scalability compared to the Carpet-based version.

astro-ph.IM↗

arXiv2025

Neutron star evolution by combining discontinuous Galerkin and finite volume methods

We present here a new hybrid scheme that combines a discontinuous Galerkin (DG) method with compact finite volume (FV) and finite difference (FD) methods. The computational mesh is divided into smaller elements that touch but do not overlap. Like a pure DG method, our new hybrid scheme requires information exchange only at the surface of neighboring elements. This avoids the need for ghost zones that are usually many points deep in traditional FV implementations. Furthermore, unlike traditional FV implementations, that need information exchange between each element and its 26 surrounding neighbors on noncuboid meshes, our new hybrid method exchanges information only between each element and its six nearest neighbors. With this reduced communication, we aim to retain the high scalability of DG when using large supercomputers. In addition, the information exchange between adjacent elements is much simpler than in a traditional FV implementation, because we always have grid points at the interface, so that only surface interpolation is required. As a result it is much easier to implement adaptive mesh refinement. The goal is to use DG in elements with smooth matter fields and to fall back onto the more robust FV/FD method in elements that contain nonsmooth shocks or star surfaces. For this we devise trouble criteria to decide whether an element should be evolved with DG or FV/FD. We use the Nmesh program to implement and test the new scheme. We successfully evolve various single neutron star cases. These include the challenging cases of a neutron star initially in an unstable equilibrium migrating to a stable configuration and a boosted neutron star. These cases are simulated for the first time here in full 3D with general relativistic hydrodynamics using DG methods. We also describe additional numerical methods, such as the limiters and the atmosphere treatment we need for our simulations.

gr-qc↗

arXiv2025

Relativistic gas accretion onto supermassive black Hole binaries from inspiral through merger

Accreting supermassive black hole binaries are powerful multimessenger sources emitting both gravitational and EM radiation. Understanding the accretion dynamics of these systems and predicting their distinctive EM signals is crucial to informing and guiding upcoming efforts aimed at detecting gravitational waves produced by these binaries. To this end, accurate numerical modeling is required to describe both the spacetime and the magnetized gas around the black holes. In this paper, we present two key advances in this field of research. First, we have developed a novel 3D GRMHD framework that combines multiple numerical codes to simulate the inspiral and merger of supermassive black hole binaries starting from realistic initial data and running all the way through merger. Throughout the evolution, we adopt a simple but functional prescription to account for gas cooling through photon emission. Next, we have applied our new computational method to follow the time evolution of a circular, equal-mass, nonspinning black hole binary for ~200 orbits, starting from a separation of 20r_g and reaching the postmerger evolutionary stage of the system. We have shown how mass continues to flow toward the binary even after the binary "decouples" from its surrounding disk, but the accretion rate onto the black holes diminishes. We have identified how the minidisks orbiting each black hole are slowly drained and eventually dissolve as the binary compresses. We confirm previous findings that the system's luminosity decreases by a factor of a few during inspiral; however, we observe an abrupt increase by ~50% in this quantity at the time of merger, likely accompanied by an equally abrupt change in spectrum. Finally, we have demonstrated that during the inspiral, fluid ram pressure regulates the fraction of the magnetic flux transported to the binary that attaches to the black holes' horizons.

astro-ph.HE↗

arXiv2024

AsterX: a new open-source GPU-accelerated GRMHD code for dynamical spacetimes

We present AsterX, a novel open-source, modular, GPU-accelerated, fully general relativistic magnetohydrodynamic (GRMHD) code designed for dynamic spacetimes in 3D Cartesian coordinates, and tailored for exascale computing. We utilize block-structured adaptive mesh refinement (AMR) through CarpetX, the new driver for the Einstein Toolkit, which is built on AMReX, a software framework for massively parallel applications. AsterX employs the Valencia formulation for GRMHD, coupled with the Z4c formalism for spacetime evolution, while incorporating high resolution shock capturing schemes to accurately handle the hydrodynamics. AsterX has undergone rigorous testing in both static and dynamic spacetime, demonstrating remarkable accuracy and agreement with other codes in literature. Using subcycling in time, we find an overall performance gain of factor 2.5 to 4.5. Benchmarking the code through scaling tests on OLCF's Frontier supercomputer, we demonstrate a weak scaling efficiency of about 67%-77% on 4096 nodes compared to an 8-node performance.

astro-ph.HE↗

arXiv2023

Ameliorating the Courant-Friedrichs-Lewy condition in spherical coordinates: A double FFT filter method for general relativistic MHD in dynamical spacetimes

Numerical simulations of merging compact objects and their remnants form the theoretical foundation for gravitational wave and multi-messenger astronomy. While Cartesian-coordinate-based adaptive mesh refinement is commonly used for simulations, spherical-like coordinates are more suitable for nearly spherical remnants and azimuthal flows due to lower numerical dissipation in the evolution of fluid angular momentum, as well as requiring fewer numbers of computational cells. However, the use of spherical coordinates to numerically solve hyperbolic partial differential equations can result in severe Courant-Friedrichs-Lewy (CFL) stability condition timestep limitations, which can make simulations prohibitively expensive. This paper addresses this issue for the numerical solution of coupled spacetime and general relativistic magnetohydrodynamics evolutions by introducing a double FFT filter and implementing it within the fully MPI-parallelized SphericalNR framework in the Einstein Toolkit. We demonstrate the effectiveness and robustness of the filtering algorithm by applying it to a number of challenging code tests, and show that it passes these tests effectively, demonstrating convergence while also increasing the timestep significantly compared to unfiltered simulations.

gr-qc↗

arXiv2022

The new discontinuous Galerkin methods based numerical relativity program Nmesh

Interpreting gravitational wave observations and understanding the physics of astrophysical compact objects such as black holes or neutron stars requires accurate theoretical models. Here, we present a new numerical relativity computer program, called Nmesh, that has the design goal to become a next generation program for the simulation of challenging relativistic astrophysics problems such as binary black hole or neutron star mergers. In order to efficiently run on large supercomputers, Nmesh uses a discontinuous Galerkin method together with a domain decomposition and mesh refinement that parallelizes and scales well. In this work, we discuss the various numerical methods we use. We also present results of test problems such as the evolution of scalar waves, single black holes and neutron stars, as well as shock tubes. In addition, we introduce a new positivity limiter that allows us to stably evolve single neutron stars without an additional artificial atmosphere, or other more traditional limiters.

gr-qc↗