SearcharxivSearch

arXiv subjects

Markus Battarbee

Publications and source records attributed to Markus Battarbee.

14 recordsLinked to original sources

Load Balancing in Strongly Inhomogeneous Simulations -- a Vlasiator Case Study

Parallelization is a necessity for large-scale simulations due to the amount of data processed. In this article we investigate different load balancing methods using Vlasiator, a global magnetospheric simulation as our case study. The theoretical basis for load balancing is the (hyper)graph partitioning problem, modeling simulation units as vertices and their data dependencies as edges. As it is an NP-hard problem, heuristics are necessary for dynamic runtime balancing. We consider first hypergraph partitioning via an algorithm called parallel hypergraph partitioner (PHG); this is done by partitioning a simplified grid and then attempting to optimize the solution on the finer grid. The second and third are the geometric methods of recursive coordinate bisection (RCB) and recursive inertial bisection (RIB). Finally we consider the method of Hilbert space filling curves (HSFC). The algorithm projects simulation cells along a Hilbert curve and makes cuts along the curve. This works well due to the excellent locality of Hilbert curves, and can be optimized further by choice of curve. We introduce and investigate six three-dimensional Hilbert curves in total. Our findings on runs of two different scales indicate the HSFC method provides optimal load balance, followed by RIB and PHG methods and finally by RCB. Of the Hilbert curves evaluated, the Beta curve outperformed the most commonly used curve by a few percent.

cs.DC

Coalescing MPI communication in 6D Vlasov simulations: solving ghost domains in Vlasiator

High-performance computing is used for diverse simulations, some of which parallelize over the Message Passing Interface (MPI) with ease, whilst others may have challenges related to uniform balancing of computational load and communication between simulation domains. We introduce an alternative approach to solving advection equations, specifically in an application to solving the six-dimensional Vlasov equation for modelling space plasmas. Communicating larger ghost domains around the partition assigned to each MPI task and computing on these ghost cells allows for coalescing several discrete communication calls into one. This approach needs more overall data communication and computation, but provides interesting new avenues for the balancing of computational load between MPI tasks. We discuss this trade-off, how it may assist in developing other algorithmic improvements, and how the transition to heterogeneous CPU-GPU architectures may impact its usefulness.

physics.comp-ph

Porting the grid-based 3D+3V hybrid-Vlasov kinetic plasma simulation Vlasiator to heterogeneous GPU architectures

Vlasiator is a space plasma simulation code which models near-Earth ion-kinetic dynamics in three spatial and three velocity dimensions. It is highly parallelized, modeling the Vlasov equation directly through the distribution function, discretized on a Cartesian grid, instead of the more common particle-in-cell approach. Modeling near-Earth space, plasma properties span several orders of magnitude in temperature, density, and magnetic field strength. In order to fit the required six-dimensional grids in memory, Vlasiator utilizes a sparse block-based velocity mesh, where chunks of velocity space are added or deleted based on the advection requirements of the Vlasov solver. In addition, the spatial mesh is adaptively refined through cell-based octree refinement. In this paper, we describe the design choices of porting Vlasiator to heterogeneous CPU/GPU architectures. We detail the memory management, algorithmic changes, and kernel construction as well as our unified codebase approach, resulting in portability to both NVIDIA and AMD hardware (CUDA and HIP languages, respectively). In particular, we showcase a highly parallel block adjustment approach allowing efficient re-ordering of a sparse velocity mesh. We detail pitfalls we have overcome and lay out a plan for optimization to facilitate future exascale simulations using multi-node GPU supercomputing.

physics.comp-ph

Hybrid-Vlasov simulation of soft X-ray emissions at the Earth's dayside magnetospheric boundaries

Solar wind charge exchange produces emissions in the soft X-ray energy range which can enable the study of near-Earth space regions such as the magnetopause, the magnetosheath and the polar cusps by remote sensing techniques. The Solar wind-Magnetosphere-Ionosphere Link Explorer (SMILE) and Lunar Environment heliospheric X-ray Imager (LEXI) missions aim to obtain soft X-ray images of near-Earth space thanks to their Soft X-ray Imager (SXI) instruments. While earlier modeling works have already simulated soft X-ray images as might be obtained by SMILE SXI during its mission, the numerical models used so far are all based on the magnetohydrodynamics description of the space plasma. To investigate the possible signatures of ion-kinetic-scale processes in soft X-ray images, we use for the first time a global hybrid-Vlasov simulation of the geospace from the Vlasiator model. The simulation is driven by fast and tenuous solar wind conditions and purely southward interplanetary magnetic field. We first produce global X-ray images of the dayside near-Earth space by placing a virtual imaging satellite at two different locations, providing meridional and equatorial views. We then analyze regional features present in the images and show that they correspond to signatures in soft X-ray emissions of mirror-mode wave structures in the magnetosheath and flux transfer events (FTEs) at the magnetopause. Our results suggest that, although the time scales associated with the motion of those transient phenomena will likely be significantly smaller than the integration time of the SMILE and LEXI imagers, mirror-mode structures and FTEs can cumulatively produce detectable signatures in the soft X-ray images. [...]

physics.space-ph

First 3D hybrid-Vlasov global simulation of auroral proton precipitation and comparison with satellite observations

The precipitation of charged particles from the magnetosphere into the ionosphere is one of the crucial coupling mechanisms between these two regions of geospace and is associated with multiple space weather effects, such as global navigation satellite system signal disruption and geomagnetically induced currents at ground level. While precipitating particle fluxes have been measured by numerous spacecraft missions over the past decades, it often remains difficult to obtain global precipitation patterns with a good time resolution during a substorm. Numerical simulations can help to bridge this gap and improve the understanding of mechanisms leading to particle precipitation at high latitudes through the global view they offer on the near-Earth space system. We present the first results on auroral (0.5-50 keV) proton precipitation within a 3-dimensional simulation of the Vlasiator hybrid-Vlasov model. The run is driven by southward interplanetary magnetic field conditions with constant solar wind parameters. We find that, on the dayside, cusp proton precipitation exhibits the expected energy-latitude dispersion and takes place in the form of successive bursts associated with the transit of flux transfer events formed through dayside magnetopause reconnection. On the nightside, the precipitation takes place within the expected range of geomagnetic latitudes, and it appears clearly that the precipitating particle injection is taking place within a narrow magnetic local time span, associated with fast Earthward plasma flows in the near-Earth magnetotail. Finally, the simulated precipitating fluxes are compared to observations from Defense Meteorological Satellite Program spacecraft during driving conditions similar to those in the simulation and are found to be in good agreement with the measurements.

physics.space-ph

Comprehensive Characterization of Solar Eruptions With Remote and In-Situ Observations, and Modeling: The Major Solar Events on 4 November 2015

Solar energetic particles (SEPs) are an important product of solar activity. They are connected to solar active regions and flares, coronal mass ejections (CMEs), EUV waves, shocks, Type II and III radio emissions, and X-ray bursts. These phenomena are major probes of the partition of energy in solar eruptions, as well as for the organization, dynamics, and relaxation of coronal and interplanetary magnetic fields. Many of these phenomena cause terrestrial space weather, posing multiple hazards for humans and their technology from space to the ground. Since particular flares, shocks, CMEs, and EUV waves produce SEP events but others do not, since propagation effects from the low corona to 1 AU appear important for some events but not others, and since Type II and III radio emissions and X-ray bursts are sometimes produced by energetic particles leaving these acceleration sites, it is necessary to study the whole system with a multi-frequency and multi-instrument perspective that combines both in-situ and remote observations with detailed modelling of phenomena. This article demonstrates this comprehensive approach, and shows its necessity, by analysing a trio of unusual and striking solar eruptions, radio and X-ray bursts, and SEP events that occurred on 4 November 2015. These events show both strong similarities and differences from standard events and each other, despite having very similar interplanetary conditions and only two are sites and CME genesis regions. They are therefore major targets for further in-depth observational studies, and for testing both existing and new theories and models. Based on the very limited modelling available we identify the aspects that are and are not understood, and we discuss ideas that may lead to improved understanding of the SEP, radio, and space-weather events.

astro-ph.SR

Vlasov methods in space physics and astrophysics

This paper reviews Vlasov-based numerical methods used to model plasma in space physics and astrophysics. Plasma consists of collectively behaving charged particles that form the major part of baryonic matter in the Universe. Many concepts ranging from our own planetary environment to the Solar system and beyond can be understood in terms of kinetic plasma physics, represented by the Vlasov equation. We introduce the physical basis for the Vlasov system, and then outline the associated numerical methods that are typically used. A particular application of the Vlasov system is Vlasiator, the world's first global hybrid-Vlasov simulation for the Earth's magnetic domain, the magnetosphere. We introduce the design strategies for Vlasiator and outline its numerical concepts ranging from solvers to coupling schemes. We review Vlasiator's parallelisation methods and introduce the used high-performance computing (HPC) techniques. A short review of verification, validation and physical results is included. The purpose of the paper is to present the Vlasov system and introduce an example implementation, and to illustrate that even with massive computational challenges, an accurate description of physics can be rewarding in itself and significantly advance our understanding. Upcoming supercomputing resources are making similar efforts feasible in other fields as well, making our design options relevant for others facing similar challenges.

physics.space-ph

Modelling Solar Energetic Particle transport near a wavy Heliospheric Current Sheet

Understanding the transport of Solar Energetic Particles (SEPs) from acceleration sites at the Sun into interplanetary space and to the Earth is an important question for forecasting space weather. The Interplanetary Magnetic Field (IMF), with two distinct polarities and a complex structure, governs energetic particle transport and drifts. We analyse for the first time the effect of a wavy Heliospheric Current Sheet (HCS) on the propagation of SEPs. We inject protons close to the Sun and propagate them by integrating fully 3D trajectories within the inner heliosphere in the presence of weak scattering. We model the HCS position using fits based on neutral lines of magnetic field source surface maps (SSMs). We map 1 au proton crossings, which show efficient transport in longitude via HCS, depending on the location of the injection region with respect to the HCS. For HCS tilt angles around $30^\circ-40^\circ$, we find significant qualitative differences between A+ and A$-$ configurations of the IMF, with stronger fluences along the HCS in the former case but with a distribution of particles across a wider range of longitudes and latitudes in the latter. We show how a wavy current sheet leads to longitudinally periodic enhancements in particle fluence. We show that for an A+ IMF configuration, a wavy HCS allows for more proton deceleration than a flat HCS. We find that A$-$ IMF configurations result in larger average fluences than A+ IMF configurations, due to a radial drift component at the current sheet.

physics.space-ph

Solar Energetic Particle transport near a Heliospheric Current Sheet

Solar Energetic Particles (SEPs), a major component of space weather, propagate through the interplanetary medium strongly guided by the Interplanetary Magnetic Field (IMF). In this work, we analyse the implications a flat Heliospheric Current Sheet (HCS) has on proton propagation from SEP release sites to the Earth. We simulate proton propagation by integrating fully 3-D trajectories near an analytically defined flat current sheet, collecting comprehensive statistics into histograms, fluence maps and virtual observer time profiles within an energy range of 1--800 MeV. We show that protons experience significant current sheet drift to distant longitudes, causing time profiles to exhibit multiple components, which are a potential source of confusing interpretation of observations. We find that variation of current sheet thickness within a realistic parameter range has little effect on particle propagation. We show that IMF configuration strongly affects deceleration of protons. We show that in our model, the presence of a flat equatorial HCS in the inner heliosphere limits the crossing of protons into the opposite hemisphere.

physics.space-ph

Self-consistent Monte Carlo simulations of proton acceleration in coronal shocks: Effect of anisotropic pitch-angle scattering of particles

Context. Solar energetic particles observed in association with coronal mass ejections (CMEs) are produced by the CME-driven shock waves. The acceleration of particles is considered to be due to diffusive shock acceleration (DSA). Aims. We aim at a better understanding of DSA in the case of quasi-parallel shocks, in which self-generated turbulence in the shock vicinity plays a key role. Methods. We have developed and applied a new Monte Carlo simulation code for acceleration of protons in parallel coronal shocks. The code performs a self-consistent calculation of resonant interactions of particles with Alfvén waves based on the quasi-linear theory. In contrast to the existing Monte Carlo codes of DSA, the new code features the full quasi-linear resonance condition of particle pitch-angle scattering. This allows us to take anisotropy of particle pitch-angle scattering into account, while the older codes implement an approximate resonance condition leading to isotropic scattering.We performed simulations with the new code and with an old code, applying the same initial and boundary conditions, and have compared the results provided by both codes with each other, and with the predictions of the steady-state theory. Results. We have found that anisotropic pitch-angle scattering leads to less efficient acceleration of particles than isotropic. However, extrapolations to particle injection rates higher than those we were able to use suggest the capability of DSA to produce relativistic particles. The particle and wave distributions in the foreshock as well as their time evolution, provided by our new simulation code, are significantly different from the previous results and from the steady-state theory. Specifically, the mean free path in the simulations with the new code is increasing with energy, in contrast to the theoretical result.

physics.space-ph

Injection of thermal and suprathermal seed particles into coronal shocks of varying obliquity

Context: Diffusive shock acceleration in the solar corona can accelerate solar energetic particles to very high energies. Acceleration efficiency is increased by entrapment through self-generated waves, which is highly dependent on the amount of accelerated particles. This, in turn, is determined by the efficiency of particle injection into the acceleration process. Aims: We present an analysis of the injection efficiency at coronal shocks of varying obliquity. We assessed injection through reflection and downstream scattering, including the effect of a cross-shock potential. Both quasi-thermal and suprathermal seed populations were analysed. We present results on the effect of cross-field diffusion downstream of the shock on the injection efficiency. Methods: Using analytical methods, we present applicable injection speed thresholds that were compared with both semi-analytical flux integration and Monte Carlo simulations, which do not resort to binary thresholds. Shock-normal angle and shock-normal velocity were varied to assess the injection efficiency with respect to these parameters. Results: We present evidence of a significant bias of thermal seed particle injection at small shock-normal angles. We show that downstream isotropisation methods affect the theta-dependence of this result. We show a non-negligible effect caused by the cross-shock potential, and that the effect of downstream cross-field diffusion is highly dependent on boundary definitions. Conclusions: Our results show that for Monte Carlo simulations of coronal shock acceleration a full distribution function assessment with downstream isotropisation through scatterings is necessary to realistically model particle injection. Based on our results, seed particle injection at quasi-parallel coronal shocks can result in significant acceleration efficiency, especially when combined with varying field-line geometry.

astro-ph.SR

Particle scattering in turbulent plasmas with amplified wave modes

High-energy particles stream during coronal mass ejections or flares through the plasma of the solar wind. This causes instabilities, which lead to wave growth at specific resonant wave numbers, especially within shock regions. These amplified wave modes influence the turbulent scattering process significantly. In this paper, results of particle transport and scattering in turbulent plasmas with excited wave modes are presented. The method used is a hybrid simulation code, which treats the heliospheric turbulence by an incompressible magnetohydrodynamic approach separately from a kinetic particle description. Furthermore, a semi-analytical model using quasilinear theory (QLT) is compared to the numerical results. This paper aims at a more fundamental understanding and interpretation of the pitch-angle scattering coefficients. Our calculations show a good agreement of particle simulations and the QLT for broad-band turbulent spectra; for higher turbulence levels and particle beam driven plasmas, the QLT approximation gets worse. Especially the resonance gap at $μ=0$ poses a well-known problem for QLT for steep turbulence spectra, whereas test-particle computations show no problems for the particles to scatter across this region. The reason is that the sharp resonant wave--particle interactions in QLT are an oversimplification of the broader resonances in test-particle calculations, which result from nonlinear effects not included in the QLT. We emphasise the importance of these results for both numerical simulations and analytical particle transport approaches, especially the validity of the QLT.

astro-ph.SR

Heavy-ion Acceleration and Self-generated Waves in Coronal Shocks

Context: Acceleration in coronal mass ejection driven shocks is currently considered the primary source of large solar energetic particle events. Aims: The solar wind, which feeds shock-accelerated particles, includes numerous ion populations, which offer much insight into acceleration processes. We present first simulations of shock-accelerated minor ions, in order to explore trapping dynamics and acceleration timescales in detail. Methods: We have simulated diffusive shock acceleration of minor ions (3He2+, 4He2+, 16O6+ and 56Fe14+) and protons using a Monte Carlo method, where self-generated Alfvénic turbulence allows for repeated shock crossings and acceleration to high energies. Results: We present the effect of minor ions on wave generation, especially at low wavenumbers, and show that it is significant. We find that maximum ion energy is determined by the competing effects of particle escape due to focusing in an expanding flux tube and trapping due to the amplified turbulence. We show the dependence of cut-off energy on the particle charge to mass ratio to be approximately (Q/A)^1.5. Conclusions: We suggest that understanding the acceleration of minor ions at coronal shocks requires simulations which allow us to explore trapping dynamics and acceleration timescales in detail, including evolution of the turbulent trapping boundary. We conclude that steady-state models do not adequately describe the acceleration of heavy ions in coronal shocks.

astro-ph.SR

Acceleration of Energetic Particles Through Self-Generated Waves in a Decelerating Coronal Shock

We have developed a simulation model of particle acceleration in coronal shock waves. The model is based on a Monte Carlo method, where particles are traced in prescribed large-scale electromagnetic fields utilizing the guiding center approximation. The particles are scattered in the turbulence according to quasilinear theory, with the scattering amplitude directly proportional to the intensity of Alfvén waves at gyro-resonant wavenumbers. The Alfvén waves are traced simultaneously with the particles, so that the wave field is propagated outwards from the Sun using WKB propagation supplemented with a phenomenological wavenumber diffusion term and a growth rate computed from the net flux of the accelerated particles. We consider initial wave amplitudes small enough to allow rapid escape of particles from the shock to the ambient medium. Thus, in our model the Alfvén waves responsible for the diffusive acceleration of particles are generated by the accelerated particles themselves. In this work, we study the effects of non-constant shock velocity and non-monotonic Alfvén velocity on particle acceleration scenarios. We report in particular how the deceleration of a shock affects particle intensity and turbulence power evolution in the vicinity of the shock.

astro-ph.SR