SearcharxivSearch

arXiv subjects

Leslie Greengard

Publications and source records attributed to Leslie Greengard.

At least 19 recordsLinked to original sources

An Adaptive Fast Algorithm for Periodic Coulomb Lattice Sums in Arbitrary Unit Cells

We present a fast algorithm for evaluating conditionally convergent Coulomb lattice sums, governed by the Laplace equation with periodic boundary conditions on arbitrary unit cells (oblique in 2D, triclinic in 3D) and arbitrary particle distributions. The algorithm extends the dual-space multilevel kernel-splitting (DMK) framework to this context. The root of the adaptive tree is now a rectangular grid of cubes consisting of an inner block covering the unit cell and a surrounding halo of image cubes, rather than a single cube, and the smooth top-level periodic kernel -- the only term that requires the consideration of conditional convergence issues -- is evaluated by the ``five-step procedure" used in fast Ewald summation: spreading, fast Fourier transform (FFT), diagonal scaling, inverse FFT, and interpolation. The resulting complexity is $O(N)$ for fixed cell shape. Benchmarked against the periodic fast multipole method on highly nonuniform source distributions, our 2D algorithm is roughly an order of magnitude faster across particle counts and target precisions; in three dimensions, it is often as fast as the free-space DMK on the same sources, even for triclinic cells with edge-length ratios up to roughly $17$.

math.NA

Accelerating Molecular Dynamics Simulations using Fast Ewald Summation with Prolates

The evaluation of long-range Coulomb interactions is a significant cost in molecular dynamics (MD), even when using Particle Mesh Ewald (PME) or Particle-Particle-Particle-Mesh (PPPM) methods, which rely on Ewald splitting and the fast Fourier transform to achieve near-linear scaling. We introduce ESP -- Ewald summation with prolate spheroidal wave functions (PSWFs) -- which leads to a more efficient Fourier representation and a reduction in the required grid size, global communication, and particle-grid operations, without loss of accuracy. We have integrated the ESP method into two widely-used open-source MD packages, LAMMPS and GROMACS, enabling rapid comparison and adoption. Relative to PME/PPPM baselines at error tolerances $10^{-3}$ to $10^{-4}$, ESP gives roughly a $3$-fold acceleration of electrostatic interactions, and a $2.5$-fold speed-up in the MD simulation when using about $10^3$ compute cores. At high accuracy ($10^{-5}$), these increase to $10$-fold for the far-field electrostatics and $5$-fold for MD simulation. Furthermore, we show that the accelerated codes have improved strong scaling with core count, and validate them in realistic long-time biological and material simulations. ESP thus offers a practical, drop-in path to reduce the time-to-solution and energy footprint of MD workflows.

math.NA

A spectral method for the rapid evaluation of hyperbolic potentials in two dimensions using windowed Fourier projection

We present a fast algorithm for evaluating the (non-smooth) solution of the free-space two-dimensional (2D) scalar wave equation with many point sources, each with a high-frequency band-limited time signature. Such an algorithm is key to an efficient time-domain scattering solver using spatially-discretized hyperbolic layer potentials. Given $M$ sources/targets and $N_t$ time steps, direct evaluation costs $O(M^2N_t^2)$, due to the history dependence. We develop a quasi-linear scaling algorithm that splits the solution at a given time into (a) a non-smooth time-local part, (b) a (smooth) near history involving sources up to ${\mathcal O}(1)$ domain traversal times into the past, plus (c) a (very smooth) far history comprising all waves emitted before the near history. The local part is computed directly via high-order quadrature. A naive spatial Fourier transform for (b) plus (c) would be both slowly converging and arbitrarily oscillatory as time progresses. Yet in (b) the oscillations are controlled, so we use the recent truncated windowed Fourier projection (TK-WFP) method to give rapid convergence. For (c) -- present due to the weak Huygens' principle -- we exploit a new large-time sum-of-exponentials approximation of the free-space wave kernel. Numerical examples with up to a million sources and targets, a domain of $300\times 300$ wavelengths, and 6-digit accuracy, show an acceleration of five orders of magnitude relative to direct evaluation.

math.NA

Interpolative separable density fitting on adaptive real space grids

We generalize the interpolative separable density fitting (ISDF) method, used for compressing the four-index electron repulsion integral (ERI) tensor, to incorporate adaptive real space grids for potentially highly localized single-particle basis functions. To do so, we employ a fast adaptive algorithm, the recently-introduced dual-space multilevel kernel-splitting method, to solve the Poisson equation for the ISDF auxiliary basis functions. The adaptive grids are generated using a high-order accurate, black-box procedure that satisfies a user-specified error tolerance. Our algorithm relies on the observation, which we prove, that an adaptive grid resolving the pair densities appearing in the ERI tensor can be straightforwardly constructed from one that resolves the single-particle basis functions, with the number of required grid points differing only by a constant factor. We find that the ISDF compression efficiency for the ERI tensor with highly localized basis sets is comparable to that for smoother basis sets compatible with uniform grids. To demonstrate the performance of our procedure, we consider several molecular systems with all-electron basis sets which are intractable using uniform grid-based methods. Our work establishes a pathway for scalable many-body electronic structure simulations with arbitrary smooth basis functions, making simulations of phenomena like core-level excitations feasible on a large scale.

physics.comp-ph

Space-time adaptive methods for parabolic evolution equations

We present a family of integral equation-based solvers for the heat equation, reaction-diffusion systems, the unsteady Stokes equation and the incompressible Navier-Stokes equations in two space dimensions. Our emphasis is on the development of methods that can efficiently follow complex solution features in space-time by refinement and coarsening at each time step on an adaptive quadtree. For simplicity, we focus on problems posed in a square domain with periodic boundary conditions. The performance and robustness of the methods are illustrated with several numerical examples.

math.NA

Truncated kernel windowed Fourier projection: a fast algorithm for the 3D free-space wave equation

We present a spectrally accurate fast algorithm for evaluating the solution to the scalar wave equation in free space driven by a large collection of point sources in a bounded domain. With $M$ sources temporally discretized by $N_t$ time steps of size $Δt$, a naive potential evaluation at $M$ targets on the same time grid requires $\mathcal O(M^2 N_t)$ work. Our scheme requires $\mathcal{O}\left((M + N^3\log N)N_t\right)$ work, where $N$ scales as $\mathcal O(1/Δt)$, i.e., the maximum signal frequency. This is achieved by using the recently-proposed windowed Fourier projection (WFP) method to split the potential into a local part, evaluated directly, plus a smooth history part approximated by an $N^3$-point equispaced discretization of the Fourier transform, where each Fourier coefficient obeys a simple recursion relation. The growing oscillations in the spectral representation (which would be present with a naive use of the Fourier transform) are controlled by spatially truncating the hyperbolic Green's function itself. Thus, the method avoids the need for absorbing boundary conditions. We demonstrate the performance of our algorithm with up to a million sources and targets at 6-digit accuracy. We believe it can serve as a key component in addressing time-domain wave equation scattering problems.

math.NA

Fast Multipole Method with Complex Coordinates

In this work we present a variant of the fast multipole method (FMM) for efficiently evaluating standard layer potentials on geometries with complex coordinates in two and three dimensions. The complex scaled boundary integral method for the efficient solution of scattering problems on unbounded domains results in complex point locations upon discretization. Classical real-coordinate FMMs are no longer applicable, hindering the use of this approach for large-scale problems. Here we develop the complex-coordinate FMM based on the analytic continuation of certain special function identities used in the construction of the classical FMM. To achieve the same linear time complexity as the classical FMM, we construct a hierarchical tree based solely on the real parts of the complex point locations, and derive convergence rates for truncated expansions when the imaginary parts of the locations are a Lipschitz function of the corresponding real parts. We demonstrate the efficiency of our approach through several numerical examples and illustrate its application for solving large-scale time-harmonic water wave problems and Helmholtz transmission problems.

math.NA

Fast summation of Stokes potentials using a new kernel-splitting in the DMK framework

Classical Ewald methods for Coulomb and Stokes interactions rely on ``kernel-splitting," using decompositions based on Gaussians to divide the resulting potential into a near field and a far field component. Here, we show that a more efficient splitting for the scalar biharmonic Green's function can be derived using zeroth-order prolate spheroidal wave functions (PSWFs), which in turn yields new efficient splittings for the Stokeslet, stresslet, and elastic kernels, since these Green's tensors can all be derived from the biharmonic kernel. This benefits all fast summation methods based on kernel splitting, including FFT-based Ewald summation methods, that are suitable for uniform point distributions, and DMK-based methods that allow for nonuniform point distributions. The DMK (dual-space multilevel kernel-splitting) algorithm we develop here is fast, adaptive, and linear-scaling, both in free space and in a periodic cube. We demonstrate its performance with numerical examples in two and three dimensions.

math.NA

Scattering theory for Stokes flow in complex branched structures

Slow, viscous flow in branched structures arises in many biological and engineering settings. Direct numerical simulation of flow in such complicated multi-scale geometry, however, is a computationally intensive task. We propose a scattering theory framework that dramatically reduces this cost by decomposing networks into components connected by short straight channels. Exploiting the phenomenon of rapid return to Poiseuille flow (Saint-Venant's principle in the context of elasticity), we compute a high-order accurate scattering matrix for each component via boundary integral equations. These precomputed components can then be assembled into arbitrary branched structures, and the precomputed local solutions on each component can be assembled into an accurate global solution. The method is modular, has negligible cost, and appears to be the first full-fidelity solver that makes use of the return to Poiseuille flow phenomenon. In our two-dimensional examples, it matches the accuracy of full-domain solvers while requiring only a fraction of the computational effort.

math.NA

Fast adaptive high-order integral equation methods for electromagnetic scattering from smooth perfect electric conductors

Many integral equation-based methods are available for problems of time-harmonic electromagnetic scattering from perfect electric conductors. Among the many challenges that arise in such calculations are the avoidance of spurious resonances, robustness of the method to scatterers of non-trivial topology or multiscale features, stability under mesh refinement, ease of implementation with high-order basis functions, and behavior in the static limit. Since three-dimensional scattering is a challenging, large-scale problem, many of these issues have been historically difficult to investigate. It is only with the advent of fast algorithms for matrix-vector multiplies coupled with modern iterative methods that a careful study of these issues can be carried out effectively. Our focus here is on comparing the behavior of several integral equation formulations with regard to the issues noted above, namely: the well-known, standard electric, magnetic, and combined field integral equations with standard RWG basis functions, and the more modern non-resonant charge-current and decoupled potential integral equation. Numerical results are provided to demonstrate the behavior of each of these schemes. Furthermore, we provide some analytical properties and comparisons with the electric charge-current integral equation and the augmented regularized combined source integral equation.

math.NA

A fast algorithm for the wave equation using time-windowed Fourier projection

We introduce a new arbitrarily high-order method for the rapid evaluation of hyperbolic potentials (space-time integrals involving the Green's function for the scalar wave equation). With $M$ points in the spatial discretization and $N_t$ time steps of size $Δt$, a naive implementation would require $\mathcal O(M^2N_t^2)$ work in dimensions where the weak Huygens' principle applies. We avoid this all-to-all interaction using a smoothly windowed decomposition into a local part, treated directly, plus a history part, approximated by a $N_F$-term Fourier series. In one dimension, our method requires $\mathcal O\left((M + N_F \log N_F)N_t\right)$ work, with $N_F =\mathcal O(1/Δt)$, by exploiting the non-uniform fast Fourier transform. We demonstrate the method's performance for time-domain scattering problems involving a large number $M$ of springs (point scatterers) attached to a vibrating string at arbitrary locations, with either periodic or free-space boundary conditions. We typically achieve 10-digit accuracy, and include tests for $M$ up to a million.

math.NA

Coordinate complexification for the Helmholtz equation with Dirichlet boundary conditions in a perturbed half-space

We present a new complexification scheme based on the classical double layer potential for the solution of the Helmholtz equation with Dirichlet boundary conditions in compactly perturbed half-spaces in two and three dimensions. The kernel for the double layer potential is the normal derivative of the free-space Green's function, which has a well-known analytic continuation into the complex plane as a function of both target and source locations. Here, we prove that - when the incident data are analytic and satisfy a precise asymptotic estimate - the solution to the boundary integral equation itself admits an analytic continuation into specific regions of the complex plane, and satisfies a related asymptotic estimate (this class of data includes both plane waves and the field induced by point sources). We then show that, with a carefully chosen contour deformation, the oscillatory integrals are converted to exponentially decaying integrals, effectively reducing the infinite domain to a domain of finite size. Our scheme is different from existing methods that use complex coordinate transformations, such as perfectly matched layers, or absorbing regions, such as the gradual complexification of the governing wavenumber. More precisely, in our method, we are still solving a boundary integral equation, albeit on a truncated, complexified version of the original boundary. In other words, no volumetric/domain modifications are introduced. The scheme can be extended to other boundary conditions, to open wave guides and to layered media. We illustrate the performance of the scheme with two and three dimensional examples.

math.NA

A Lightweight, Geometrically Flexible Fast Algorithm for the Evaluation of Layer and Volume Potentials

Over the last two decades, several fast, robust, and high-order accurate methods have been developed for solving the Poisson equation in complicated geometry using potential theory. In this approach, rather than discretizing the partial differential equation itself, one first evaluates a volume integral to account for the source distribution within the domain, followed by solving a boundary integral equation to impose the specified boundary conditions. Here, we present a new fast algorithm which is easy to implement and compatible with virtually any discretization technique, including unstructured domain triangulations, such as those used in standard finite element or finite volume methods. Our approach combines earlier work on potential theory for the heat equation, asymptotic analysis, the nonuniform fast Fourier transform (NUFFT), and the dual-space multilevel kernel-splitting (DMK) framework. It is insensitive to flaws in the triangulation, permitting not just nonconforming elements, but arbitrary aspect ratio triangles, gaps and various other degeneracies. On a single CPU core, the scheme computes the solution at a rate comparable to that of the fast Fourier transform (FFT) in work per gridpoint.

math.NA

On the construction of scattering matrices for irregular or elongated enclosures using Green's representation formula

Multiple scattering methods are widely used to reduce the computational complexity of acoustic or electromagnetic scattering problems when waves propagate through media containing many identical inclusions. Historically, this numerical technique has been limited to situations in which the inclusions (particles) can be covered by nonoverlapping disks in two dimensions or spheres in three dimensions. This allows for the use of separation of variables in cylindrical or spherical coordinates to represent the solution to the governing partial differential equation. Here, we provide a more flexible approach, applicable to a much larger class of geometries. We use a Green's representation formula and the associated layer potentials to construct incoming and outgoing solutions on rectangular enclosures. The performance and flexibility of the resulting scattering operator formulation in two-dimensions is demonstrated via several numerical examples for multi-particle scattering in free space as well as in layered media. The mathematical formalism extends directly to the three dimensional case as well, and can easily be coupled with several commercial numerical PDE software packages.

math.NA

Differentiable Cosmological Simulation with Adjoint Method

Rapid advances in deep learning have brought not only myriad powerful neural networks, but also breakthroughs that benefit established scientific research. In particular, automatic differentiation (AD) tools and computational accelerators like GPUs have facilitated forward modeling of the Universe with differentiable simulations. Based on analytic or automatic backpropagation, current differentiable cosmological simulations are limited by memory, and thus are subject to a trade-off between time and space/mass resolution, usually sacrificing both. We present a new approach free of such constraints, using the adjoint method and reverse time integration. It enables larger and more accurate forward modeling at the field level, and will improve gradient based optimization and inference. We implement it in an open-source particle-mesh (PM) $N$-body library pmwd (particle-mesh with derivatives). Based on the powerful AD system JAX, pmwd is fully differentiable, and is highly performant on GPUs.

astro-ph.IM

A Dual-space Multilevel Kernel-splitting Framework for Discrete and Continuous Convolution

We introduce a new class of multilevel, adaptive, dual-space methods for computing fast convolutional transforms. These methods can be applied to a broad class of kernels, from the Green's functions for classical partial differential equations (PDEs) to power functions and radial basis functions such as those used in statistics and machine learning. The DMK (dual-space multilevel kernel-splitting) framework uses a hierarchy of grids, computing a smoothed interaction at the coarsest level, followed by a sequence of corrections at finer and finer scales until the problem is entirely local, at which point direct summation is applied. The main novelty of DMK is that the interaction at each scale is diagonalized by a short Fourier transform, permitting the use of separation of variables, but without requiring the FFT for its asymptotic performance. The DMK framework substantially simplifies the algorithmic structure of the fast multipole method (FMM) and unifies the FMM, Ewald summation, and multilevel summation, achieving speeds comparable to the FFT in work per gridpoint, even in a fully adaptive context. For continuous source distributions, the evaluation of local interactions is further accelerated by approximating the kernel at the finest level as a sum of Gaussians with a highly localized remainder. The Gaussian convolutions are calculated using tensor product transforms, and the remainder term is calculated using asymptotic methods. We illustrate the performance of DMK for both continuous and discrete sources with extensive numerical examples in two and three dimensions.

math.NA

Robust ab initio solution of the cryo-EM reconstruction problem at low resolution with small data sets

Single particle cryo-electron microscopy has become a critical tool in structural biology over the last decade, able to achieve atomic scale resolution in three dimensional models from hundreds of thousands of (noisy) two-dimensional projection views of particles frozen at unknown orientations. This is accomplished by using a suite of software tools to (i) identify particles in large micrographs, (ii) obtain low-resolution reconstructions, (iii) refine those low-resolution structures, and (iv) finally match the obtained electron scattering density to the constituent atoms that make up the macromolecule or macromolecular complex of interest. Here, we focus on the second stage of the reconstruction pipeline: obtaining a low resolution model from picked particle images. Our goal is to create an algorithm that is capable of ab initio reconstruction from small data sets (on the order of a few thousand selected particles). More precisely, we propose an algorithm that is robust, automatic, and fast enough that it can potentially be used to assist in the assessment of particle quality as the data is being generated during the microscopy experiment.

math.NA

A new version of the adaptive fast Gauss transform for discrete and continuous sources

We present a new version of the fast Gauss transform (FGT) for discrete and continuous sources. Classical Hermite expansions are avoided entirely, making use only of the plane-wave representation of the Gaussian kernel and a new hierarchical merging scheme. For continuous source distributions sampled on adaptive tensor-product grids, we exploit the separable structure of the Gaussian kernel to accelerate the computation. For discrete sources, the scheme relies on the nonuniform fast Fourier transform (NUFFT) to construct near field plane wave representations. The scheme has been implemented for either free-space or periodic boundary conditions. In many regimes, the speed is comparable to or better than that of the conventional FFT in work per gridpoint, despite being fully adaptive.

math.NA