Searcharxiv⌕ Search

arXiv subjects

Jörn Zimmerling

Publications and source records attributed to Jörn Zimmerling.

17 recordsLinked to original sources

Adapting the Lanczos algorithm to matrices with almost continuous spectra

We consider approximating $B^T(A+sI)^{-1}B$, where $A\in\mathbb{R}^{n\times n}$ is large, symmetric positive definite, and $B\in\mathbb{R}^{n\times p}$ with $p\ll n$. We focus on the case where $A$ has an almost continuous (dense) spectrum: its eigenvalues fill one or more intervals so densely that Krylov methods cannot resolve them individually. Our target is computing multiple-input multiple-output transfer functions arising from large-scale discretizations of problems with continuous spectral measures, such as linear time-invariant PDEs on unbounded domains. Traditional Krylov methods, such as Lanczos or conjugate gradients, resolve individual eigenvalues of a dense discretization while ignoring the underlying continuous spectral measure these points approximate. We argue it is more efficient to model the operator's inherent branch cut than to exhaustively resolve the artificial point spectrum induced by discretization. We adapt the framework of Kreĭn-Nudelman semi-infinite strings to the block Lanczos algorithm, with parameters chosen adaptively by maximizing the energy absorbed at the string termination relative to the energy stored in the string. This yields a low-rank modification to the block Lanczos matrix, dependent on $\sqrt{s}$, at an additional $O(n)$ cost. We show significant error reductions for large-scale self-adjoint PDE discretizations in unbounded domains, including two- and three-dimensional Maxwell's equations in diffusive regimes. The method is especially advantageous for computing state-space solutions for wave propagation, specifically for 2D wave and 3D Maxwell operators. Replacing the conventional Lanczos spectral decomposition with the continuous Kreĭn-Nudelman spectrum yields a qualitative improvement in finite-difference approximations, transforming standing-wave artifacts into outgoing propagating waves.

math.NA↗

Quantitative synthetic aperture radar inversion

We study an inverse scattering problem for monostatic synthetic aperture radar (SAR): Estimate the wave speed in a heterogeneous, isotropic and nonmagnetic medium probed by waves emitted and measured by a moving antenna. The forward map, from the wave speed to the measurements, is derived from Maxwell's equations. It is a nonlinear map that accounts for multiple scattering and it is very oscillatory at high frequencies. This makes the standard, nonlinear least squares data fitting formulation of the inverse problem difficult to solve. We introduce an alternative, two-step approach: The first step computes the nonlinear map from the measurements to an approximation of the electric field inside the unknown medium aka, the internal wave. This is done for each antenna location in a non-iterative manner. The internal wave fits the data by construction, but it does not solve Maxwell's equations. The second step uses optimization to minimize the discrepancy between the internal wave and the solution of Maxwell's equations, for all antenna locations. The optimization is iterative. The first step defines an imaging function whose computational cost is comparable to that of standard SAR imaging, but it gives a better estimate of the support of targets. Further iterations improve the quantitative estimation of the wave speed. We assess the performance of the method with numerical simulations and compare the results with those of standard inversion.

math.NA↗

A Targeted Quadrature Framework for Simulating Large-Scale 3D Anisotropic Electromagnetic Measurements

We develop a new, efficient, and accurate method to simulate frequency-domain borehole electromagnetic (EM) measurements acquired in the presence of three-dimensional (3D) variations of the anisotropic subsurface conductivity. The method is based on solving the quasi-static Maxwell equations with a goal-oriented finite-volume discretization via block-quadrature reduced-order modeling. Discretization is performed with a Lebedev grid that enables accurate and conservative solutions in the presence of any form of anisotropic electrical conductivity. Likewise, the method makes use of a new effective-medium approximation to locally account for non-conformal boundaries and large contrasts in electrical conductivity, especially in the vicinity of EM sources and receivers. The finite-volume discretization yields a large symmetric linear system of equations, which is reduced to a set of smaller structured problems via block Lanczos recursion. The formulation also enables the efficient calculation of the adjoint solution, which is necessary for gradient-based inversion of the measurements to estimate the associated spatial distribution of electrical conductivity, i.e., to solve the inverse problem. Specific applications and verifications of the new numerical simulation algorithm are considered for the case of borehole ultra-deep azimuthal resistivity measurements (UDAR) typically used for subsurface well geosteering and navigation. We verify the efficiency, robustness, and scalability of this approach using synthetic UDAR measurements acquired in a 3D formation inspired by North-Sea geology. The numerical experiments successfully verify the applicability of our modeling approach to real-time UDAR processing frameworks.

physics.geo-ph↗

Waveform inversion with a data driven estimate of the internal wave

We study an inverse problem for the wave equation, concerned with estimating the wave speed, aka velocity, from data gathered by an array of sources and receivers that emit probing signals and measure the resulting waves. The typical mathematical formulation of velocity estimation is a nonlinear least squares minimization of the data misfit, over a search velocity space. There are two main impediments to this approach, which manifest as multiple local minima of the objective function: The nonlinearity of the mapping from the velocity to the data, which accounts for multiple scattering effects, and poor knowledge of the kinematics (smooth part of the wave speed) which causes cycle-skipping. We show that the nonlinearity can be mitigated using a data driven estimate of the internal wave field. This leads to improved performance of the inversion for a reasonable initial guess of the kinematics.

math.NA↗

Reduced Order Modeling for First Order Hyperbolic Systems with Application to Multiparameter Acoustic Waveform Inversion

Waveform inversion seeks to estimate an inaccessible heterogeneous medium from data gathered by sensors that emit probing signals and measure the generated waves. It is an inverse problem for a second order wave equation or a first order hyperbolic system, with the sensor excitation modeled as a forcing term and the heterogeneous medium described by unknown, spatially variable coefficients. The traditional ``full waveform inversion" (FWI) formulation estimates the unknown coefficients via minimization of the nonlinear, least squares data fitting objective function. For typical band-limited and high frequency data, this objective function has spurious local minima near and far from the true coefficients. Thus, FWI implemented with gradient based optimization algorithms may fail, even for good initial guesses. Recently, it was shown that it is possible to obtain a better behaved objective function for wave speed estimation, using data driven reduced order models (ROMs) that capture the propagation of pressure waves, governed by the classic second order wave equation. Here we introduce ROMs for vectorial waves, satisfying a general first order hyperbolic system. They are defined via Galerkin projection on the space spanned by the wave snapshots, evaluated on a uniform time grid with appropriately chosen time step. Our ROMs are data driven: They are computed in an efficient and non-iterative manner, from the sensor measurements, without knowledge of the medium and the snapshots. The ROM computation applies to any linear waves in lossless and non-dispersive media. For the inverse problem we focus attention on acoustic waves in a medium with unknown variable wave speed and density. We show that these can be determined via minimization of an objective function that uses a ROM based approximation of the vectorial wave field inside the inaccessible medium.

math.NA↗

A Krylov projection algorithm for large symmetric matrices with dense spectra

We consider the approximation of $B^T (A+sI)^{-1} B$ for large s.p.d. $A\in\mathbb{R}^{n\times n}$ with dense spectrum and $B\in\mathbb{R}^{n\times p}$, $p\ll n$. We target the computations of Multiple-Input Multiple-Output (MIMO) transfer functions for large-scale discretizations of problems with continuous spectral measures, such as linear time-invariant (LTI) PDEs on unbounded domains. Traditional Krylov methods, such as the Lanczos or CG algorithm, are known to be optimal for the computation of $(A+sI)^{-1}B$ with real positive $s$, resulting in an adaptation to the distinctively discrete and nonuniform spectra. However, the adaptation is damped for matrices with dense spectra. It was demonstrated in [Zimmerling, Druskin, Simoncini, Journal of Scientific Computing 103(1), 5 (2025)] that averaging Gauß and Gauß-Radau quadratures computed using the block-Lanczos method significantly reduces approximation errors for such problems. Here, we introduce an adaptive Kreĭn-Nudelman extension to the (block) Lanczos recursions, allowing further acceleration at negligible $o(n)$ cost. Similar to the Gauß-Radau quadrature, a low-rank modification is applied to the (block) Lanczos matrix. However, unlike the Gauß-Radau quadrature, this modification depends on $\sqrt{s}$ and can be considered in the framework of the Hermite-Padé approximants, which are known to be efficient for problems with branch-cuts, that can be good approximations to dense spectral intervals. Numerical results for large-scale discretizations of heat-diffusion and quasi-magnetostatic Maxwell's operators in unbounded domains confirm the efficiency of the proposed approach.

math.NA↗

Monotonicity, bounds and extrapolation of Block-Gauss and Gauss-Radau quadrature for computing $B^T ϕ(A) B$

In this paper, we explore quadratures for the evaluation of $B^T ϕ(A) B$ where $A$ is a symmetric positive-definite (s.p.d.) matrix in $\mathbb{R}^{n \times n}$, $B$ is a tall matrix in $\mathbb{R}^{n \times p}$, and $ϕ(\cdot)$ represents a matrix function that is regular enough in the neighborhood of $A$'s spectrum, e.g., a Stieltjes or exponential function. These formulations, for example, commonly arise in the computation of multiple-input multiple-output (MIMO) transfer functions for diffusion PDEs. We propose an approximation scheme for $B^T ϕ(A) B$ leveraging the block Lanczos algorithm and its equivalent representation through Stieltjes matrix continued fractions. We extend the notion of Gauss-Radau quadrature to the block case, facilitating the derivation of easily computable error bounds. For problems stemming from the discretization of self-adjoint operators with a continuous spectrum, we obtain sharp estimates grounded in potential theory for Padé approximations and justify averaging algorithms at no added computational cost. The obtained results are illustrated on large-scale examples of 2D diffusion and 3D Maxwell's equations and a graph from the SNAP repository. We also present promising experimental results on convergence acceleration via random enrichment of the initial block $B$.

math.NA↗

When data driven reduced order modeling meets full waveform inversion

Waveform inversion is concerned with estimating a heterogeneous medium, modeled by variable coefficients of wave equations, using sources that emit probing signals and receivers that record the generated waves. It is an old and intensively studied inverse problem with a wide range of applications, but the existing inversion methodologies are still far from satisfactory. The typical mathematical formulation is a nonlinear least squares data fit optimization and the difficulty stems from the non-convexity of the objective function that displays numerous local minima at which local optimization approaches stagnate. This pathological behavior has at least three unavoidable causes: (1) The mapping from the unknown coefficients to the wave field is nonlinear and complicated. (2) The sources and receivers typically lie on a single side of the medium, so only backscattered waves are measured. (3) The probing signals are band limited and with high frequency content. There is a lot of activity in the computational science and engineering communities that seeks to mitigate the difficulty of estimating the medium by data fitting. In this paper we present a different point of view, based on reduced order models (ROMs) of two operators that control the wave propagation. The ROMs are called data driven because they are computed directly from the measurements, without any knowledge of the wave field inside the inaccessible medium. This computation is non-iterative and uses standard numerical linear algebra methods. The resulting ROMs capture features of the physics of wave propagation in a complementary way and have surprisingly good approximation properties that facilitate waveform inversion. In this arxiv version two important typos are corrected when compared to the published version. The typo was in the second equation in Theorem 3 and carried over into Corollary 1. The proofs are correct.

math.NA↗

Electromagnetic inverse wave scattering in anisotropic media via reduced order modeling

The inverse wave scattering problem seeks to estimate a heterogeneous, inaccessible medium, modeled by unknown variable coefficients in wave equations, from transient recordings of waves generated by probing signals. It is a widely studied inverse problem with important applications, that is typically formulated as a nonlinear least squares data fit optimization. For typical measurement setups and band-limited probing signals, the least squares objective function has spurious local minima far and near the true solution, so Newton-type optimization methods fail. We introduce a different approach, for electromagnetic inverse wave scattering in lossless, anisotropic media. Our reduced order model (ROM) is an algebraic, discrete time dynamical system derived from Maxwell's equations with four important properties: (1) It is data driven, without knowledge of the medium. (2) The data to ROM mapping is nonlinear and yet the ROM can be obtained in a non-iterative fashion. (3) It has a special algebraic structure that captures the causal Wave propagation. (4) The ROM interpolates the data on a uniform time grid. We show how to obtain from the ROM an estimate of the wave field at inaccessible points inside the unknown medium. The use of this wave is twofold: First, it defines a computationally inexpensive imaging function designed to estimate the support of reflective structures in the medium, modeled by jump discontinuities of the matrix valued dielectric permittivity. Second, it gives an objective function for quantitative estimation of the dielectric permittivity, that has better behavior than the least squares data fitting objective function. The methodology introduced in this paper applies to Maxwell's equations in three dimensions. To avoid high computational costs, we limit the study to a cylindrical domain filled with an orthotropic medium, so the problem becomes two dimensional.

math.NA↗

Solving inverse scattering problems via reduced-order model embedding procedures

We present a reduced-order model (ROM) methodology for inverse scattering problems in which the reduced-order models are data-driven, i.e. they are constructed directly from data gathered by sensors. Moreover, the entries of the ROM contain localised information about the coefficients of the wave equation. We solve the inverse problem by embedding the ROM in physical space. Such an approach is also followed in the theory of ``optimal grids,'' where the ROMs are interpreted as two-point finite-difference discretisations of an underlying set of equations of a first-order continuous system on this special grid. Here, we extend this line of work to wave equations and introduce a new embedding technique, which we call Krein embedding, since it is inspired by Krein's seminal work on vibrations of a string. In this embedding approach, an adaptive grid and a set of medium parameters can be directly extracted from a ROM and we show that several limitations of optimal grid embeddings can be avoided. Furthermore, we show how Krein embedding is connected to classical optimal grid embedding and that convergence results for optimal grids can be extended to this novel embedding approach. Finally, we also briefly discuss Krein embedding for open domains, that is, semi-infinite domains that extend to infinity in one direction.

math.NA↗

Waveform inversion via reduced order modeling

We introduce a novel approach to waveform inversion, based on a data driven reduced order model (ROM) of the wave operator. The presentation is for the acoustic wave equation, but the approach can be extended to elastic or electromagnetic waves. The data are time resolved measurements of the pressure wave gathered by an acquisition system which probes the unknown medium with pulses and measures the generated waves. We propose to solve the inverse problem of velocity estimation by minimizing the square misfit between the ROM computed from the recorded data and the ROM computed from the modeled data, at the current guess of the velocity. We give the step by step computation of the ROM, which depends nonlinearly on the data and yet can be obtained from them in a non-iterative fashion, using efficient methods from linear algebra. We also explain how to make the ROM robust to data inaccuracy. The ROM computation requires the full array response matrix gathered with collocated sources and receivers. However, we show that the computation can deal with an approximation of this matrix, obtained from towed-streamer data using interpolation and reciprocity on-the-fly. While the full-waveform inversion approach of nonlinear least-squares data fitting is challenging without low frequency information, due to multiple minima of the data fit objective function, we show that the ROM misfit objective function has a better behavior, even for a poor initial guess. We also show by an explicit computation of the objective functions in a simple setting that the ROM misfit objective function has convexity properties, whereas the least squares data fit objective function displays multiple local minima.

math.NA↗

Velocity estimation via model order reduction

A novel approach to full waveform inversion (FWI), based on a data driven reduced order model (ROM) of the wave equation operator is introduced. The unknown medium is probed with pulses and the time domain pressure waveform data is recorded on an active array of sensors. The ROM, a projection of the wave equation operator is constructed from the data via a nonlinear process and is used for efficient velocity estimation. While the conventional FWI via nonlinear least-squares data fitting is challenging without low frequency information, and prone to getting stuck in local minima (cycle skipping), minimization of ROM misfit is behaved much better, even for a poor initial guess. For low-dimensional parametrizations of the unknown velocity the ROM misfit function is close to convex. The proposed approach consistently outperforms conventional FWI in standard synthetic tests.

math.NA↗

A reduced order model approach to inverse scattering in lossy layered media

We introduce a reduced order model (ROM) methodology for inverse electromagnetic wave scattering in layered lossy media, using data gathered by an antenna which generates a probing wave and measures the time resolved reflected wave. We recast the wave propagation problem as a passive infinite-dimensional dynamical system, whose transfer function is expressed in terms of the measurements at the antenna. The ROM is a low-dimensional dynamical system that approximates this transfer function. While there are many possible ROM realizations, we are interested in one that preserves passivity and in addition is: (1) data driven (i.e., is constructed only from the measurements) and (2) it consists of a matrix with special sparse algebraic structure, whose entries contain spatially localized information about the unknown dielectric permittivity and electrical conductivity of the layered medium. Localized means in the intervals of a special finite difference grid. The main result of the paper is to show with analysis and numerical simulations that these unknowns can be extracted efficiently from the ROM.

math.DS↗

Reduced order model approach for imaging with waves

We introduce a novel, computationally inexpensive approach for imaging with an active array of sensors, which probe an unknown medium with a pulse and measure the resulting waves. The imaging function uses a data driven estimate of the "internal wave" originating from the vicinity of the imaging point and propagating to the sensors through the unknown medium. We explain how this estimate can be obtained using a reduced order model (ROM) for the wave propagation. We analyze the imaging function, connect it to the time reversal process and describe how its resolution depends on the aperture of the array, the bandwidth of the probing pulse and the medium through which the waves propagate. We also show how the internal wave can be used for selective focusing of waves at points in the imaging region. This can be implemented experimentally and can be used for pixel scanning imaging. We assess the performance of the imaging methods with numerical simulations and compare them to the conventional reverse-time migration method and the "backprojection" method introduced recently as an application of the same ROM.

math.NA↗

Reduced Order Model Approach to Inverse Scattering

We study an inverse scattering problem for a generic hyperbolic system of equations with an unknown coefficient called the reflectivity. The solution of the system models waves (sound, electromagnetic or elastic), and the reflectivity models unknown scatterers embedded in a smooth and known medium. The inverse problem is to determine the reflectivity from the time resolved scattering matrix (the data) measured by an array of sensors. We introduce a novel inversion method, based on a reduced order model (ROM) of an operator called wave propagator, because it maps the wave from one time instant to the next, at interval corresponding to the discrete time sampling of the data. The wave propagator is unknown in the inverse problem, but the ROM can be computed directly from the data. By construction, the ROM inherits key properties of the wave propagator, which facilitate the estimation of the reflectivity. The ROM was introduced previously and was used for two purposes: (1) to map the scattering matrix to that corresponding to the single scattering (Born) approximation and (2) to image i.e., obtain a qualitative estimate of the support of the reflectivity. Here we study further the ROM and show that it corresponds to a Galerkin projection of the wave propagator. The Galerkin framework is useful for proving properties of the ROM that are used in the new inversion method which seeks a quantitative estimate of the reflectivity.

math.NA↗

Modal Analysis of photonic and plasmonic resonators

Quasi-normal modes (QNMs) are ubiquitous throughout photonics and are utilized in a wide variety of applications, but determining these modes remains a formidable task in general. Here we show that by exploiting the structure of Maxwell's equations it is possible to effectively compute QNMs of photonic and plasmonic nanoresonators. The symmetry of Maxwell's equations allows for a reduction to a system of small order via a Lanczos reduction process through which dominant QNMs can be identified. A closed-form reduced-order model for the spontaneous decay (SD) rate of a quantum emitter is also obtained, which does not require an a priori QNM expansion of the fields. The model is parametric in wavelength and field expansions in dominant QNMs are determined a posteriori. We demonstrate and validate that QNMs of open resonators and the SD rate of a quantum emitter are accurately predicted.

physics.optics↗

Compressing Large-Scale Wave Propagation Models via Phase-Preconditioned Rational Krylov Subspaces

Rational Krylov subspace (RKS) techniques are well-established and powerful tools for projection-based model reduction of time-invariant dynamic systems. For hyperbolic wavefield problems, such techniques perform well in configurations where only a few modes contribute to the field. RKS methods, however, are fundamentally limited by the Nyquist-Shannon sampling rate, making them unsuitable for the approximation of wavefields in configuration characterized by large travel times and propagation distances, since wavefield responses in such configurations are highly oscillatory in the frequency-domain. To overcome this limitation, we propose to precondition the RKSs by factoring out the rapidly varying frequency-domain field oscillations. The remaining amplitude functions are generally slowly varying functions of source position and spatial coordinate and allow for a significant compression of the approximation subspace. Our one-dimensional analysis together with numerical experiments for large scale 2D acoustic models show superior approximation properties of preconditioned RKS compared with the standard RKS model-order reduction. The preconditioned RKS results in a reduction of the frequency sampling well below the Nyquist-Shannon rate, a weak dependence of the RKS size on the number of inputs and outputs for multiple-input/multiple-output (MIMO) problems, and, most importantly, in a significant coarsening of the finite-difference grid used to generate the RKS. A prototype implementation indicates that the preconditioned RKS algorithm is competitive in the modern high performance computing environment.

math.NA↗