SearcharxivSearch

arXiv subjects

Ludmil Zikatanov

Publications and source records attributed to Ludmil Zikatanov.

At least 19 recordsLinked to original sources

A Conjugate Gradient Formulation of the EnKF Algorithm

Ensemble Kalman Filter (EnKF) based data assimilation algorithms synthesize predictive numerical forecast models with accumulated data as time evolves and account for model uncertainty and noisy measurements. The computational cost of these algorithms can be expensive, in particular for highly dimensional dynamical systems. Often, EnKF based algorithms have traded accuracy for reduced computational cost. In this paper, we present a novel parallelizable Conjugate Gradient-based Ensemble Kalman Filter (CGD-EnKF) algorithm that maintains comparable computational cost to efficient algorithms while realizing better state estimation accuracy in select cases. Here, we established the new approach by reformulating a matrix inverse calculation with a classical Conjugate Gradient (CGD) method. In addition, we discuss the upper error bound under CGD, error convergence to the classical EnKF result, and the computational complexity of the algorithm. We also showcase the CGD-EnKF-Reduced algorithm that is shown to be further computationally efficient for highly dimensional dynamical systems under small ensemble formulation. Numerical examples demonstrate the performance of our proposed algorithms and analytical properties, highlighting their comparability and advantages with respect to some benchmark EnKF algorithms.

math.NA

A Mollification Approach to Ramified Transport and Tree Shape Optimization

The paper analyzes a mollification algorithm, for the numerical computation of optimal irrigation patterns. This provides a regularization of the standard irrigation cost functional, in a Lagrangian framework. Lower semicontinuity and Gamma-convergence results are proved. The technique is then applied to some numerical optimization problems, related to the optimal shape of tree roots and branches.

math.OC

Superconvergence in finite element method by smoothing

This paper develops a smoothing-based postprocessing method for superconvergence in finite element methods. The method applies a few smoothing iterations, such as damped Jacobi, Gauss-Seidel, or conjugate gradient, with initial guess being the current finite element solution embedded in an enriched finite element space. The resulting procedure is algebraic, easy to implement, and applicable to high-order and three-dimensional discretizations. For symmetric and positive-definite problems, we prove superconvergence of the smoothed solutions under additive and multiplicative smoothers. Effectiveness of the proposed method is demonstrated by numerical experiments for the Poisson, Maxwell, biharmonic and Helmholtz equations.

math.NA

Neural networks with trainable matrix activation functions

The training process of neural networks usually optimize weights and bias parameters of linear transformations, while nonlinear activation functions are pre-specified and fixed. This work develops a systematic approach to constructing matrix-valued activation functions whose entries are generalized from ReLU. The activation is based on matrix-vector multiplications using only scalar multiplications and comparisons. The proposed activation functions depend on parameters that are trained along with the weights and bias vectors. Neural networks based on this approach are simple and efficient and are shown to be robust in numerical experiments.

cs.LG

Oscillation-free numerical schemes for Biot's model and their iterative coupling solution

In this work, we present a new stabilization method aimed at removing spurious oscillations in the pressure approximation of Biot's model for poroelasticity with low permeabilities and/or small time steps. We consider different finite-element discretizations and illustrate how not only does such a stabilized scheme provide numerical solutions that are free of non-physical oscillations, but it also allows one to iterate the fluid and mechanics problems in a fashion similar to the well-known fixed-stress split method. The resulting solution method is convergent without the necessity for additional terms to stabilize the iteration. Finally, we present numerical results illustrating the robust behavior of both the stabilization and iterative solver with respect to the physical and discretization parameters of the model.

math.NA

A Local Fourier Analysis for Additive Schwarz Smoothers

In this work, a local Fourier analysis is presented to study the convergence of multigrid methods based on additive Schwarz smoothers. This analysis is presented as a general framework which allows us to study these smoothers for any type of discretization and problem. The presented framework is crucial in practice since it allows one to know a priori the answer to questions such as what is the size of the patch to use within these relaxations, the size of the overlapping, or even the optimal values for the weights involved in the smoother. Results are shown for a class of additive and restricted additive Schwarz relaxations used within a multigrid framework applied to high-order finite-element discretizations and saddle point problems, which are two of the contexts in which these type of relaxations are widely used.

math.NA

Rational approximation preconditioners for multiphysics problems

We consider a class of mathematical models describing multiphysics phenomena interacting through interfaces. On such interfaces, the traces of the fields lie (approximately) in the range of a weighted sum of two fractional differential operators. We use a rational function approximation to precondition such operators. We first demonstrate the robustness of the approximation for ordinary functions given by weighted sums of fractional exponents. Additionally, we present more realistic examples utilizing the proposed preconditioning techniques in interface coupling between Darcy and Stokes equations.

math.NA

HAZniCS -- Software Components for Multiphysics Problems

We introduce the software toolbox HAZniCS for solving interface-coupled multiphysics problems. HAZniCS is a suite of modules that combines the well-known FEniCS framework for finite element discretization with solver and graph library HAZmath. The focus of the paper is on the design and implementation of a pool of robust and efficient solver algorithms which tackle issues related to the complex interfacial coupling of the physical problems often encountered in applications in brain biomechanics. The robustness and efficiency of the numerical algorithms and methods is shown in several numerical examples, namely the Darcy-Stokes equations that model flow of cerebrospinal fluid in the human brain and the mixed-dimensional model of electrodiffusion in the brain tissue.

math.NA

Automatic coarsening in Algebraic Multigrid utilizing quality measures for matching-based aggregations

In this paper, we discuss the convergence of an Algebraic MultiGrid (AMG) method for general symmetric positive-definite matrices. The method relies on an aggregation algorithm, named \emph{coarsening based on compatible weighted matching}, which exploits the interplay between the principle of compatible relaxation and the maximum product matching in undirected weighted graphs. The results are based on a general convergence analysis theory applied to the class of AMG methods employing unsmoothed aggregation and identifying a quality measure for the coarsening; similar quality measures were originally introduced and applied to other methods as tools to obtain good quality aggregates leading to optimal convergence for M-matrices. The analysis, as well as the coarsening procedure, is purely algebraic and, in our case, allows an \emph{a posteriori} evaluation of the quality of the aggregation procedure which we apply to analyze the impact of approximate algorithms for matching computation and the definition of graph edge weights. We also explore the connection between the choice of the aggregates and the compatible relaxation convergence, confirming the consistency between theories for designing coarsening procedures in purely algebraic multigrid methods and the effectiveness of the coarsening based on compatible weighted matching. We discuss various completely automatic algorithmic approaches to obtain aggregates for which good convergence properties are achieved on various test cases.

math.NA

New stabilized $P_1\times P_0$ finite element methods for nearly inviscid and incompressible flows

This work proposes a new stabilized $P_1\times P_0$ finite element method for solving the incompressible Navier--Stokes equations. The numerical scheme is based on a reduced Bernardi--Raugel element with statically condensed face bubbles and is pressure-robust in the small viscosity regime. For the Stokes problem, an error estimate uniform with respect to the kinematic viscosity is shown. For the Navier--Stokes equation, the nonlinear convection term is discretized using an edge-averaged finite element method. In comparison with classical schemes, the proposed method does not require tuning of parameters and is validated for competitiveness on several benchmark problems in 2 and 3 dimensional space.

math.NA

A posteriori error estimates of finite element methods by preconditioning

We present a framework that relates preconditioning with a posteriori error estimates in finite element methods. In particular, we use standard tools in subspace correction methods to obtain reliable and efficient error estimators. As a simple example, we recover the classical residual error estimators for the second order elliptic equations.

math.NA

On the Weyl's law for discretized elliptic operators

In this paper we give an estimate on the asymptotic behavior of eigenvalues of discretized elliptic boundary values problems. We first prove a simple min-max principle for selfadjoint operators on a Hilbert space. Then we show two sided bounds on the $k$-th eigenvalue of the discrete Laplacian by the $k$-th eigenvalue of the continuous Laplacian operator under the assumption that the finite element mesh is quasi-uniform. Combining this result with the well-known Weyl's law, we show that the $k$-th eigenvalue of the discretized isotropic elliptic operators, spectrally equivalent to the discretized Laplacian, is $\mathcal O\left(k^{2/d}\right)$. Finally, we show how these results can be used to obtain an error estimate for finite element approximations of elliptic eigenvalue problems.

math.NA

Low Regularity Primal-Dual Weak Galerkin Finite Element Methods for Convection-Diffusion Equations

We propose a numerical method for convection-diffusion problems under low regularity assumptions. We derive the method and analyze it using the primal-dual weak Galerkin (PDWG) finite element framework. The Euler-Lagrange formulation resulting from the PDWG scheme yields a system of equations involving not only the equation for the primal variable but also its adjoint for the dual variable. We show that the proposed PDWG method is stable and convergent. We also derive a priori error estimates for the primal variable in the $H^ε$-norm for $ε\in [0,\frac12)$. A series of numerical tests that validate the theory and are presented as well.

math.NA

Randomized Method of Subspace Corrections

In this paper, we consider the iterative method of subspace corrections with random ordering. We prove identities for the expected convergence rate, which can provide sharp estimates for the error reduction per iteration. We also study the fault-tolerant feature of the randomized successive subspace correction method by simply rejecting all the corrections when error occurs and show that the results iterative method converges with probability one. Moreover, we also provide sharp estimates on the expected convergence rate for the fault-tolerant, randomized, subspace correction method.

math.NA

Some Applications of the Hahn-Banach Separation Theorem

We show that a single special separation theorem (namely, a consequence of the geometric form of the Hahn-Banach theorem) can be used to prove Farkas type theorems, existence theorems for numerical quadrature with positive coefficients, and detailed characterizations of best approximations from certain important cones in Hilbert space.

math.FA

New stabilized discretizations for poroelasticity and the Stokes' equations

In this work, we consider the popular P1-RT0-P0 discretization of the three-field formulation of Biot's consolidation problem. Since this finite-element formulation does not satisfy an inf-sup condition uniformly with respect to the physical parameters, several issues arise in numerical simulations. For example, when the permeability is small with respect to the mesh size, volumetric locking may occur. Thus, we propose a stabilization technique that enriches the piecewise linear finite-element space of the displacement with the span of edge/face bubble functions. We show that for Biot's model this does give rise to discretizations that are uniformly stable with respect to the physical parameters. We also propose a perturbation of the bilinear form, which allows for local elimination of the bubble functions and provides a uniformly stable scheme with the same number of degrees of freedom as the classical P1-RT0-P0 approach. We prove optimal stability and error estimates for this discretization. Finally, we show that this scheme can also be successfully applied to Stokes' equations, yielding a discrete problem with optimal approximation properties and with minimum number of degrees of freedom (equivalent to a P1-P0 discretization). Numerical tests confirm the theory for both poroelastic and Stokes' test problems.

math.NA

A unified approach to the design and analysis of AMG

In this work, we present a general framework for the design and analysis of two-level AMG methods. The approach is to find a basis for locally optimal or quasi-optimal coarse space, such as the space of constant vectors for standard discretizations of scalar elliptic partial differential equations. The locally defined basis elements are glued together using carefully designed linear extension maps to form a global coarse space. Such coarse spaces, constructed locally, satisfy global approximation property and by estimating the local Poincar{\' e} constants, we obtain sharp bounds on the convergence rate of the resulting two-level methods. To illustrate the use of the theoretical framework in practice, we prove the uniform convergence of the classical two level AMG method for finite element discretization of a jump coefficient problem on a shape regular mesh.

math.NA

Preconditioning of weighted H(div)-norm and applications to numerical simulation of highly heterogeneous media

In this paper we propose and analyze a preconditioner for a system arising from a finite element approximation of second order elliptic problems describing processes in highly het- erogeneous media. Our approach uses the technique of multilevel methods and the recently proposed preconditioner based on additive Schur complement approximation by J. Kraus (see [8]). The main results are the design and a theoretical and numerical justification of an iterative method for such problems that is robust with respect to the contrast of the media, defined as the ratio between the maximum and minimum values of the coefficient (related to the permeability/conductivity).

math.NA