Searcharxiv⌕ Search

arXiv subjects

Bangti Jin

Publications and source records attributed to Bangti Jin.

At least 145 records · Page 8Linked to original sources

Lagrange optimality system for a class of nonsmooth convex optimization

In this paper, we revisit the augmented Lagrangian method for a class of nonsmooth convex optimization. We present the Lagrange optimality system of the augmented Lagrangian associated with the problems, and establish its connections with the standard optimality condition and the saddle point condition of the augmented Lagrangian, which provides a powerful tool for developing numerical algorithms. We apply a linear Newton method to the Lagrange optimality system to obtain a novel algorithm applicable to a variety of nonsmooth convex optimization problems arising in practical applications. Under suitable conditions, we prove the nonsingularity of the Newton system and the local convergence of the algorithm.

math.OC↗

A Finite Element Method With Singularity Reconstruction for Fractional Boundary Value Problems

We consider a two-point boundary value problem involving a Riemann-Liouville fractional derivative of order $\al\in (1,2)$ in the leading term on the unit interval $(0,1)$. Generally the standard Galerkin finite element method can only give a low-order convergence even if the source term is very smooth due to the presence of the singularity term $x^{\al-1}$ in the solution representation. In order to enhance the convergence, we develop a simple singularity reconstruction strategy by splitting the solution into a singular part and a regular part, where the former captures explicitly the singularity. We derive a new variational formulation for the regular part, and establish that the Galerkin approximation of the regular part can achieve a better convergence order in the $L^2(0,1)$, $H^{\al/2}(0,1)$ and $L^\infty(0,1)$-norms than the standard Galerkin approach, with a convergence rate for the recovered singularity strength identical with the $L^2(0,1)$ error estimate. The reconstruction approach is very flexible in handling explicit singularity, and it is further extended to the case of a Neumann type boundary condition on the left end point, which involves a strong singularity $x^{\al-2}$. Extensive numerical results confirm the theoretical study and efficiency of the proposed approach.

math.NA↗

An Analysis of the Rayleigh-Stokes problem for a Generalized Second-Grade Fluid

We study the Rayleigh-Stokes problem for a generalized second-grade fluid which involves a Riemann-Liouville fractional derivative in time, and present an analysis of the problem in the continuous, space semidiscrete and fully discrete formulations. We establish the Sobolev regularity of the homogeneous problem for both smooth and nonsmooth initial data $v$, including $v\in L^2(Ω)$. A space semidiscrete Galerkin scheme using continuous piecewise linear finite elements is developed, and optimal with respect to initial data regularity error estimates for the finite element approximations are derived. Further, two fully discrete schemes based on the backward Euler method and second-order backward difference method and the related convolution quadrature are developed, and optimal error estimates are derived for the fully discrete approximations for both smooth and nonsmooth initial data. Numerical results for one- and two-dimensional examples with smooth and nonsmooth initial data are presented to illustrate the efficiency of the method, and to verify the convergence theory.

math.NA↗

An analysis of the L1 Scheme for the subdiffusion equation with nonsmooth data

The subdiffusion equation with a Caputo fractional derivative of order $α\in(0,1)$ in time arises in a wide variety of practical applications, and it is often adopted to model anomalous subdiffusion processes in heterogeneous media. The L1 scheme is one of the most popular and successful numerical methods for discretizing the Caputo fractional derivative in time. The scheme was analyzed earlier independently by Lin and Xu (2007) and Sun and Wu (2006), and an $O(τ^{2-α})$ convergence rate was established, under the assumption that the solution is twice continuously differentiable in time. However, in view of the smoothing property of the subdiffusion equation, this regularity condition is restrictive, since it does not hold even for the homogeneous problem with a smooth initial data. In this work, we revisit the error analysis of the scheme, and establish an $O(τ)$ convergence rate for both smooth and nonsmooth initial data. The analysis is valid for more general sectorial operators. In particular, the L1 scheme is applied to one-dimensional space-time fractional diffusion equations, which involves also a Riemann-Liouville derivative of order $β\in(3/2,2)$ in space, and error estimates are provided for the fully discrete scheme. Numerical experiments are provided to verify the sharpness of the error estimates, and robustness of the scheme with respect to data regularity.

math.NA↗

A Tutorial on Inverse Problems for Anomalous Diffusion Processes

Over the last two decades, anomalous diffusion processes in which the mean squares variance grows slower or faster than that in a Gaussian process have found many applications. At a macroscopic level, these processes are adequately described by fractional differential equations, which involves fractional derivatives in time or/and space. The fractional derivatives describe either history mechanism or long range interactions of particle motions at a microscopic level. The new physics can change dramatically the behavior of the forward problems. Naturally one expects that the new physics will impact related inverse problems in terms of uniqueness, stability, and degree of ill-posedness. The last aspect is especially important from a practical point of view, i.e., stably reconstructing the quantities of interest. In this paper, we employ a formal analytic and numerical way to examine the degree of ill-posedness of several "classical" inverse problems for fractional differential equations involving a Djrbashian-Caputo fractional derivative in either time or space, which represent the fractional analogues of that for classical integral order differential equations. We discuss four inverse problems, i.e., backward fractional diffusion, sideways problem, inverse source problem and inverse potential problem for time fractional diffusion, and inverse Sturm-Liouville problem, Cauchy problem, backward fractional diffusion and sideways problem for space fractional diffusion. It is found that contrary to the wide belief, the influence of anomalous diffusion on the degree of ill-posedness is not definitive: it can either significantly improve or worsen the conditioning of related inverse problems, depending crucially on the specific type of given data and quantity of interest. Further, the study exhibits distinct new features of "fractional" inverse problems.

math.NA↗

A Primal Dual Active Set with Continuation Algorithm for the \ell^0-Regularized Optimization Problem

We develop a primal dual active set with continuation algorithm for solving the \ell^0-regularized least-squares problem that frequently arises in compressed sensing. The algorithm couples the the primal dual active set method with a continuation strategy on the regularization parameter. At each inner iteration, it first identifies the active set from both primal and dual variables, and then updates the primal variable by solving a (typically small) least-squares problem defined on the active set, from which the dual variable can be updated explicitly. Under certain conditions on the sensing matrix, i.e., mutual incoherence property or restricted isometry property, and the noise level, the finite step global convergence of the algorithm is established. Extensive numerical examples are presented to illustrate the efficiency and accuracy of the algorithm and the convergence analysis.

math.OC↗

Multilevel Markov Chain Monte Carlo Method for High-Contrast Single-Phase Flow Problems

In this paper we propose a general framework for the uncertainty quantification of quantities of interest for high-contrast single-phase flow problems. It is based on the generalized multiscale finite element method (GMsFEM) and multilevel Monte Carlo (MLMC) methods. The former provides a hierarchy of approximations of different resolution, whereas the latter gives an efficient way to estimate quantities of interest using samples on different levels. The number of basis functions in the online GMsFEM stage can be varied to determine the solution resolution and the computational cost, and to efficiently generate samples at different levels. In particular, it is cheap to generate samples on coarse grids but with low resolution, and it is expensive to generate samples on fine grids with high accuracy. By suitably choosing the number of samples at different levels, one can leverage the expensive computation in larger fine-grid spaces toward smaller coarse-grid spaces, while retaining the accuracy of the final Monte Carlo estimate. Further, we describe a multilevel Markov chain Monte Carlo method, which sequentially screens the proposal with different levels of approximations and reduces the number of evaluations required on fine grids, while combining the samples at different levels to arrive at an accurate estimate. The framework seamlessly integrates the multiscale features of the GMsFEM with the multilevel feature of the MLMC methods following the work in \cite{ketelson2013}, and our numerical experiments illustrate its efficiency and accuracy in comparison with standard Monte Carlo estimates.

math.NA↗

The Galerkin Finite Element Method for A Multi-term Time-Fractional Diffusion equation

We consider the initial/boundary value problem for a diffusion equation involving multiple time-fractional derivatives on a bounded convex polyhedral domain. We analyze a space semidiscrete scheme based on the standard Galerkin finite element method using continuous piecewise linear functions. Nearly optimal error estimates for both cases of initial data and inhomogeneous term are derived, which cover both smooth and nonsmooth data. Further we develop a fully discrete scheme based on a finite difference discretization of the time-fractional derivatives, and discuss its stability and error estimate. Extensive numerical experiments for one and two-dimension problems confirm the convergence rates of the theoretical results.

math.NA↗

Expectation Propagation for Nonlinear Inverse Problems -- with an Application to Electrical Impedance Tomography

In this paper, we study a fast approximate inference method based on expectation propagation for exploring the posterior probability distribution arising from the Bayesian formulation of nonlinear inverse problems. It is capable of efficiently delivering reliable estimates of the posterior mean and covariance, thereby providing an inverse solution together with quantified uncertainties. Some theoretical properties of the iterative algorithm are discussed, and the efficient implementation for an important class of problems of projection type is described. The method is illustrated with one typical nonlinear inverse problem, electrical impedance tomography with complete electrode model, under sparsity constraints. Numerical results for real experimental data are presented, and compared with that by Markov chain Monte Carlo. The results indicate that the method is accurate and computationally very efficient.

math.NA↗

An Analysis of Finite Element Approximation in Electrical Impedance Tomography

We present a finite element analysis of electrical impedance tomography for reconstructing the conductivity distribution from electrode voltage measurements by means of Tikhonov regularization. Two popular choices of the penalty term, i.e., $H^1(Ω)$-norm smoothness penalty and total variation seminorm penalty, are considered. A piecewise linear finite element method is employed for discretizing the forward model, i.e., the complete electrode model, the conductivity, and the penalty functional. The convergence of the finite element approximations for the Tikhonov model on both polyhedral and smooth curved domains is established. This provides rigorous justifications for the ad hoc discretization procedures in the literature.

math.NA↗

Error Analysis of Finite Element Methods for Space-Fractional Parabolic Equations

We consider an initial/boundary value problem for one-dimensional fractional-order parabolic equations with a space fractional derivative of Riemann-Liouville type and order $α\in (1,2)$. We study a spatial semidiscrete scheme with the standard Galerkin finite element method with piecewise linear finite elements, as well as fully discrete schemes based on the backward Euler method and Crank-Nicolson method. Error estimates in the $L^2\II$- and $H^{α/2}\II$-norm are derived for the semidiscrete scheme, and in the $L^2\II$-norm for the fully discrete schemes. These estimates are for both smooth and nonsmooth initial data, and are expressed directly in terms of the smoothness of the initial data. Extensive numerical results are presented to illustrate the theoretical results.

math.NA↗

A Finite Element Method for the Fractional Sturm-Liouville Problem

In this work, we propose an efficient finite element method for solving fractional Sturm-Liouville problems involving either the Caputo or Riemann-Liouville derivative of order $α\in(1,2)$ on the unit interval $(0,1)$. It is based on novel variational formulations of the eigenvalue problem. Error estimates are provided for the finite element approximations of the eigenvalues. Numerical results are presented to illustrate the efficiency and accuracy of the method. The results indicate that the method can achieve a second-order convergence for both fractional derivatives, and can provide accurate approximations to multiple eigenvalues simultaneously.

math.NA↗

Variational formulation of problems involving fractional order differential operators

In this work, we consider boundary value problems involving Caputo and Riemann-Liouville fractional derivatives of order $α\in(1,2)$ on the unit interval $(0,1)$. These fractional derivatives lead to non-symmetric boundary value problems, which are investigated from a variational point of view. The variational problem for the Riemann-Liouville case is coercive on the space $H_0^{α/2}(0,1)$ but the solutions are less regular, whereas that for the Caputo case involves different test and trial spaces. The numerical analysis of these problems requires the so-called shift theorems which show that the solutions of the variational problem are more regular. The regularity pickup enables one to establish convergence rates of the finite element approximations. Finally, numerical results are presented to illustrate the error estimates.

math.NA↗

Error Analysis of Semidiscrete Finite Element Methods for Inhomogeneous Time-Fractional Diffusion

We consider the initial boundary value problem for the inhomogeneous time-fractional diffusion equation with a homogeneous Dirichlet boundary condition and a nonsmooth right hand side data in a bounded convex polyhedral domain. We analyze two semidiscrete schemes based on the standard Galerkin and lumped mass finite element methods. Almost optimal error estimates are obtained for right hand side data $f(x,t)\in L^\infty(0,T;\dot H^q(Ω))$, $-1< q \le 1$, for both semidiscrete schemes. For lumped mass method, the optimal $L^2(Ω)$-norm error estimate requires symmetric meshes. Finally, numerical experiments for one- and two-dimensional examples are presented to verify our theoretical results.

math.NA↗

Multi-Parameter Tikhonov Regularization -- An Augmented Approach

We study multi-parameter regularization (multiple penalties) for solving linear inverse problems to promote simultaneously distinct features of the sought-for objects. We revisit a balancing principle for choosing regularization parameters from the viewpoint of augmented Tikhonov regularization, and derive a new parameter choice strategy called the \textit{balanced discrepancy principle}. A priori and a posteriori error estimates are provided to theoretically justify the principles, and numerical algorithms for efficiently implementing the principles are also provided. Numerical results on denoising are presented to illustrate the feasibility of the balanced discrepancy principle.

math.NA↗

Galerkin FEM for fractional order parabolic equations with initial data in $H^{-s},~0 < s \le 1$

We investigate semi-discrete numerical schemes based on the standard Galerkin and lumped mass Galerkin finite element methods for an initial-boundary value problem for homogeneous fractional diffusion problems with non-smooth initial data. We assume that $Ω\subset \mathbb{R}^d$, $d=1,2,3$ is a convex polygonal (polyhedral) domain. We theoretically justify optimal order error estimates in $L_2$- and $H^1$-norms for initial data in $H^{-s}(Ω),~0\le s \le 1$. We confirm our theoretical findings with a number of numerical tests that include initial data $v$ being a Dirac $δ$-function supported on a $(d-1)$-dimensional manifold.

math.NA↗

A Direct Sampling Method for Inverse Electromagnetic Medium Scattering

In this paper, we study the inverse electromagnetic medium scattering problem of estimating the support and shape of medium scatterers from scattered electric or magnetic near-field data. We shall develop a novel direct sampling method based on an analysis of electromagnetic scattering and the behavior of the fundamental solution. The method is applicable even with one incident field and needs only to compute inner products of the measured scattered field with the fundamental solutions located at sampling points. Hence it is strictly direct, computationally very efficient, and highly tolerant to the presence of noise in the data. Two- and three-dimensional numerical experiments indicate that it can provide reliable support estimates of one single and multiple scatterers in case of both exact and highly noisy data.

math.NA↗

A Two-stage Method for Inverse Medium Scattering

We present a novel numerical method to the time-harmonic inverse medium scattering problem of recovering the refractive index from near-field scattered data. The approach consists of two stages, one pruning step of detecting the scatterer support, and one resolution enhancing step with mixed regularization. The first step is strictly direct and of sampling type, and faithfully detects the scatterer support. The second step is an innovative application of nonsmooth mixed regularization, and it accurately resolves the scatterer sizes as well as intensities. The model is efficiently solved by a semi-smooth Newton-type method. Numerical results for two- and three-dimensional examples indicate that the approach is accurate, computationally efficient, and robust with respect to data noise.

math.NA↗