SearcharxivSearch

arXiv subjects

Fengru Wang

Publications and source records attributed to Fengru Wang.

8 recordsLinked to original sources

Dual Variational Neural Network for the $p$-Laplace Problem

The reliable and accurate numerical approximation of the $p$-Laplacian is particularly challenging in the extreme regimes $p \to 1^{+}$ and $p \gg 1$, where the operator becomes either highly singular or strongly degenerate, often causing severe instability in standard numerical methods. To address these difficulties, we propose a novel deep learning based framework, termed the dual variational neural network, for $p$-Laplace problems. The approach is based on a mixed formulation and an $L^q$-based Helmholtz decomposition, which decouples the original problem into two convex subproblems: a linear Poisson problem for the irrotational component and an unconstrained minimization problem over divergence-free fields for the solenoidal component. Following the decomposition, we employ two neural networks using a gradient--curl representation to approximate the flux, and further establish an error analysis of the neural approximation. The analysis relies on fundamental vector inequalities together with tools from statistical learning theory. Numerical experiments demonstrate robust convergence of the proposed method in challenging settings, including the extreme cases $p \to 1^{+}$ and $p \gg 1$, as well as the $p(x)$-Laplace equation.

math.NA

A Stable Iterative Direct Sampling Method for Elliptic Inverse Problems with Partial Cauchy Data

We develop a novel iterative direct sampling method (IDSM) for solving linear or nonlinear elliptic inverse problems with partial Cauchy data. It integrates three innovations: a data completion scheme to reconstruct missing boundary information, a heterogeneously regularized Dirichlet-to-Neumann map to enhance the near-orthogonality of probing functions, and a stabilization-correction strategy to ensure the numerical stability. The resulting method is remarkably robust with respect to measurement noise, is flexible with the measurement configuration, enjoys provable stability guarantee, and achieves enhanced resolution for recovering inhomogeneities. Numerical experiments in electrical impedance tomography, diffuse optical tomography, and cardiac electrophysiology show its effectiveness in accurately reconstructing the locations and geometries of inhomogeneities.

math.NA

An Iterative Direct Sampling Method for Reconstructing Moving Inhomogeneities in Parabolic Problems

We propose in this work a novel iterative direct sampling method for imaging moving inhomogeneities in parabolic problems using boundary measurements. It can efficiently identify the locations and shapes of moving inhomogeneities when very limited data are available, even with only one pair of lateral Cauchy data, and enjoys remarkable numerical stability for noisy data and over an extended time horizon. The method is formulated in an abstract framework, and is applicable to linear and nonlinear parabolic problems, including linear, nonlinear, and mixed-type inhomogeneities. Numerical experiments across diverse scenarios show its effectiveness and robustness against the data noise.

math.NA

Adaptive Approximations of Inclusions in a Semilinear Elliptic Problem Related to Cardiac Electrophysiology

In this work, we investigate the numerical reconstruction of inclusions in a semilinear elliptic equation arising in the mathematical modeling of cardiac ischemia. We propose an adaptive finite element method for the resulting constrained minimization problem that is relaxed by a phase-field approach. The \textit{a posteriori} error estimators of the adaptive algorithm consist of three components, i.e., the state variable, the adjoint variable and the complementary relation. Moreover, using tools from adaptive finite element analysis and nonlinear optimization, we establish the strong convergence for a subsequence of adaptively generated discrete solutions to a solution of the continuous optimality system. Several numerical examples are presented to illustrate the convergence and efficiency of the adaptive algorithm

math.NA

Iterative Direct Sampling Method for Elliptic Inverse Problems with Limited Cauchy Data

In this work, we propose an innovative iterative direct sampling method to solve nonlinear elliptic inverse problems from a limited number of pairs of Cauchy data. It extends the original direct sampling method (DSM) by incorporating an iterative mechanism, enhancing its performance with a modest increase in computational effort but a clear improvement in its stability against data noise. The method is formulated in an abstract framework of operator equations and is applicable to a broad range of elliptic inverse problems. Numerical results on electrical impedance tomography, optical tomography and cardiac electrophysiology etc. demonstrate its effectiveness and robustness, especially with an improved accuracy for identifying the locations and geometric shapes of inhomogeneities in the presence of large noise, when compared with the standard DSM.

math.NA

An Iterative Deep Ritz Method for Monotone Elliptic Problems

In this work, we present a novel iterative deep Ritz method (IDRM) for solving a general class of elliptic problems. It is inspired by the iterative procedure for minimizing the loss during the training of the neural network, but at each step encodes the geometry of the underlying function space and incorporates a convex penalty to enhance the performance of the algorithm. The algorithm is applicable to elliptic problems involving a monotone operator (not necessarily of variational form) and does not impose any stringent regularity assumption on the solution. It improves several existing neural PDE solvers, e.g., physics informed neural network and deep Ritz method, in terms of the accuracy for the concerned class of elliptic problems. Further, we establish a convergence rate for the method using tools from geometry of Banach spaces and theory of monotone operators, and also analyze the learning error. To illustrate the effectiveness of the method, we present several challenging examples, including a comparative study with existing techniques.

math.NA

Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on Hölder Class

In this paper, we construct neural networks with ReLU, sine and $2^x$ as activation functions. For general continuous $f$ defined on $[0,1]^d$ with continuity modulus $ω_f(\cdot)$, we construct ReLU-sine-$2^x$ networks that enjoy an approximation rate $\mathcal{O}(ω_f(\sqrt{d})\cdot2^{-M}+ω_{f}\left(\frac{\sqrt{d}}{N}\right))$, where $M,N\in \mathbb{N}^{+}$ denote the hyperparameters related to widths of the networks. As a consequence, we can construct ReLU-sine-$2^x$ network with the depth $5$ and width $\max\left\{\left\lceil2d^{3/2}\left(\frac{3μ}ε\right)^{1/α}\right\rceil,2\left\lceil\log_2\frac{3μd^{α/2}}{2ε}\right\rceil+2\right\}$ that approximates $f\in \mathcal{H}_μ^α([0,1]^d)$ within a given tolerance $ε>0$ measured in $L^p$ norm $p\in[1,\infty)$, where $\mathcal{H}_μ^α([0,1]^d)$ denotes the Hölder continuous function class defined on $[0,1]^d$ with order $α\in (0,1]$ and constant $μ> 0$. Therefore, the ReLU-sine-$2^x$ networks overcome the curse of dimensionality on $\mathcal{H}_μ^α([0,1]^d)$. In addition to its supper expressive power, functions implemented by ReLU-sine-$2^x$ networks are (generalized) differentiable, enabling us to apply SGD to train.

cs.LG

A rate of convergence of Physics Informed Neural Networks for the linear second order elliptic PDEs

In recent years, physical informed neural networks (PINNs) have been shown to be a powerful tool for solving PDEs empirically. However, numerical analysis of PINNs is still missing. In this paper, we prove the convergence rate to PINNs for the second order elliptic equations with Dirichlet boundary condition, by establishing the upper bounds on the number of training samples, depth and width of the deep neural networks to achieve desired accuracy. The error of PINNs is decomposed into approximation error and statistical error, where the approximation error is given in $C^2$ norm with $\mathrm{ReLU}^{3}$ networks (deep network with activations function $\max\{0,x^3\}$) and the statistical error is estimated by Rademacher complexity. We derive the bound on the Rademacher complexity of the non-Lipschitz composition of gradient norm with $\mathrm{ReLU}^{3}$ network, which is of immense independent interest.

math.NA