arXiv subjects

Ch. Schwab

Publications and source records attributed to Ch. Schwab.

6 recordsLinked to original sources

arXiv2026

Neural Networks for Singular Perturbations -- Finite Regularity

We study finite-element and deep feedforward neural network (DNN for short) expressivity rate bounds for solution sets of a model linear, second order singularly perturbed, elliptic two-point boundary value problem, in Sobolev norms on a bounded interval $(-1,1)$, with explicit dependence on the singular perturbation parameter $\e\in (0,1]$. Emphasis is on low Sobolev regularity of the data, i.e., source term $f$ and reaction coefficient $b$. A proof of $\e$-explicit solution regularity based on exponentially weighted energy-norm bounds is developed, and \emph{$\e$-robust, algebraic expression rate bounds} in Sobolev norms for $\mathbb{P}_1$ Finite-Elements on exponential and Shishkin type meshes is proved. Expression rates for shallow (fixed depth) $\ReLU$-NNs are shown which are robust w.r. to $\e$ and explicit in terms of the NN size. Robust NN expression rate bounds are further studied for deep feedforward DNNs with ReLU and tanh-activations. As in \cite{OSX24_1085}, tanh- and sigmoid-activated sub-NNs allow to include exponential boundary layer functions exactly into the NN feature space, leading to reduced NN sizes. Recent bitstring encoding techniques for deep NNs with ReLU activations afford, still under low data regularity $f,b \in H^1(I)$ \emph{twice the (robust) convergence rate of $\mathbb{P}_1$ Finite-Elements} achievable with ``eXp'' or Shishkin meshes.

math.NA↗

arXiv2023

Multiresolution kernel matrix algebra

We propose a sparse algebra for samplet compressed kernel matrices, to enable efficient scattered data analysis. We show the compression of kernel matrices by means of samplets produces optimally sparse matrices in a certain S-format. It can be performed in cost and memory that scale essentially linearly with the matrix size $N$, for kernels of finite differentiability, along with addition and multiplication of S-formatted matrices. We prove and exploit the fact that the inverse of a kernel matrix (if it exists) is compressible in the S-format as well. Selected inversion allows to directly compute the entries in the corresponding sparsity pattern. The S-formatted matrix operations enable the efficient, approximate computation of more complicated matrix functions such as ${\bm A}^α$ or $\exp({\bm A})$. The matrix algebra is justified mathematically by pseudo differential calculus. As an application, efficient Gaussian process learning algorithms for spatial statistics is considered. Numerical results are presented to illustrate and quantify our findings.

math.NA↗

arXiv2020

Higher-order Quasi-Monte Carlo Training of Deep Neural Networks

We present a novel algorithmic approach and an error analysis leveraging Quasi-Monte Carlo points for training deep neural network (DNN) surrogates of Data-to-Observable (DtO) maps in engineering design. Our analysis reveals higher-order consistent, deterministic choices of training points in the input data space for deep and shallow Neural Networks with holomorphic activation functions such as tanh. These novel training points are proved to facilitate higher-order decay (in terms of the number of training samples) of the underlying generalization error, with consistency error bounds that are free from the curse of dimensionality in the input data space, provided that DNN weights in hidden layers satisfy certain summability conditions. We present numerical experiments for DtO maps from elliptic and parabolic PDEs with uncertain inputs that confirm the theoretical analysis.

math.NA↗

arXiv2020

Quantized tensor FEM for multiscale problems: diffusion problems in two and three dimensions

Homogenization in terms of multiscale limits transforms a multiscale problem with $n+1$ asymptotically separated microscales posed on a physical domain $D \subset \mathbb{R}^d$ into a one-scale problem posed on a product domain of dimension $(n+1)d$ by introducing $n$ so-called "fast variables". This procedure allows to convert $n+1$ scales in $d$ physical dimensions into a single-scale structure in $(n+1)d$ dimensions. We prove here that both the original, physical multiscale problem and the corresponding high-dimensional, one-scale limiting problem can be efficiently treated numerically with the recently developed quantized tensor-train finite-element method (QTT-FEM). The method is based on restricting computation to sequences of nested subspaces of low dimensions (which are called tensor ranks) within a vast but generic "virtual" (background) discretization space. In the course of computation, these subspaces are computed iteratively and data-adaptively at runtime, bypassing any "offline precomputation". For the purpose of theoretical analysis, such low-dimensional subspaces are constructed analytically to bound the tensor ranks vs. error $τ>0$. We consider a model linear elliptic multiscale problem in several physical dimensions and show, theoretically and experimentally, that both (i) the solution of the associated high-dimensional one-scale problem and (ii) the corresponding approximation to the solution of the multiscale problem admit efficient approximation by the QTT-FEM. These problems can therefore be numerically solved in a scale-robust fashion by standard (low-order) PDE discretizations combined with state-of-the-art general-purpose solvers for tensor-structured linear systems. We prove scale-robust exponential convergence, i.e., that QTT-FEM achieves accuracy $τ$ with the number of effective degrees of freedom scaling polynomially in $\log τ$.

math.NA↗

arXiv2013

Multilevel Monte Carlo for Random Degenerate Scalar Convection Diffusion Equation

We consider the numerical solution of scalar, nonlinear degenerate convection-diffusion problems with random diffusion coefficient and with random flux functions. Building on recent results on the existence, uniqueness and continuous dependence of weak solutions on data in the deterministic case, we develop a definition of random entropy solution. We establish existence, uniqueness, measurability and integrability results for these random entropy solutions, generalizing \cite{Mishr478,MishSch10a} to possibly degenerate hyperbolic-parabolic problems with random data. We next address the numerical approximation of random entropy solutions, specifically the approximation of the deterministic first and second order statistics. To this end, we consider explicit and implicit time discretization and Finite Difference methods in space, and single as well as Multi-Level Monte-Carlo methods to sample the statistics. We establish convergence rate estimates with respect to the discretization parameters, as well as with respect to the overall work, indicating substantial gains in efficiency are afforded under realistic regularity assumptions by the use of the Multi-Level Monte-Carlo method. Numerical experiments are presented which confirm the theoretical convergence estimates.

math.AP↗

arXiv2012

Sparse Deterministic Approximation of Bayesian Inverse Problems

We present a parametric deterministic formulation of Bayesian inverse problems with input parameter from infinite dimensional, separable Banach spaces. In this formulation, the forward problems are parametric, deterministic elliptic partial differential equations, and the inverse problem is to determine the unknown, parametric deterministic coefficients from noisy observations comprising linear functionals of the solution. We prove a generalized polynomial chaos representation of the posterior density with respect to the prior measure, given noisy observational data. We analyze the sparsity of the posterior density in terms of the summability of the input data's coefficient sequence. To this end, we estimate the fluctuations in the prior. We exhibit sufficient conditions on the prior model in order for approximations of the posterior density to converge at a given algebraic rate, in terms of the number $N$ of unknowns appearing in the parameteric representation of the prior measure. Similar sparsity and approximation results are also exhibited for the solution and covariance of the elliptic partial differential equation under the posterior. These results then form the basis for efficient uncertainty quantification, in the presence of data with noise.

math.AP↗