arXiv subjects

Michael Griebel

Publications and source records attributed to Michael Griebel.

33 records · Page 2Linked to original sources

arXiv2021

Analysis of tensor approximation schemes for continuous functions

In this article, we analyze tensor approximation schemes for continuous functions. We assume that the function to be approximated lies in an isotropic Sobolev space and discuss the cost when approximating this function in the continuous analogue of the Tucker tensor format or of the tensor train format. We especially show that the cost of both approximations are dimension-robust when the Sobolev space under consideration provides appropriate weights.

math.NA↗

arXiv2021

A fault-tolerant domain decomposition method based on space-filling curves

We propose a simple domain decomposition method for $d$-dimensional elliptic PDEs which involves an overlapping decomposition into local subdomain problems and a global coarse problem. It relies on a space-filling curve to create equally sized subproblems and to determine a certain overlap based on the one-dimensional ordering of the space-filling curve. Furthermore we employ agglomeration and a purely algebraic Galerkin discretization in the construction of the coarse problem. This way, the use of $d$-dimensional geometric information is avoided. The subproblems are dealt with in an additive, parallel way, which gives rise to a subspace correction type linear iteration and a preconditioner for the conjugate gradient method. To make the algorithm fault-tolerant we store on each processor, besides the data of the associated subproblem, a copy of the coarse problem and also the data of a fixed amount of neighboring subproblems with respect to the one-dimensional ordering of the subproblems induced by the space-filling curve. This redundancy then allows to restore the necessary data if processors fail during the computation. Theory supports that the convergence rate of such a linear iteration method stays the same in expectation, and only its order constant deteriorates slightly due to the faults. We observe this in numerical experiments for the preconditioned conjugate gradient method in slightly weaker form as well. Altogether, we obtain a fault-tolerant, parallel and efficient domain decomposition method based on space-filling curves which is especially suited for higher-dimensional elliptic problems.

math.NA↗

arXiv2019

Maximum Approximated Likelihood Estimation

Empirical economic research frequently applies maximum likelihood estimation in cases where the likelihood function is analytically intractable. Most of the theoretical literature focuses on maximum simulated likelihood (MSL) estimators, while empirical and simulation analyzes often find that alternative approximation methods such as quasi-Monte Carlo simulation, Gaussian quadrature, and integration on sparse grids behave considerably better numerically. This paper generalizes the theoretical results widely known for MSL estimators to a general set of maximum approximated likelihood (MAL) estimators. We provide general conditions for both the model and the approximation approach to ensure consistency and asymptotic normality. We also show specific examples and finite-sample simulation results.

econ.EM↗

arXiv2019

On the Numerical Approximation of the Karhunen-Loève Expansion for Lognormal Random Fields

The Karhunen-Loève (KL) expansion is a popular method for approximating random fields by transforming an infinite-dimensional stochastic domain into a finite-dimensional parameter space. Its numerical approximation is of central importance to the study of PDEs with random coefficients. In this work, we analyze the approximation error of the Karhunen-Loève expansion for lognormal random fields. We derive error estimates that allow the optimal balancing of the truncation error of the expansion, the Quasi Monte-Carlo error for sampling in the stochastic domain and the numerical approximation error in the physical domain. The estimate is given in the number $M$ of terms maintained in the KL expansion, in the number of sampling points $N$, and in the discretization mesh size $h$ in the physical domain employed in the numerical solution of the eigenvalue problems during the expansion. The result is used to quantify the error in PDEs with random coefficients. We complete the theoretical analysis with numerical experiments in one and multiple stochastic dimensions.

math.NA↗

arXiv2019

Kernel-based stochastic collocation for the random two-phase Navier-Stokes equations

In this work, we apply stochastic collocation methods with radial kernel basis functions for an uncertainty quantification of the random incompressible two-phase Navier-Stokes equations. Our approach is non-intrusive and we use the existing fluid dynamics solver NaSt3DGPF to solve the incompressible two-phase Navier-Stokes equation for each given realization. We are able to empirically show that the resulting kernel-based stochastic collocation is highly competitive in this setting and even outperforms some other standard methods.

math.NA↗

arXiv2019

Optimally rotated coordinate systems for adaptive least-squares regression on sparse grids

For low-dimensional data sets with a large amount of data points, standard kernel methods are usually not feasible for regression anymore. Besides simple linear models or involved heuristic deep learning models, grid-based discretizations of larger (kernel) model classes lead to algorithms, which naturally scale linearly in the amount of data points. For moderate-dimensional or high-dimensional regression tasks, these grid-based discretizations suffer from the curse of dimensionality. Here, sparse grid methods have proven to circumvent this problem to a large extent. In this context, space- and dimension-adaptive sparse grids, which can detect and exploit a given low effective dimensionality of nominally high-dimensional data, are particularly successful. They nevertheless rely on an axis-aligned structure of the solution and exhibit issues for data with predominantly skewed and rotated coordinates. In this paper we propose a preprocessing approach for these adaptive sparse grid algorithms that determines an optimized, problem-dependent coordinate system and, thus, reduces the effective dimensionality of a given data set in the ANOVA sense. We provide numerical examples on synthetic data as well as real-world data to show how an adaptive sparse grid least squares algorithm benefits from our preprocessing method.

cs.LG↗

arXiv2018

Multilevel quadrature for elliptic parametric partial differential equations in case of polygonal approximations of curved domains

Multilevel quadrature methods for parametric operator equations such as the multilevel (quasi-) Monte Carlo method are closely related to the sparse tensor product approximation between the spatial variable and the parameter. In this article, we employ this fact and reverse the multilevel quadrature method via the sparse grid construction by applying differences of quadrature rules to finite element discretizations of increasing resolution. Besides being algorithmically more efficient if the underlying quadrature rules are nested, this way of performing the sparse tensor product approximation enables the easy use of non-nested and even adaptively refined finite element meshes. Especially, we present a rigorous error and regularity analysis of the fully discrete solution, taking into account the effect of polygonal approximations to a curved physical domain and the numerical approximation of the bilinear form. Our results facilitate the construction of efficient multilevel quadrature methods based on deterministic quadrature rules. Numerical results in three spatial dimensions are provided to illustrate the approach.

math.NA↗

arXiv2018

Stochastic subspace correction methods and fault tolerance

We present convergence results in expectation for stochastic subspace correction schemes and their accelerated versions to solve symmetric positive-definite variational problems, and discuss their potential for achieving fault tolerance in an unreliable compute network. We employ the standard overlapping domain decomposition algorithm for PDE discretizations to discuss the latter aspect.

math.NA↗

arXiv2018

A representer theorem for deep kernel learning

In this paper we provide a finite-sample and an infinite-sample representer theorem for the concatenation of (linear combinations of) kernel functions of reproducing kernel Hilbert spaces. These results serve as mathematical foundation for the analysis of machine learning algorithms based on compositions of functions. As a direct consequence in the finite-sample case, the corresponding infinite-dimensional minimization problems can be recast into (nonlinear) finite-dimensional minimization problems, which can be tackled with nonlinear optimization algorithms. Moreover, we show how concatenated machine learning problems can be reformulated as neural networks and how our representer theorem applies to a broad class of state-of-the-art deep learning methods.

cs.LG↗

arXiv2018

Stochastic subspace correction in Hilbert space

We consider an incremental approximation method for solving variational problems in infinite-dimensional Hilbert spaces, where in each step a randomly and independently selected subproblem from an infinite collection of subproblems is solved. we show that convergence rates for the expectation of the squared error can be guaranteed under weaker conditions than previously established in [Constr. Approx. 44:1 (2016), 121-139]. A connection to the theory of learning algorithms in reproducing kernel Hilbert spaces is revealed.

math.NA↗

arXiv2017

An Adaptive Multiscale Approach for Electronic Structure Methods

In this paper, we introduce a new scheme for the efficient numerical treatment of the electronic Schrödinger equation for molecules. It is based on the combination of a many-body expansion, which corresponds to the so-called bond order dissection Anova approach, with a hierarchy of basis sets of increasing order. Here, the energy is represented as a finite sum of contributions associated to subsets of nuclei and basis sets in a telescoping sum like fashion. Under the assumption of data locality of the electronic density (nearsightedness of electronic matter), the terms of this expansion decay rapidly and higher terms may be neglected. We further extend the approach in a dimension-adaptive fashion to generate quasi-optimal approximations, i.e. a specific truncation of the hierarchical series such that the total benefit is maximized for a fixed amount of costs. This way, we are able to achieve substantial speed up factors compared to conventional first principles methods depending on the molecular system under consideration. In particular, the method can deal efficiently with molecular systems which include only a small active part that needs to be described by accurate but expensive models.

math.NA↗

arXiv2017

$\varepsilon$-dimension in infinite dimensional hyperbolic cross approximation and application to parametric elliptic PDEs

In this article, we present a cost-benefit analysis of the approximation in tensor products of Hilbert spaces of Sobolev-analytic type. The Sobolev part is defined on a finite dimensional domain, whereas the analytical space is defined on an infinite dimensional domain. As main mathematical tool, we use the $\varepsilon$-dimension of a subset in a Hilbert space. The $\varepsilon$-dimension gives the lowest number of linear information that is needed to approximate an element from the set in the norm of the Hilbert space up to an accuracy $\varepsilon>0$. From a practical point of view this means that we a priori fix an accuracy and ask for the amount of information to achieve this accuracy. Such an analysis usually requires sharp estimates on the cardinality of certain index sets which are in our case infinite-dimensional hyperbolic crosses. As main result, we obtain sharp bounds of the $\varepsilon$-dimension of the Sobolev-analytic-type function classes which depend only on the smoothness differences in the Sobolev spaces and the dimension of the finite dimensional domain where these spaces are defined. This implies in particular that, up to constants, the costs of the infinite dimensional (analytical) approximation problem is dominated by the finite-variate Sobolev approximation problem. We demonstrate this procedure with an examples of functions spaces stemming from the regularity theory of parametric partial differential equation.

math.NA↗

arXiv2016

Hilbert function space splittings on domains with infinitely many variables

We present an approach to defining Hilbert spaces of functions depending on infinitely many variables or parameters, with emphasis on a weighted tensor product construction based on stable space splittings, The construction has been used in an exemplary way for guiding dimension- and scale-adaptive algorithms in application areas such as statistical learning theory, reduced order modeling, and information-based complexity. We prove results on compact embeddings, norm equivalences, and the estimation of $epsilon$-dimensions. A new condition for the equivalence of weighted ANOVA and anchored norms is also given.

math.NA↗

arXiv2015

Hyperbolic cross approximation in infinite dimensions

We give tight upper and lower bounds of the cardinality of the index sets of certain hyperbolic crosses which reflect mixed Sobolev-Korobov-type smoothness and mixed Sobolev-analytic-type smoothness in the infinite-dimensional case where specific summability properties of the smoothness indices are fulfilled. These estimates are then applied to the linear approximation of functions from the associated spaces in terms of the $\varepsilon$-dimension of their unit balls. Here, the approximation is based on linear information. Such function spaces appear for example for the solution of parametric and stochastic PDEs. The obtained upper and lower bounds of the approximation error as well as of the associated $\varepsilon$-complexities are completely independent of any dimension. Moreover, the rates are independent of the parameters which define the smoothness properties of the infinite-variate parametric or stochastic part of the solution. These parameters are only contained in the order constants. This way, linear approximation theory becomes possible in the infinite-dimensional case and corresponding infinite-dimensional problems get tractable.

math.NA↗

arXiv2015

Schwarz Iterative Methods: Infinite Space Splittings

We prove the convergence of greedy and randomized versions of Schwarz iterative methods for solving linear elliptic variational problems based on infinite space splittings of a Hilbert space. For the greedy case, we show a squared error decay rate of $O((m+1)^{-1})$ for elements of an approximation space $\mathcal{A}_1$ related to the underlying splitting. For the randomized case, we show an expected squared error decay rate of $O((m+1)^{-1})$ on a class $\mathcal{A}_{\infty}^π\subset \mathcal{A}_1$ depending on the probability distribution.

math.NA↗