Searcharxiv⌕ Search

arXiv subjects

Peter Kritzer

Publications and source records attributed to Peter Kritzer.

At least 37 records · Page 2Linked to original sources

Constructing lattice points for numerical integration by a reduced fast successive coordinate search algorithm

In this paper, we study an efficient algorithm for constructing node sets of high-quality quasi-Monte Carlo integration rules for weighted Korobov, Walsh, and Sobolev spaces. The algorithm presented is a reduced fast successive coordinate search (SCS) algorithm, which is adapted to situations where the weights in the function space show a sufficiently fast decay. The new SCS algorithm is designed to work for the construction of lattice points, and, in a modified version, for polynomial lattice points, and the corresponding integration rules can be used to treat functions in different kinds of function spaces. We show that the integration rules constructed by our algorithms satisfy error bounds of optimal convergence order. Furthermore, we give details on efficient implementation such that we obtain a considerable speed-up of previously known SCS algorithms. This improvement is illustrated by numerical results. The speed-up obtained by our results may be of particular interest in the context of QMC for PDEs with random coefficients, where both the dimension and the required numberof points are usually very large. Furthermore, our main theorems yield previously unknown generalizations of earlier results.

math.NA↗

Exponential tractability of linear weighted tensor product problems in the worst-case setting for arbitrary linear functionals

We study the approximation of compact linear operators defined over certain weighted tensor product Hilbert spaces. The information complexity is defined as the minimal number of arbitrary linear functionals which is needed to obtain an $\varepsilon$-approximation for the $d$-variate problem. It is fully determined in terms of the weights and univariate singular values. Exponential tractability means that the information complexity is bounded by a certain function which depends polynomially on $d$ and logarithmically on $\varepsilon^{-1}$. The corresponding un-weighted problem was studied recently by Hickernell, Kritzer and Woźniakowski with many negative results for exponential tractability. The product weights studied in the present paper change the situation. Depending on the form of polynomial dependence on $d$ and logarithmic dependence on $\varepsilon^{-1}$, we study exponential strong polynomial, exponential polynomial, exponential quasi-polynomial, and exponential $(s,t)$-weak tractability with $\max(s,t)\ge1$. For all these notions of exponential tractability, we establish necessary and sufficient conditions on weights and univariate singular values for which it is indeed possible to achieve the corresponding notion of exponential tractability. The case of exponential $(s,t)$-weak tractability with $\max(s,t)<1$ is left for future study.

math.NA↗

On Quasi-Monte Carlo Methods in Weighted ANOVA Spaces

In the present paper we study quasi-Monte Carlo rules for approximating integrals over the $d$-dimensional unit cube for functions from weighted Sobolev spaces of regularity one. While the properties of these rules are well understood for anchored Sobolev spaces, this is not the case for the ANOVA spaces, which are another very important type of reference spaces for quasi-Monte Carlo rules. Using a direct approach we provide a formula for the worst case error of quasi-Monte Carlo rules for functions from weighted ANOVA spaces. As a consequence we bound the worst case error from above in terms of weighted discrepancy of the employed integration nodes. On the other hand we also obtain a general lower bound in terms of the number $n$ of used integration nodes. For the one-dimensional case our results lead to the optimal integration rule and also in the two-dimensional case we provide rules yielding optimal convergence rates.

math.NA↗

Digit-by-digit and component-by-component constructions of lattice rules for periodic functions with unknown smoothness

Lattice rules are among the most prominently studied quasi-Monte Carlo methods to approximate multivariate integrals. A rank-1 lattice rule to approximate an $s$-dimensional integral is fully specified by its generating vector $\mathbf{z} \in \mathbb{Z}^s$ and its number of points $N$. While there are many results on the existence of "good" rank-1 lattice rules, there are no explicit constructions for good generating vectors for dimensions $s \ge 3$. This is why one usually resorts to computer search algorithms. Motivated by earlier work of Korobov from 1963 and 1982, we present two variants of search algorithms for good lattice rules and show that the resulting rules exhibit a convergence rate in weighted function spaces that can be arbitrarily close to the optimal rate. Moreover, contrary to most other algorithms, we do not need to know the smoothness of our integrands in advance, the generating vector will still recover the convergence rate associated with the smoothness of the particular integrand, and, under appropriate conditions on the weights, the error bounds can be stated without dependence on $s$. The search algorithms presented in this paper are two variants of the well-known component-by-component (CBC) construction, one of which is combined with a digit-by-digit (DBD) construction. We present numerical results for both algorithms using fast construction algorithms in the case of product weights. They confirm our theoretical findings.

math.NA↗

Adaptive Approximation for Multivariate Linear Problems with Inputs Lying in a Cone

We study adaptive approximation algorithms for general multivariate linear problems where the sets of input functions are non-convex cones. While it is known that adaptive algorithms perform essentially no better than non-adaptive algorithms for convex input sets, the situation may be different for non-convex sets. A typical example considered here is function approximation based on series expansions. Given an error tolerance, we use series coefficients of the input to construct an approximate solution such that the error does not exceed this tolerance. We study the situation where we can bound the norm of the input based on a pilot sample, and the situation where we keep track of the decay rate of the series coefficients of the input. Moreover, we consider situations where it makes sense to infer coordinate and smoothness importance. Besides performing an error analysis, we also study the information cost of our algorithms and the computational complexity of our problems, and we identify conditions under which we can avoid a curse of dimensionality.

math.NA↗

Constructing QMC finite element methods for elliptic PDEs with random coefficients by a reduced CBC construction

In the analysis of using quasi-Monte Carlo (QMC) methods to approximate expectations of a linear functional of the solution of an elliptic PDE with random diffusion coefficient the sensitivity w.r.t. the parameters is often stated in terms of product-and-order-dependent (POD) weights. The (offline) fast component-by-component (CBC) construction of an $N$-point QMC method making use of these POD weights leads to a cost of $\mathcal{O}(s N \log(N) + s^2 N)$ with $s$ the parameter truncation dimension. When $s$ is large this cost is prohibitive. As an alternative Herrmann and Schwab introduced an analysis resulting in product weights to reduce the construction cost to $\mathcal{O}(s N \log(N))$. We here show how the reduced CBC method can be used for POD weights to reduce the cost to $\mathcal{O}(\sum_{j=1}^{\min\{s,s^*\}} (m-w_j+j) \, b^{m-w_j})$, where $N=b^m$ with prime $b$, $w_1 \le \cdots \le w_s$ are nonnegative integers and $s^*$ can be chosen much smaller than $s$ depending on the regularity of the random field expansion as such making it possible to use the POD weights directly. We show a total error estimate for using randomly shifted lattice rules constructed through the reduced CBC construction.

math.NA↗

Approximation methods for piecewise deterministic Markov processes and their costs

In this paper, we analyse piecewise deterministic Markov processes, as introduced in Davis (1984). Many models in insurance mathematics can be formulated in terms of the general concept of piecewise deterministic Markov processes. In this context, one is interested in computing certain quantities of interest such as the probability of ruin of an insurance company, or the insurance company's value, defined as the expected discounted future dividend payments until the time of ruin. Instead of explicitly solving the integro-(partial) differential equation related to the quantity of interest considered (an approach which can only be used in few special cases), we adapt the problem in a manner that allows us to apply deterministic numerical integration algorithms such as quasi-Monte Carlo rules; this is in contrast to applying random integration algorithms such as Monte Carlo. To this end, we reformulate a general cost functional as a fixed point of a particular integral operator, which allows for iterative approximation of the functional. Furthermore, we introduce a smoothing technique which is applied to the integrands involved, in order to use error bounds for deterministic cubature rules. On the analytical side, we prove a convergence result for our PDMP approximation, which is of independent interest as it justifies phase-type approximations on the process level. We illustrate the smoothing technique for a risk-theoretic example, and provide a comparative study of deterministic and Monte Carlo integration.

math.PR↗

On efficient weighted integration via a change of variables

In this paper, we study the approximation of $d$-dimensional $ρ$-weighted integrals over unbounded domains $\mathbb{R}_+^d$ or $\mathbb{R}^d$ using a special change of variables, so that quasi-Monte Carlo (QMC) or sparse grid rules can be applied to the transformed integrands over the unit cube. We consider a class of integrands with bounded $L_p$ norm of mixed partial derivatives of first order, where $p\in[1,+\infty].$ The main results give sufficient conditions on the change of variables $ν$ which guarantee that the transformed integrand belongs to the standard Sobolev space of functions over the unit cube with mixed smoothness of order one. These conditions depend on $ρ$ and $p$. The proposed change of variables is in general different than the standard change based on the inverse of the cumulative distribution function. We stress that the standard change of variables leads to integrands over a cube; however, those integrands have singularities which make the application of QMC and sparse grids ineffective. Our conclusions are supported by numerical experiments.

math.NA↗

Exponential tractability of linear tensor product problems

In this article we consider the approximation of compact linear operators defined over tensor product Hilbert spaces. Necessary and sufficient conditions on the singular values of the problem under which we can or cannot achieve different notions of exponential tractability are given in a paper by Papageorgiou, Petras, and Wozniakowski. In this paper, we use the new equivalency conditions shown in a recent paper by the second and third authors of this paper to obtain these results in an alternative way. As opposed to the algebraic setting, quasi-polynomial tractability is not possible for non-trivial cases in the exponential setting.

math.NA↗

Lattice rules with random $n$ achieve nearly the optimal $\mathcal{O}(n^{-α-1/2})$ error independently of the dimension

We analyze a new random algorithm for numerical integration of $d$-variate functions over $[0,1]^d$ from a weighted Sobolev space with dominating mixed smoothness $α\ge 0$ and product weights $1\geγ_1\geγ_2\ge\cdots>0$, where the functions are continuous and periodic when $α>1/2$. The algorithm is based on rank-$1$ lattice rules with a random number of points~$n$. For the case $α>1/2$, we prove that the algorithm achieves almost the optimal order of convergence of $\mathcal{O}(n^{-α-1/2})$, where the implied constant is independent of the dimension~$d$ if the weights satisfy $\sum_{j=1}^\infty γ_j^{1/α}<\infty$. The same rate of convergence holds for the more general case $α>0$ by adding a random shift to the lattice rule with random $n$. This shows, in particular, that the exponent of strong tractability in the randomized setting equals $1/(α+1/2)$, if the weights decay fast enough. We obtain a lower bound to indicate that our results are essentially optimal. This paper is a significant advancement over previous related works with respect to the potential for implementation and the independence of error bounds on the problem dimension. Other known algorithms which achieve the optimal error bounds, such as those based on Frolov's method, are very difficult to implement especially in high dimensions. Here we adapt a lesser-known randomization technique introduced by Bakhvalov in 1961. This algorithm is based on rank-$1$ lattice rules which are very easy to implement given the integer generating vectors. A simple probabilistic approach can be used to obtain suitable generating vectors.

math.NA↗

Notes on tractability conditions for linear multivariate problems

We study approximations of compact linear multivariate operators defined over Hilbert spaces. We provide necessary and sufficient conditions on various notions of tractability. These conditions are mainly given in terms of sums of certain functions depending on the singular values of the multivariate problem. They do not require the ordering of these singular values which in many cases is difficult to achieve.

math.NA↗

Truncation Dimension for Linear Problems on Multivariate Function Spaces

The paper considers linear problems on weighted spaces of multivariate functions of many variables. The main questions addressed are: When is it possible to approximate the solution for the original function of very many variables by the solution for the same function; however with all but the first $k$ variables set to zero, so that the corresponding error is small? What is the truncation dimension, i.e., the smallest number $k=k(\varepsilon)$ such that the corresponding error is bounded by a given error demand $\varepsilon$? Surprisingly, $k(\varepsilon)$ could be very small even for weights with a modest speed of convergence to zero.

math.NA↗

Truncation in Average and Worst Case Settings for Special Classes of $\infty$-Variate Functions

The paper considers truncation errors for functions of the form $f(x_1,x_2,\dots)=g(\sum_{j=1}^\infty x_j\,ξ_j)$, i.e., errors of approximating $f$ by $f_k(x_1,\dots,x_k)=g(\sum_{j=1}^k x_j\,ξ_j)$, where the numbers $ξ_j$ converge to zero sufficiently fast and $x_j$'s are i.i.d. random variables. As explained in the introduction, functions $f$ of the form above appear in a number of important applications. To have positive results for possibly large classes of such functions, the paper provides sharp bounds on truncation errors in both the average and worst case settings. In the former case, the functions $g$ are from a Hilbert space $G$ endowed with a zero mean probability measure with a given covariance kernel. In the latter case, the functions $g$ are from a reproducing kernel Hilbert space, or a space of functions satisfying a Hölder condition.

math.NA↗

Tractability of $\mathbb{L}_2$-approximation in hybrid function spaces

We consider multivariate $\mathbb{L}_2$-approximation in reproducing kernel Hilbert spaces which are tensor products of weighted Walsh spaces and weighted Korobov spaces. We study the minimal worst-case error $e^{\mathbb{L}_2-\mathrm{app},Λ}(N,d)$ of all algorithms that use $N$ information evaluations from the class $Λ$ in the $d$-dimensional case. The two classes $Λ$ considered in this paper are the class $Λ^{\rm all}$ consisting of all linear functionals and the class $Λ^{\rm std}$ consisting only of function evaluations. The focus lies on the dependence of $e^{\mathbb{L}_2-\mathrm{app},Λ}(N,d)$ on the dimension $d$. The main results are conditions for weak, polynomial, and strong polynomial tractability.

math.NA↗

Truncation Dimension for Function Approximation

We consider approximation of functions of $s$ variables, where $s$ is very large or infinite, that belong to weighted anchored spaces. We study when such functions can be approximated by algorithms designed for functions with only very small number ${\rm dim^{trnc}}(\varepsilon)$ of variables. Here $\varepsilon$ is the error demand and we refer to ${\rm dim^{trnc}}(\varepsilon)$ as the $\varepsilon$-truncation dimension. We show that for sufficiently fast decaying product weights and modest error demand (up to about $\varepsilon \approx 10^{-5}$) the truncation dimension is surprisingly very small.

math.NA↗

$\boldsymbol{L}_{\infty}$-approximation in Korobov spaces with Exponential Weights

We study multivariate $\boldsymbol{L}_{\infty}$-approximation for a weighted Korobov space of periodic functions for which the Fourier coefficients decay exponentially fast. The weights are defined, in particular, in terms of two sequences $\boldsymbol{a}=\{a_j\}$ and $\boldsymbol{b}=\{b_j\}$ of positive real numbers bounded away from zero. We study the minimal worst-case error $e^{\boldsymbol{L}_{\infty}\mathrm{-app},Λ}(n,s)$ of all algorithms that use $n$ information evaluations from a class $Λ$ in the $s$-variate case. We consider two classes $Λ$ in this paper: the class $Λ^{\rm all}$ of all linear functionals and the class $Λ^{\rm std}$ of only function evaluations. We study exponential convergence of the minimal worst-case error, which means that $e^{\boldsymbol{L}_{\infty}\mathrm{-app},Λ}(n,s)$ converges to zero exponentially fast with increasing $n$. Furthermore, we consider how the error depends on the dimension $s$. To this end, we define the notions of $κ$-EC-weak, EC-polynomial and EC-strong polynomial tractability, where EC stands for "exponential convergence". In particular, EC-polynomial tractability means that we need a polynomial number of information evaluations in $s$ and $1+\log\,\varepsilon^{-1}$ to compute an $\varepsilon$-approximation. We derive necessary and sufficient conditions on the sequences $\boldsymbol{a}$ and $\boldsymbol{b}$ for obtaining exponential error convergence, and also for obtaining the various notions of tractability. The results are the same for both classes $Λ$.

math.NA↗

On Equivalence of Anchored and ANOVA Spaces; Lower Bounds

We provide lower bounds for the norms of embeddings between $\boldsymbolγ$-weighted Anchored and ANOVA spaces of $s$-variate functions with mixed partial derivatives of order one bounded in $L_p$ norm ($p\in[1,\infty]$). In particular we show that the norms behave polynomially in $s$ for Finite Order Weights and Finite Diameter Weights if $p>1$, and increase faster than any polynomial in $s$ for Product Order-Dependent Weights and any $p$.

math.NA↗

Integration and approximation in cosine spaces of smooth functions

We study multivariate integration and approximation for functions belonging to a weighted reproducing kernel Hilbert space based on half-period cosine functions in the worst-case setting. The weights in the norm of the function space depend on two sequences of real numbers and decay exponentially. As a consequence the functions are infinitely often differentiable, and therefore it is natural to expect exponential convergence of the worst-case error. We give conditions on the weight sequences under which we have exponential convergence for the integration as well as the approximation problem. Furthermore, we investigate the dependence of the errors on the dimension by considering various notions of tractability. We prove sufficient and necessary conditions to achieve these tractability notions.

math.NA↗