SearcharxivSearch

arXiv subjects

V. Temlyakov

Publications and source records attributed to V. Temlyakov.

At least 19 recordsLinked to original sources

Some theoretical and practical results on noisy signals recovery

We discuss some theoretical results and their applications to specific practical problems from wireless communications. We assume that we know the noisy version of the signal, which is sparse with respect to a given system of elements (dictionary), at a finite number of points and we want to approximately recover it. This problem of recovery of a noisy signal is closely related to the problem of establishing the Lebesgue-type inequalities for the corresponding algorithms and it motivates us to prove such inequalities. Under certain conditions on a dictionary (RIP-type condition, coherence condition) we obtain different kinds of the Lebesgue-type inequalities for the OMP and its version WOMP algorithms. The most important feature of our new theoretical result is the assumption that the dictionary has the RIP-type property instead of the assumption that it is the Riesz basis, which was used in the previous results. Our approach allows us to treat redundant (overcomplete) systems, which is important in applications. We consider the setting of sparse recovery for highly-coherent dictionaries that appear in OFDM setting for wireless communication. Our main example is the oversampled Fourier dictionary and the recovery of the frequency response of a sparse channel. We develop a general approach to such problems and we prove that under certain conditions the OMP algorithm recovers all dictionary elements with large coefficients, and estimate its accuracy (in NMSE metric) in terms of signal-to-noise ratio.

math.NA

Nonlinear approximation with adaptive dictionaries

It is well known that the study of the Kolmogorov widths of a function class, which is the image of the unit ball of the $L_q$ space of an integral operator $J_K$ with the kernel $K$, is closely connected with the study of sparse approximations of the kernel $K$ with respect to the classical bilinear dictionary. Recently, it was discovered that if instead of the Kolmogorov widths we study the errors of optimal linear sampling recovery of the same classes, then we need to study sparse approximations of the kernel $K$ with respect to an adaptive dictionary, which is determined by the kernel $K$. In this paper we study this important problem of nonlinear approximation with respect to an adaptive dictionary. Also, in this paper we continue to develop the following general approach, which is related to the above nonlinear approximation problem. We study asymptotic behavior of the errors of sampling recovery not for an individual smoothness class, how it is usually done, but for the collection of classes, which are defined by integral operators with kernels coming from a given class of functions. Earlier, such approach was realized for the Kolmogorov widths and very recently for the entropy numbers.

math.NA

A survey of sampling discretization of integral and uniform norms

This paper surveys recent developments in the sampling discretization of integral and uniform norms for functions in general finite-dimensional spaces. These results generalize the classical Marcinkiewicz-Zygmund inequalities for trigonometric and algebraic polynomials, which play a crucial role in Fourier analysis, interpolation, and approximation theory. We focus on the problem in the broad context of finite-dimensional subspaces, where norms defined by general probability measures are approximated by their discrete counterparts. The primary emphasis is on results closely related to the authors' recent research. A key objective is to highlight the main ideas and techniques that form the foundation of the proofs in this area. This survey serves as a complement to three recently published survey papers on sampling discretization \cite{DPTT, KKLT, LMT}.

math.NA

Sampling recovery on classes defined by integral operators and sparse approximation with adaptive dictionaries

In this paper we continue to develop the following general approach. We study asymptotic behavior of the errors of sampling recovery not for an individual smoothness class, how it is usually done, but for the collection of classes, which are defined by integral operators with kernels coming from a given class of functions. Earlier, such approach was realized for the Kolmogorov widths and very recently for the entropy numbers. It turns out that the above problem is closely related to the sparse approximation problem with respect to different redundant dictionaries. Specifically, the problem of sampling recovery is connected with sparse nonlinear approximation with respect to adaptive dictionaries, which means that the dictionary depends on the function under approximation.

math.NA

A survey on sampling recovery

The reconstruction of unknown functions from a finite number of samples is a fundamental challenge in pure and applied mathematics. This survey provides a comprehensive overview of recent developments in sampling recovery, focusing on the accuracy of various algorithms and the relationship between optimal recovery errors, nonlinear approximation, and the Kolmogorov widths of function classes. A central theme is the synergy between the theory of universal sampling discretization and Lebesgue-type inequalities for greedy algorithms. We discuss three primary algorithmic frameworks: weighted least squares and $\ell_p$ minimization, sparse approximation methods, and greedy algorithms such as the Weak Orthogonal Matching Pursuit (WOMP) in Hilbert spaces and the Weak Tchebychev Greedy Algorithm (WCGA) in Banach spaces. These methods are applied to function classes defined by structural conditions, like the $A_\beta^r$ and Wiener-type classes, as well as classical Sobolev-type classes with dominated mixed derivatives. Notably, we highlight recent findings showing that nonlinear sampling recovery can provide superior error guarantees compared to linear methods for certain multivariate function classes.

math.NA

Entropy numbers of classes defined by integral operators

In this paper we develop the following general approach. We study asymptotic behavior of the entropy numbers not for an individual smoothness class, how it is usually done, but for the collection of classes, which are defined by integral operators with kernels coming from a given class of functions. Earlier, such approach was realized for the Kolmogorov widths.

math.NA

Brief introduction in greedy approximation

Sparse approximation is important in many applications because of concise form of an approximant and good accuracy guarantees. The theory of compressed sensing, which proved to be very useful in the image processing and data sciences, is based on the concept of sparsity. A fundamental issue of sparse approximation is the problem of construction of efficient algorithms, which provide good approximation. It turns out that greedy algorithms with respect to dictionaries are very good from this point of view. They are simple in implementation and there are well developed theoretical guarantees of their efficiency. This survey/tutorial paper contains brief description of different kinds of greedy algorithms and results on their convergence and rate of convergence. Also, Chapter IV gives some typical proofs of convergence and rate of convergence results for important greedy algorithms and Chapter V gives some open problems.

math.NA

Some lower bounds for optimal sampling recovery of functions with mixed smoothness

Recently, there was a substantial progress in the problem of sampling recovery on function classes with mixed smoothness. Mostly, it has been done by proving new and sometimes optimal upper bounds for both linear sampling recovery and for nonlinear sampling recovery. In this paper we address the problem of lower bounds for the optimal rates of nonlinear sampling recovery. In the case of linear recovery one can use the well developed theory of estimating the Kolmogorov and linear widths for establishing some lower bounds for the optimal rates. In the case of nonlinear recovery we cannot use the above approach. It seems like the only technique, which is available now, is based on some simple observations. We demonstrate how these observations can be used.

math.NA

On greedy approximation in complex Banach spaces

The general theory of greedy approximation with respect to arbitrary dictionaries is well developed in the case of real Banach spaces. Recently, some of results proved for the Weak Chebyshev Greedy Algorithm (WCGA) in the case of real Banach spaces were extended to the case of complex Banach spaces. In this paper we extend some of known in the real case results for other than WCGA greedy algorithms to the case of complex Banach spaces.

math.FA

Sampling recovery on function classes with a structural condition

Sampling recovery on some function classes is studied in this paper. Typically, function classes are defined by imposing smoothness conditions. It was understood in nonlinear approximation that structural conditions in the form of control of the number of big coefficients of an expansion of a function with respect to a given system of functions plays an important role. Sampling recovery on smoothness classes is an area of active research, some problems, especially in the case of mixed smoothness classes, are still open. It was discovered recently that universal sampling discretization and nonlinear sparse approximations are useful in the sampling recovery problem. This motivated us to systematically study sampling recovery on function classes with a structural condition. Some results in this direction are already known. In particular, the classes defined by conditions on coefficients with indices from the domains, which are differences of two dyadic cubes are studied in the recent author's papers. In this paper we concentrate on studying function classes defined by conditions on coefficients with indices from the domains, which are differences of two dyadic hyperbolic crosses.

math.NA

Sparse sampling recovery in integral norms on some function classes

This paper is a direct followup of the recent author's paper. In this paper we continue to analyze approximation and recovery properties with respect to systems satisfying universal sampling discretization property and a special unconditionality property. In addition we assume that the subspace spanned by our system satisfies some Nikol'skii-type inequalities. We concentrate on recovery with the error measured in the $L_p$ norm for $2\le p<\infty$. We apply a powerful nonlinear approximation method -- the Weak Orthogonal Matching Pursuit (WOMP) also known under the name Weak Orthogonal Greedy Algorithm (WOGA). We establish that the WOMP based on good points for the $L_2$-universal discretization provides good recovery in the $L_p$ norm for $2\le p<\infty$. For our recovery algorithms we obtain both the Lebesgue-type inequalities for individual functions and the error bounds for special classes of multivariate functions. We combine here two deep and powerful techniques -- Lebesgue-type inequalities for the WOMP and theory of the universal sampling dicretization -- in order to obtain new results in sampling recovery.

math.NA

Sparse sampling recovery by greedy algorithms

In this paper we analyze approximation and recovery properties with respect to systems satisfying universal sampling discretization property and a special incoherence property. We apply a powerful nonlinear approximation method -- the Weak Chebyshev Greedy Algorithm (WCGA). We establish that the WCGA based on good points for the $L_p$-universal discretization provides good recovery in the $L_p$ norm. For our recovery algorithms we obtain both the Lebesgue-type inequalities for individual functions and the error bounds for special classes of multivariate functions. The main point of the paper is that we combine here two deep and powerful techniques -- Lebesgue-type inequalities for the WCGA and theory of the universal sampling dicretization -- in order to obtain new results in sampling recovery.

math.NA

Lebesgue-type inequalities in sparse sampling recovery

Recently, it has been discovered that results on universal sampling discretization of the square norm are useful in sparse sampling recovery with error being measured in the square norm. It was established that a simple greedy type algorithm -- Weak Orthogonal Matching Pursuit -- based on good points for universal discretization provides effective recovery in the square norm. In this paper we extend those results by replacing the square norm with other integral norms. In this case we need to conduct our analysis in a Banach space rather than in a Hilbert space, making the techniques more involved. In particular, we establish that a greedy type algorithm -- Weak Chebyshev Greedy Algorithm -- based on good points for the $L_p$-universal discretization provides good recovery in the $L_p$ norm for $2\le p<\infty$. Furthermore, we discuss the problem of stable recovery and demonstrate its close relationship with sampling discretization.

math.NA

Random points are good for universal discretization

There has been significant progress in the study of sampling discretization of integral norms for both a designated finite-dimensional function space and a finite collection of such function spaces (universal discretization). Sampling discretization results turn out to be very useful in various applications, particularly in sampling recovery. Recent sampling discretization results typically provide existence of good sampling points for discretization. In this paper, we show that independent and identically distributed random points provide good universal discretization with high probability. Furthermore, we demonstrate that a simple greedy algorithm based on those points that are good for universal discretization provides excellent sparse recovery results in the square norm.

math.FA

Universal discretization and sparse sampling recovery

Recently, it was discovered that for a given function class $\mathbf{F}$ the error of best linear recovery in the square norm can be bounded above by the Kolmogorov width of $\mathbf{F}$ in the uniform norm. That analysis is based on deep results in discretization of the square norm of functions from finite dimensional subspaces. In this paper we show how very recent results on universal discretization of the square norm of functions from a collection of finite dimensional subspaces lead to an inequality between optimal sparse recovery in the square norm and best sparse approximations in the uniform norm with respect to appropriate dictionaries.

math.NA

Some improved bounds in sampling discretization of integral norms

The paper addresses a problem of sampling discretization of integral norms of elements of finite-dimensional subspaces satisfying some conditions. We prove sampling discretization results under a standard assumption formulated in terms of the Nikol'skii-type inequality. {In particular, we obtain} some upper bounds on the number of sample points sufficient for good discretization of the integral $L_p$ norms, $1\le p<2$, of functions from finite-dimensional subspaces of continuous functions. Our new results improve upon the known results in this direction. We use a new technique based on deep results of Talagrand from functional analysis.

math.FA

On the cardinality of lower sets and universal discretization

A set $Q$ in $\mathbb{Z}_+^d$ is a lower set if $(k_1,\dots,k_d)\in Q$ implies $(l_1,\dots,l_d)\in Q$ whenever $0\le l_i\le k_i$ for all $i$. We derive new and refine known results regarding the cardinality of the lower sets of size $n$ in $\mathbb{Z}_+^d$. Next we apply these results for universal discretization of the $L_2$-norm of elements from $n$-dimensional subspaces of trigonometric polynomials generated by lower sets.

math.NA

Sampling discretization of integral norms and its application

The paper addresses the problem of sampling discretization of integral norms of elements of finite-dimensional subspaces satisfying some conditions. We prove sampling discretization results under two standard kinds of assumptions -- conditions on the entropy numbers and conditions in terms of the Nikol'skii-type inequalities. We prove some upper bounds on the number of sample points sufficient for good discretization and show that these upper bounds are sharp in a certain sense. Then we apply our general conditional results to subspaces with special structures, namely, subspaces with the tensor product structure. We demonstrate that applications of results based on the Nikol'skii-type inequalities provide somewhat better results than applications of results based on the entropy numbers conditions. Finally, we apply discretization results to the problem of sampling recovery.

math.NA