arXiv subjects

Gitta Kutyniok

Publications and source records attributed to Gitta Kutyniok.

At least 127 records · Page 7Linked to original sources

arXiv2016

Sparse Proteomics Analysis - A compressed sensing-based approach for feature selection and classification of high-dimensional proteomics mass spectrometry data

Background: High-throughput proteomics techniques, such as mass spectrometry (MS)-based approaches, produce very high-dimensional data-sets. In a clinical setting one is often interested in how mass spectra differ between patients of different classes, for example spectra from healthy patients vs. spectra from patients having a particular disease. Machine learning algorithms are needed to (a) identify these discriminating features and (b) classify unknown spectra based on this feature set. Since the acquired data is usually noisy, the algorithms should be robust against noise and outliers, while the identified feature set should be as small as possible. Results: We present a new algorithm, Sparse Proteomics Analysis (SPA), based on the theory of compressed sensing that allows us to identify a minimal discriminating set of features from mass spectrometry data-sets. We show (1) how our method performs on artificial and real-world data-sets, (2) that its performance is competitive with standard (and widely used) algorithms for analyzing proteomics data, and (3) that it is robust against random and systematic noise. We further demonstrate the applicability of our algorithm to two previously published clinical data-sets.

math.ST↗

arXiv2016

Compressed Sensing for Finite-Valued Signals

The need of reconstructing discrete-valued sparse signals from few measurements, that is solving an undetermined system of linear equations, appears frequently in science and engineering. Whereas classical compressed sensing algorithms do not incorporate the additional knowledge of the discrete nature of the signal, classical lattice decoding approaches such as the sphere decoder do not utilize sparsity constraints. In this work, we present an approach that incorporates a discrete values prior into basis pursuit. In particular, we address unipolar binary and bipolar ternary sparse signals, i.e., sparse signals with entries in $\{0,1\}$, respectively in $\{-1,0,1\}$. We will show that phase transition takes place earlier than when using the classical basis pursuit approach and that, independently of the sparsity of the signal, at most $N/2$, respectively $3N/4$, measurements are necessary to recover a unipolar binary, and a bipolar ternary signal uniquely, where $N$ is the dimension of the ambient space. We will further discuss robustness of the algorithm and generalizations to signals with entries in larger alphabets.

math.OC↗

arXiv2016

The Effect of Perturbations of Operator-Valued Frame Sequences and Fusion Frames on Their Duals

Fusion frames, and, more generally, operator-valued frame sequences are generalizations of classical frames, which are today a standard notion when redundant, yet stable sequences are required. However, the question of stability of duals with respect to perturbations has not been satisfactorily answered. In this paper, we quantitatively measure this stability by considering the associated deviations of the canonical and alternate dual sequences from the original ones. It is proven that operator-valued frame sequences are indeed stable in this sense. Along the way, we also generalize existing definitions for fusion frame duals to the infinite-dimensional situation and analyze how they perform with respect to a list of desiderata which, to our minds, a fusion frame dual should satisfy. Finally, we prove a similar stability result as above for fusion frames and their canonical duals.

math.FA↗

arXiv2016

A Mathematical Framework for Feature Selection from Real-World Data with Non-Linear Observations

In this paper, we study the challenge of feature selection based on a relatively small collection of sample pairs $\{(x_i, y_i)\}_{1 \leq i \leq m}$. The observations $y_i \in \mathbb{R}$ are thereby supposed to follow a noisy single-index model, depending on a certain set of signal variables. A major difficulty is that these variables usually cannot be observed directly, but rather arise as hidden factors in the actual data vectors $x_i \in \mathbb{R}^d$ (feature variables). We will prove that a successful variable selection is still possible in this setup, even when the applied estimator does not have any knowledge of the underlying model parameters and only takes the 'raw' samples $\{(x_i, y_i)\}_{1 \leq i \leq m}$ as input. The model assumptions of our results will be fairly general, allowing for non-linear observations, arbitrary convex signal structures as well as strictly convex loss functions. This is particularly appealing for practical purposes, since in many applications, already standard methods, e.g., the Lasso or logistic regression, yield surprisingly good outcomes. Apart from a general discussion of the practical scope of our theoretical findings, we will also derive a rigorous guarantee for a specific real-world problem, namely sparse feature extraction from (proteomics-based) mass spectrometry data.

stat.ML↗

arXiv2016

Regularization and Numerical Solution of the Inverse Scattering Problem using Shearlet Frames

Regularization techniques for the numerical solution of inverse scattering problems in two space dimensions are discussed. Assuming that the boundary of a scatterer is its most prominent feature, we exploit as model the class of cartoon-like functions. Since functions in this class are asymptotically optimally sparsely approximated by shearlet frames, we consider shearlets as a means for regularization in a Tikhonov method. We analyze two approaches, namely solvers for the nonlinear problem and for the linearized problem obtained by the Born approximation technique. As example for the first class we study the acoustic inverse scattering problem, and for the second class, the inverse scattering problem of the Schrödinger equation. In both cases, we derive analytical results for our approaches. Whereas our emphasis for the linearized problem is more on the theoretical side due to the standardness of associated solvers, we provide numerical examples for the nonlinear problem that highlight the effectiveness of our algorithmic approach.

math.FA↗

arXiv2015

Optimal Compressive Imaging of Fourier Data

Applications such as Magnetic Resonance Tomography acquire imaging data by point samples of their Fourier transform. This raises the question of balancing the efficiency of the sampling strategies with the approximation accuracy of an associated reconstruction procedure. In this paper, we introduce a novel sampling-reconstruction scheme based on a random anisotropic sampling pattern and a compressed sensing type reconstruction strategy with a variant of dualizable shearlet frames as sparsifying representation system. For this scheme, we prove asymptotic optimality in an approximation theoretic sense for cartoon-like functions as a model class for the imaging data. Finally, we present numerical experiments showing the superiority of our scheme over other approaches.

math.NA↗

arXiv2015

Classification of Edges Using Compactly Supported Shearlets

We analyze the detection and classification of singularities of functions $f = χ_B$, where $B \subset \mathbb{R}^d$ and $d = 2,3$. It will be shown how the set $\partial B$ can be extracted by a continuous shearlet transform associated with compactly supported shearlets. Furthermore, if $\partial S$ is a $d-1$ dimensional piecewise smooth manifold with $d=2$ or $3$, we will classify smooth and non-smooth components of $\partial S$. This improves previous results given for shearlet systems with a certain band-limited generator, since the estimates we derive are uniform. Moreover, we will show that our bounds are optimal. Along the way, we also obtain novel results on the characterization of wavefront sets in $3$ dimensions by compactly supported shearlets. Finally, geometric properties of $\partial S$ such as curvature are described in terms of the continuous shearlet transform of $f$.

math.FA↗

arXiv2014

Dualizable Shearlet Frames and Sparse Approximation

Shearlet systems have been introduced as directional representation systems, which provide optimally sparse approximations of a certain model class of functions governed by anisotropic features while allowing faithful numerical realizations by a unified treatment of the continuum and digital realm. They are redundant systems, and their frame properties have been extensively studied. In contrast to certain band-limited shearlets, compactly supported shearlets provide high spatial localization, but do not constitute Parseval frames. Thus reconstruction of a signal from shearlet coefficients requires knowledge of a dual frame. However, no closed and easily computable form of any dual frame is known. In this paper, we introduce the class of dualizable shearlet systems, which consist of compactly supported elements and can be proven to form frames for $L^2(\mathbb{R}^2)$. For each such dualizable shearlet system, we then provide an explicit construction of an associated dual frame, which can be stated in closed form and efficiently computed. We also show that dualizable shearlet frames still provide optimally sparse approximations of anisotropic features.

math.FA↗

arXiv2014

Efficient Resolution of Anisotropic Structures

We highlight some recent new delevelopments concerning the sparse representation of possibly high-dimensional functions exhibiting strong anisotropic features and low regularity in isotropic Sobolev or Besov scales. Specifically, we focus on the solution of transport equations which exhibit propagation of singularities where, additionally, high-dimensionality enters when the convection field, and hence the solutions, depend on parameters varying over some compact set. Important constituents of our approach are directionally adaptive discretization concepts motivated by compactly supported shearlet systems, and well-conditioned stable variational formulations that support trial spaces with anisotropic refinements with arbitrary directionalities. We prove that they provide tight error-residual relations which are used to contrive rigorously founded adaptive refinement schemes which converge in $L_2$. Moreover, in the context of parameter dependent problems we discuss two approaches serving different purposes and working under different regularity assumptions. For frequent query problems, making essential use of the novel well-conditioned variational formulations, a new Reduced Basis Method is outlined which exhibits a certain rate-optimal performance for indefinite, unsymmetric or singularly perturbed problems. For the radiative transfer problem with scattering a sparse tensor method is presented which mitigates or even overcomes the curse of dimensionality under suitable (so far still isotropic) regularity assumptions. Numerical examples for both methods illustrate the theoretical findings.

math.NA↗

arXiv2014

$α$-Molecules

Within the area of applied harmonic analysis, various multiscale systems such as wavelets, ridgelets, curvelets, and shearlets have been introduced and successfully applied. The key property of each of those systems are their (optimal) approximation properties in terms of the decay of the $L^2$-error of the best $N$-term approximation for a certain class of functions. In this paper, we introduce the general framework of $α$-molecules, which encompasses most multiscale systems from applied harmonic analysis, in particular, wavelets, ridgelets, curvelets, and shearlets as well as extensions of such with $α$ being a parameter measuring the degree of anisotropy, as a means to allow a unified treatment of approximation results within this area. Based on an $α$-scaled index distance, we first prove that two systems of $α$-molecules are almost orthogonal. This leads to a general methodology to transfer approximation results within this framework, provided that certain consistency and time-frequency localization conditions of the involved systems of $α$-molecules are satisfied. We finally utilize these results to enable the derivation of optimal sparse approximation results \msch{for} a specific class of cartoon-like functions by sufficient conditions on the 'control' parameters of a system of $α$-molecules.

math.FA↗

arXiv2014

Measures of scalability

Scalable frames are frames with the property that the frame vectors can be rescaled resulting in tight frames. However, if a frame is not scalable, one has to aim for an approximate procedure. For this, in this paper we introduce three novel quantitative measures of the closeness to scalability for frames in finite dimensional real Euclidean spaces. Besides the natural measure of scalability given by the distance of a frame to the set of scalable frames, another measure is obtained by optimizing a quadratic functional, while the third is given by the volume of the ellipsoid of minimal volume containing the symmetrized frame. After proving that these measures are equivalent in a certain sense, we establish bounds on the probability of a randomly selected frame to be scalable. In the process, we also derive new necessary and sufficient conditions for a frame to be scalable.

math.FA↗

arXiv2014

Asymptotic Analysis of Inpainting via Universal Shearlet Systems

Recently introduced inpainting algorithms using a combination of applied harmonic analysis and compressed sensing have turned out to be very successful. One key ingredient is a carefully chosen representation system which provides (optimally) sparse approximations of the original image. Due to the common assumption that images are typically governed by anisotropic features, directional representation systems have often been utilized. One prominent example of this class are shearlets, which have the additional benefitallowing faithful implementations. Numerical results show that shearlets significantly outperform wavelets in inpainting tasks. One of those software packages, www.shearlab.org, even offers the flexibility of usingdifferent parameter for each scale, which is not yet covered by shearlet theory. In this paper, we first introduce universal shearlet systems which are associated with an arbitrary scaling sequence, thereby modeling the previously mentioned flexibility. In addition, this novel construction allows for a smooth transition between wavelets and shearlets and therefore enables us to analyze them in a uniform fashion. For a large class of such scaling sequences, we first prove that the associated universal shearlet systems form band-limited Parseval frames for $L^2(\mathbb{R}^2)$ consisting of Schwartz functions. Secondly, we analyze the performance for inpainting of this class of universal shearlet systems within a distributional model situation using an $\ell^1$-analysis minimization algorithm for reconstruction. Our main result in this part states that, provided the scaling sequence is comparable to the size of the (scale-dependent) gap, nearly-perfect inpainting is achieved at sufficiently fine scales.

math.FA↗

arXiv2014

Cartoon Approximation with $α$-Curvelets

It is well-known that curvelets provide optimal approximations for so-called cartoon images which are defined as piecewise $C^2$-functions, separated by a $C^2$ singularity curve. In this paper, we consider the more general case of piecewise $C^β$-functions, separated by a $C^β$ singularity curve for $β\in (1,2]$. We first prove a benchmark result for the possibly achievable best $N$-term approximation rate for this more general signal model. Then we introduce what we call $α$-curvelets, which are systems that interpolate between wavelet systems on the one hand ($α= 1$) and curvelet systems on the other hand ($α= \frac12$). Our main result states that those frames achieve this optimal rate for $α= \frac{1}β$, up to $\log$-factors.

math.FA↗

arXiv2014

Linear Stable Sampling Rate: Optimality of 2D Wavelet Reconstructions from Fourier Measurements

In this paper we analyze two-dimensional wavelet reconstructions from Fourier samples within the framework of generalized sampling. For this, we consider both separable compactly-supported wavelets and boundary wavelets. We prove that the number of samples that must be acquired to ensure a stable and accurate reconstruction scales linearly with the number of reconstructing wavelet functions. We also provide numerical experiments that corroborate our theoretical results.

math.FA↗

arXiv2014

ShearLab 3D: Faithful Digital Shearlet Transforms based on Compactly Supported Shearlets

Wavelets and their associated transforms are highly efficient when approximating and analyzing one-dimensional signals. However, multivariate signals such as images or videos typically exhibit curvilinear singularities, which wavelets are provably deficient of sparsely approximating and also of analyzing in the sense of, for instance, detecting their direction. Shearlets are a directional representation system extending the wavelet framework, which overcomes those deficiencies. Similar to wavelets, shearlets allow a faithful implementation and fast associated transforms. In this paper, we will introduce a comprehensive carefully documented software package coined ShearLab 3D (www.ShearLab.org) and discuss its algorithmic details. This package provides MATLAB code for a novel faithful algorithmic realization of the 2D and 3D shearlet transform (and their inverses) associated with compactly supported universal shearlet systems incorporating the option of using CUDA. We will present extensive numerical experiments in 2D and 3D concerning denoising, inpainting, and feature extraction, comparing the performance of ShearLab 3D with similar transform-based algorithms such as curvelets, contourlets, or surfacelets. In the spirit of reproducible reseaerch, all scripts are accessible on www.ShearLab.org.

math.NA↗

arXiv2014

Scalable Frames and Convex Geometry

The recently introduced and characterized scalable frames can be considered as those frames which allow for perfect preconditioning in the sense that the frame vectors can be rescaled to yield a tight frame. In this paper we define $m$-scalability, a refinement of scalability based on the number of non-zero weights used in the rescaling process, and study the connection between this notion and elements from convex geometry. Finally, we provide results on the topology of scalable frames. In particular, we prove that the set of scalable frames with "small" redundancy is nowhere dense in the set of frames.

math.NA↗

arXiv2013

Gabor Shearlets

In this paper, we introduce Gabor shearlets, a variant of shearlet systems, which are based on a different group representation than previous shearlet constructions: they combine elements from Gabor and wavelet frames in their construction. As a consequence, they can be implemented with standard filters from wavelet theory in combination with standard Gabor windows. Unlike the usual shearlets, the new construction can achieve a redundancy as close to one as desired. Our construction follows the general strategy for shearlets. First we define group-based Gabor shearlets and then modify them to a cone-adapted version. In combination with Meyer filters, the cone-adapted Gabor shearlets constitute a tight frame and provide low-redundancy sparse approximations of the common model class of anisotropic features which are cartoon-like functions.

math.FA↗

arXiv2012

Analysis of Inpainting via Clustered Sparsity and Microlocal Analysis

Recently, compressed sensing techniques in combination with both wavelet and directional representation systems have been very effectively applied to the problem of image inpainting. However, a mathematical analysis of these techniques which reveals the underlying geometrical content is completely missing. In this paper, we provide the first comprehensive analysis in the continuum domain utilizing the novel concept of clustered sparsity, which besides leading to asymptotic error bounds also makes the superior behavior of directional representation systems over wavelets precise. First, we propose an abstract model for problems of data recovery and derive error bounds for two different recovery schemes, namely l_1 minimization and thresholding. Second, we set up a particular microlocal model for an image governed by edges inspired by seismic data as well as a particular mask to model the missing data, namely a linear singularity masked by a horizontal strip. Applying the abstract estimate in the case of wavelets and of shearlets we prove that -- provided the size of the missing part is asymptotically to the size of the analyzing functions -- asymptotically precise inpainting can be obtained for this model. Finally, we show that shearlets can fill strictly larger gaps than wavelets in this model.

math.FA↗