Searcharxiv⌕ Search

arXiv subjects

Sjoerd Dirksen

Publications and source records attributed to Sjoerd Dirksen.

35 records · Page 2Linked to original sources

Robust one-bit compressed sensing with partial circulant matrices

We present optimal sample complexity estimates for one-bit compressed sensing problems in a realistic scenario: the procedure uses a structured matrix (a randomly sub-sampled circulant matrix) and is robust to analog pre-quantization noise as well as to adversarial bit corruptions in the quantization process. Our results imply that quantization is not a statistically expensive procedure in the presence of nontrivial analog noise: recovery requires the same sample size one would have needed had the measurement matrix been Gaussian and the noisy analog measurements been given as data.

cs.IT↗

Non-Gaussian Hyperplane Tessellations and Robust One-Bit Compressed Sensing

We show that a tessellation generated by a small number of random affine hyperplanes can be used to approximate Euclidean distances between any two points in an arbitrary bounded set $T$, where the random hyperplanes are generated by subgaussian or heavy-tailed normal vectors and uniformly distributed shifts. We derive quantitative bounds on the number of hyperplanes needed for constructing such tessellations in terms of natural metric complexity measures of $T$ and the desired approximation error. Our work extends significantly prior results in this direction, which were restricted to Gaussian hyperplane tessellations of subsets of the Euclidean unit sphere. As an application, we obtain new reconstruction results in memoryless one-bit compressed sensing with non-Gaussian measurement matrices. We show that by quantizing at uniformly distributed thresholds, it is possible to accurately reconstruct low-complexity signals from a small number of one-bit quantized measurements, even if the measurement vectors are drawn from a heavy-tailed distribution. Our reconstruction results are uniform in nature and robust in the presence of pre-quantization noise on the analog measurements as well as adversarial bit corruptions in the quantization process. Moreover we show that if the measurement matrix is subgaussian then accurate recovery can be achieved via a convex program.

cs.IT↗

Fast binary embeddings with Gaussian circulant matrices: improved bounds

We consider the problem of encoding a finite set of vectors into a small number of bits while approximately retaining information on the angular distances between the vectors. By deriving improved variance bounds related to binary Gaussian circulant embeddings, we largely fix a gap in the proof of the best known fast binary embedding method. Our bounds also show that well-spreadness assumptions on the data vectors, which were needed in earlier work on variance bounds, are unnecessary. In addition, we propose a new binary embedding with a faster running time on sparse data.

cs.IT↗

One-bit compressed sensing with partial Gaussian circulant matrices

In this paper we consider memoryless one-bit compressed sensing with randomly subsampled Gaussian circulant matrices. We show that in a small sparsity regime and for small enough accuracy $δ$, $m\sim δ^{-4} s\log(N/sδ)$ measurements suffice to reconstruct the direction of any $s$-sparse vector up to accuracy $δ$ via an efficient program. We derive this result by proving that partial Gaussian circulant matrices satisfy an $\ell_1/\ell_2$ RIP-property. Under a slightly worse dependence on $δ$, we establish stability with respect to approximate sparsity, as well as full vector recovery results.

cs.IT↗

Toward a unified theory of sparse dimensionality reduction in Euclidean space

Let $Φ\in\mathbb{R}^{m\times n}$ be a sparse Johnson-Lindenstrauss transform [KN14] with $s$ non-zeroes per column. For a subset $T$ of the unit sphere, $\varepsilon\in(0,1/2)$ given, we study settings for $m,s$ required to ensure $$ \mathop{\mathbb{E}}_Φ\sup_{x\in T} \left|\|Φx\|_2^2 - 1 \right| < \varepsilon , $$ i.e. so that $Φ$ preserves the norm of every $x\in T$ simultaneously and multiplicatively up to $1+\varepsilon$. We introduce a new complexity parameter, which depends on the geometry of $T$, and show that it suffices to choose $s$ and $m$ such that this parameter is small. Our result is a sparse analog of Gordon's theorem, which was concerned with a dense $Φ$ having i.i.d. Gaussian entries. We qualitatively unify several results related to the Johnson-Lindenstrauss lemma, subspace embeddings, and Fourier-based restricted isometries. Our work also implies new results in using the sparse Johnson-Lindenstrauss transform in numerical linear algebra, classical and model-based compressed sensing, manifold learning, and constrained least squares problems such as the Lasso.

cs.DS↗

On the gap between RIP-properties and sparse recovery conditions

We consider the problem of recovering sparse vectors from underdetermined linear measurements via $\ell_p$-constrained basis pursuit. Previous analyses of this problem based on generalized restricted isometry properties have suggested that two phenomena occur if $p\neq 2$. First, one may need substantially more than $s \log(en/s)$ measurements (optimal for $p=2$) for uniform recovery of all $s$-sparse vectors. Second, the matrix that achieves recovery with the optimal number of measurements may not be Gaussian (as for $p=2$). We present a new, direct analysis which shows that in fact neither of these phenomena occur. Via a suitable version of the null space property we show that a standard Gaussian matrix provides $\ell_q/\ell_1$-recovery guarantees for $\ell_p$-constrained basis pursuit in the optimal measurement regime. Our result extends to several heavier-tailed measurement matrices. As an application, we show that one can obtain a consistent reconstruction from uniform scalar quantized measurements in the optimal measurement regime.

cs.IT↗

Itô isomorphisms for $L^{p}$-valued Poisson stochastic integrals

Motivated by the study of existence, uniqueness and regularity of solutions to stochastic partial differential equations driven by jump noise, we prove Itô isomorphisms for $L^p$-valued stochastic integrals with respect to a compensated Poisson random measure. The principal ingredients for the proof are novel Rosenthal type inequalities for independent random variables taking values in a (noncommutative) $L^p$-space, which may be of independent interest. As a by-product of our proof, we observe some moment estimates for the operator norm of a sum of independent random matrices.

math.FA↗

Uniform recovery of fusion frame structured sparse signals

We consider the problem of recovering fusion frame sparse signals from incomplete measurements. These signals are composed of a small number of nonzero blocks taken from a family of subspaces. First, we show that, by using a-priori knowledge of a coherence parameter associated with the angles between the subspaces, one can uniformly recover fusion frame sparse signals with a significantly reduced number of vector-valued (sub-)Gaussian measurements via mixed l^1/l^2-minimization. We prove this by establishing an appropriate version of the restricted isometry property. Our result complements previous nonuniform recovery results in this context, and provides stronger stability guarantees for noisy measurements and approximately sparse signals. Second, we determine the minimal number of scalar-valued measurements needed to uniformly recover all fusion frame sparse signals via mixed l^1/l^2-minimization. This bound is achieved by scalar-valued subgaussian measurements. In particular, our result shows that the number of scalar-valued subgaussian measurements cannot be further reduced using knowledge of the coherence parameter. As a special case it implies that the best known uniform recovery result for block sparse signals using subgaussian measurements is optimal.

cs.IT↗

Tail bounds via generic chaining

We modify Talagrand's generic chaining method to obtain upper bounds for all p-th moments of the supremum of a stochastic process. These bounds lead to an estimate for the upper tail of the supremum with optimal deviation parameters. We apply our procedure to improve and extend some known deviation inequalities for suprema of unbounded empirical processes and chaos processes. As an application we give a significantly simplified proof of the restricted isometry property of the subsampled discrete Fourier transform.

math.PR↗

Dimensionality reduction with subgaussian matrices: a unified theory

We present a theory for Euclidean dimensionality reduction with subgaussian matrices which unifies several restricted isometry property and Johnson-Lindenstrauss type results obtained earlier for specific data sets. In particular, we recover and, in several cases, improve results for sets of sparse and structured sparse vectors, low-rank matrices and tensors, and smooth manifolds. In addition, we establish a new Johnson-Lindenstrauss embedding for data sets taking the form of an infinite union of subspaces of a Hilbert space.

cs.IT↗

Weak-type interpolation for noncommutative maximal operators

We prove a Boyd-type interpolation result for noncommutative maximal operators of restricted weak type. Our result positively answers an open question posed recently by Bekjan, Chen and Osekowski. As a special case, we find a restricted weak type version of the noncommutative Marcinkiewicz interpolation theorem, due to Junge and Xu, with interpolation constant of optimal order.

math.OA↗

Poisson stochastic integration in Banach spaces

We prove new upper and lower bounds for Banach space-valued stochastic integrals with respect to a compensated Poisson random measure. Our estimates apply to Banach spaces with non-trivial martingale (co)type and extend various results in the literature. We also develop a Malliavin framework to interpret Poisson stochastic integrals as vector-valued Skorohod integrals, and prove a Clark-Ocone representation formula.

math.PR↗

Noncommutative Boyd interpolation theorems

We present a new, elementary proof of Boyd's interpolation theorem. Our approach naturally yields a noncommutative version of this result and even allows for the interpolation of certain operators on l^1-valued noncommutative symmetric spaces. By duality we may interpolate several well-known noncommutative maximal inequalities. In particular we obtain a version of Doob's maximal inequality and the dual Doob inequality for noncommutative symmetric spaces. We apply our results to prove the Burkholder-Davis-Gundy and Burkholder-Rosenthal inequalities for noncommutative martingales in these spaces.

math.FA↗

Some remarks on noncommutative Khintchine inequalities

Normalized free semi-circular random variables satisfy an upper Khintchine inequality in $L_\infty$. We show that this implies the corresponding upper Khintchine inequality in any noncommutative Banach function space. As applications, we obtain a very simple proof of a well-known interpolation result for row and column operator spaces and, moreover, answer an open question on noncommutative moment inequalities concerning a paper by Bekjan and Chen.

math.OA↗

Crossed products of Banach algebras. I

We construct a crossed product Banach algebra from a Banach algebra dynamical system $(A,G,α)$ and a given uniformly bounded class $R$ of continuous covariant Banach space representations of that system. If $A$ has a bounded left approximate identity, and $R$ consists of non-degenerate continuous covariant representations only, then the non-degenerate bounded representations of the crossed product are in bijection with the non-degenerate $R$-continuous covariant representations of the system. This bijection, which is the main result of the paper, is also established for involutive Banach algebra dynamical systems and then yields the well-known representation theoretical correspondence for the crossed product $C^*$-algebra as commonly associated with a $C^*$-algebra dynamical system as a special case. Taking the algebra $A$ to be the base field, the crossed product construction provides, for a given non-empty class of Banach spaces, a Banach algebra with a relatively simple structure and with the property that its non-degenerate contractive representations in the spaces from that class are in bijection with the isometric strongly continuous representations of $G$ in those spaces. This generalizes the notion of a group $C^*$-algebra, and may likewise be used to translate issues concerning group representations in a class of Banach spaces to the context of a Banach algebra, simpler than $L^1(G)$, where more functional analytic structure is present.

math.FA↗

Extending representations of normed algebras in Banach spaces

Let X be a non-degenerate left Banach module over a normed algebra A having a bounded approximate left identity. We show that, if A is a left ideal of a larger algebra, then this representation can be extended to a representation of the larger algebra. Based on this result, we study in detail the existence and properties of representations of the various centralizer algebras of A which are compatible with the original representation of A. As a special case we obtain that, if A embeds as a topological algebra into the bounded operators on X, then the left centralizer algebra of $A$ embeds as a topological algebra as the left normalizer of the image, and the double centralizer algebra of A embeds as a topological algebra as the normalizer of the image. We also consider ordered and involutive contexts, and cover the right-sided cases, which are not always the obvious analogues of the left-sided cases, in detail as well.

math.FA↗