arXiv subjects

Pierre Weiss

Publications and source records attributed to Pierre Weiss.

At least 37 records · Page 2Linked to original sources

arXiv2018

On Representer Theorems and Convex Regularization

We establish a general principle which states that regularizing an inverse problem with a convex function yields solutions which are convex combinations of a small number of atoms. These atoms are identified with the extreme points and elements of the extreme rays of the regularizer level sets. An extension to a broader class of quasi-convex regularizers is also discussed. As a side result, we characterize the minimizers of the total gradient variation, which was still an unresolved problem.

math.OC↗

arXiv2017

Estimation of linear operators from scattered impulse responses

We provide a new estimator of integral operators with smooth kernels, obtained from a set of scattered and noisy impulse responses. The proposed approach relies on the formalism of smoothing in reproducing kernel Hilbert spaces and on the choice of an appropriate regularization term that takes the smoothness of the operator into account. It is numerically tractable in very large dimensions. We study the estimator's robustness to noise and analyze its approximation properties with respect to the size and the geometry of the dataset. In addition, we show minimax optimality of the proposed estimator.

cs.IT↗

arXiv2017

Exact solutions of infinite dimensional total-variation regularized problems

We study the solutions of infinite dimensional linear inverse problems over Banach spaces. The regularizer is defined as the total variation of a linear mapping of the function to recover, while the data fitting term is a near arbitrary convex function. The first contribution is about the solu-tion's structure: we show that under suitable assumptions, there always exist an m-sparse solution, where m is the number of linear measurements of the signal. Our second contribution is about the computation of the solution. While most existing works first discretize the problem, we show that exacts solutions of the infinite dimensional problem can be obtained by solving two consecutive finite dimensional convex programs. These results extend recent advances in the understanding of total-variation reg-ularized problems.

math.OC↗

arXiv2017

Multiview Attenuation Estimation and Correction

Measuring attenuation coefficients is a fundamental problem that can be solved with diverse techniques such as X-ray or optical tomography and lidar. We propose a novel approach based on the observation of a sample from a few different angles. This principle can be used in existing devices such as lidar or various types of fluorescence microscopes. It is based on the resolution of a nonlinear inverse problem. We propose a specific computational approach to solve it and show the well-foundedness of the approach on simulated data. Some of the tools developed are of independent interest. In particular we propose an efficient method to correct attenuation defects, new robust solvers for the lidar equation as well as new efficient algorithms to compute the Lambert W function and the proximal operator of the logsumexp function in dimension 2.

math.OC↗

arXiv2016

Compressed sensing with structured sparsity and structured acquisition

Compressed Sensing (CS) is an appealing framework for applications such as Magnetic Resonance Imaging (MRI). However, up-to-date, the sensing schemes suggested by CS theories are made of random isolated measurements, which are usually incompatible with the physics of acquisition. To reflect the physical constraints of the imaging device, we introduce the notion of blocks of measurements: the sensing scheme is not a set of isolated measurements anymore, but a set of groups of measurements which may represent any arbitrary shape (parallel or radial lines for instance). Structured acquisition with blocks of measurements are easy to implement, and provide good reconstruction results in practice. However, very few results exist on the theoretical guarantees of CS reconstructions in this setting. In this paper, we derive new CS results for structured acquisitions and signals satisfying a prior structured sparsity. The obtained results provide a recovery probability of sparse vectors that explicitly depends on their support. Our results are thus support-dependent and offer the possibility for flexible assumptions on the sparsity structure. Moreover, the results are drawing-dependent, since we highlight an explicit dependency between the probability of reconstructing a sparse vector and the way of choosing the blocks of measurements. Numerical simulations show that the proposed theory is faithful to experimental observations.

cs.IT↗

arXiv2016

Approximation of integral operators using convolution-product expansions

We consider a class of linear integral operators with impulse responses varying regularly in time or space. These operators appear in a large number of applications ranging from signal/image processing to biology. Evaluating their action on functions is a computation-ally intensive problem necessary for many practical problems. We analyze a technique called convolution-product expansion: the operator is locally approximated by a convolution, allowing to design fast numerical algorithms based on the fast Fourier transform. We design various types of expansions, provide their explicit rates of approximation and their complexity depending on the time varying impulse response smoothness. This analysis suggests novel wavelet based implementations of the method with numerous assets such as optimal approximation rates, low complexity and storage requirements as well as adaptivity to the kernels regularity. The proposed methods are an alternative to more standard procedures such as panel clustering, cross approximations, wavelet expansions or hierarchical matrices.

math.NA↗

arXiv2015

Real-time $\ell^1$ -- $\ell^2$ deblurring using wavelet expansions of operators

Image deblurring is a fundamental problem in imaging, usually solved with com-putationally intensive optimization procedures. We show that the minimization can be significantly accelerated by leveraging the fact that images and blur operators are compressible in the same orthogonal wavelet basis. The proposed methodology consists of three ingredients: i) a sparse approximation of the blur operator in wavelet bases, ii) a diagonal preconditioner and iii) an implementation on massively parallel architectures. Combing the three ingredients leads to acceleration factors ranging from 30 to 250 on a typical workstation. For instance, a 1024 x 1024 image can be deblurred in 0.15 seconds, which corresponds to real-time.

math.NA↗

arXiv2015

Sparse Wavelet Representations of Spatially Varying Blurring Operators

Restoring images degraded by spatially varying blur is a problem encountered in many disciplines such as astrophysics, computer vision or biomedical imaging. One of the main challenges to perform this task is to design efficient numerical algorithms to approximate integral operators.We introduce a new method based on a sparse approximation of the blurring operator in the wavelet domain. This method requires $\mathcal{O}\left(N ε^{-d/M}\right)$ operations to provide $ε$-approximations, where $N$ is the number of pixels of a $d$-dimensional image and $M\geq 1$ is a scalar describing the regularity of the blur kernel. In addition, we propose original methods to define sparsity patterns when only the operators regularity is known.Numerical experiments reveal that our algorithm provides a significant improvement compared to standard methods based on windowed convolutions.

math.OC↗

arXiv2015

A projection algorithm on measures sets

We consider the problem of projecting a probability measure $π$ on a set $\mathcal{M}\_N$ of Radon measures. The projection is defined as a solution of the following variational problem:\begin{equation*}\inf\_{μ\in \mathcal{M}\_N} \|h\star (μ- π)\|\_2^2,\end{equation*}where $h\in L^2(Ω)$ is a kernel, $Ω\subset \R^d$ and $\star$ denotes the convolution operator.To motivate and illustrate our study, we show that this problem arises naturally in various practical image rendering problems such as stippling (representing an image with $N$ dots) or continuous line drawing (representing an image with a continuous line).We provide a necessary and sufficient condition on the sequence $(\mathcal{M}\_N)\_{N\in \N}$ that ensures weak convergence of the projections $(μ^*\_N)\_{N\in \N}$ to $π$.We then provide a numerical algorithm to solve a discretized version of the problem and show several illustrations related to computer-assisted synthesis of artistic paintings/drawings.

math.NA↗

arXiv2015

Variable density sampling based on physically plausible gradient waveform. Application to 3D MRI angiography

Performing k-space variable density sampling is a popular way of reducing scanning time in Magnetic Resonance Imaging (MRI). Unfortunately, given a sampling trajectory, it is not clear how to traverse it using gradient waveforms. In this paper, we actually show that existing methods [1, 2] can yield large traversal time if the trajectory contains high curvature areas. Therefore, we consider here a new method for gradient waveform design which is based on the projection of unrealistic initial trajectory onto the set of hardware constraints. Next, we show on realistic simulations that this algorithm allows implementing variable density trajectories resulting from the piecewise linear solution of the Travelling Salesman Problem in a reasonable time. Finally, we demonstrate the application of this approach to 2D MRI reconstruction and 3D angiography in the mouse brain.

math.OC↗

arXiv2014

Gradient waveform design for variable density sampling in Magnetic Resonance Imaging

Fast coverage of k-space is a major concern to speed up data acquisition in Magnetic Resonance Imaging (MRI) and limit image distortions due to long echo train durations. The hardware gradient constraints (magnitude, slew rate) must be taken into account to collect a sufficient amount of samples in a minimal amount of time. However, sampling strategies (e.g., Compressed Sensing) and optimal gradient waveform design have been developed separately so far. The major flaw of existing methods is that they do not take the sampling density into account, the latter being central in sampling theory. In particular, methods using optimal control tend to agglutinate samples in high curvature areas. In this paper, we develop an iterative algorithm to project any parameterization of k-space trajectories onto the set of feasible curves that fulfills the gradient constraints. We show that our projection algorithm provides a more efficient alternative than existinf approaches and that it can be a way of reducing acquisition time while maintaining sampling density for piece-wise linear trajectories.

math.OC↗

arXiv2014

An analysis of block sampling strategies in compressed sensing

Compressed sensing is a theory which guarantees the exact recovery of sparse signals from a small number of linear projections. The sampling schemes suggested by current compressed sensing theories are often of little practical relevance since they cannot be implemented on real acquisition systems. In this paper, we study a new random sampling approach that consists in projecting the signal over blocks of sensing vectors. A typical example is the case of blocks made of horizontal lines in the 2D Fourier plane. We provide theoretical results on the number of blocks that are required for exact sparse signal reconstruction. This number depends on two properties named intra and inter-support block coherence. We then show through a series of examples including Gaussian measurements, isolated measurements or blocks in time-frequency bases, that the main result is sharp in the sense that the minimum amount of blocks necessary to reconstruct sparse signals cannot be improved up to a multiplicative logarithmic factor. The proposed results provide a good insight on the possibilities and limits of block compressed sensing in imaging devices such as magnetic resonance imaging, radio-interferometry or ultra-sound imaging.

cs.IT↗

arXiv2014

Variable density sampling with continuous trajectories. Application to MRI

Reducing acquisition time is a crucial challenge for many imaging techniques. Compressed Sensing (CS) theory offers an appealing framework to address this issue since it provides theoretical guarantees on the reconstruction of sparse signals by projection on a low dimensional linear subspace. In this paper, we focus on a setting where the imaging device allows to sense a fixed set of measurements. We first discuss the choice of an optimal sampling subspace (smallest subset) allowing perfect reconstruction of sparse signals. Its standard design relies on the random drawing of independent measurements. We discuss how to select the drawing distribution and show that a mixed strategy involving partial deterministic sampling and independent drawings can help breaking the so-called "coherence barrier". Unfortunately, independent random sampling is irrelevant for many acquisition devices owing to acquisition constraints. To overcome this limitation, the notion of Variable Density Samplers (VDS) is introduced and defined as a stochastic process with a prescribed limit empirical measure. It encompasses samplers based on independent measurements or continuous curves. The latter are crucial to extend CS results to actual applications. Our main contribution lies in two original continuous VDS. The first one relies on random walks over the acquisition space whereas the second one is heuristically driven and rests on the approximate solution of a Traveling Salesman Problem. Theoretical analysis and retrospective CS simulations in magnetic resonance imaging highlight that the TSP-based solution provides improved reconstructed images in terms of signal-to-noise ratio compared to standard sampling schemes (spiral, radial, 3D iid...).

stat.AP↗

arXiv2014

Hyperspectral pan-sharpening: a variational convex constrained formulation to impose parallel level lines, solved with ADMM

In this paper, we address the issue of hyperspectral pan-sharpening, which consists in fusing a (low spatial resolution) hyperspectral image HX and a (high spatial resolution) panchromatic image P to obtain a high spatial resolution hyperspectral image. The problem is addressed under a variational convex constrained formulation. The objective favors high resolution spectral bands with level lines parallel to those of the panchromatic image. This term is balanced with a total variation term as regularizer. Fit-to-P data and fit-to-HX data constraints are effectively considered as mathematical constraints, which depend on the statistics of the data noise measurements. The developed Alternating Direction Method of Multipliers (ADMM) optimization scheme enables us to solve this problem efficiently despite the non differentiabilities and the huge number of unknowns.

cs.CV↗

arXiv2014

An algorithm for variable density sampling with block-constrained acquisition

Reducing acquisition time is of fundamental importance in various imaging modalities. The concept of variable density sampling provides a nice framework to achieve this. It was justified recently from a theoretical point of view in the compressed sensing (CS) literature. Unfortunately, the sampling schemes suggested by current CS theories may not be relevant since they do not take the acquisition constraints into account (for example, continuity of the acquisition trajectory in Magnetic Resonance Imaging - MRI). In this paper, we propose a numerical method to perform variable density sampling with block constraints. Our main contribution is to propose a new way to draw the blocks in order to mimic CS strategies based on isolated measurements. The basic idea is to minimize a tailored dissimilarity measure between a probability distribution defined on the set of isolated measurements and a probability distribution defined on a set of blocks of measurements. This problem turns out to be convex and solvable in high dimension. Our second contribution is to define an efficient minimization algorithm based on Nesterov's accelerated gradient descent in metric spaces. We study carefully the choice of the metrics and of the prox function. We show that the optimal choice may depend on the type of blocks under consideration. Finally, we show that we can obtain better MRI reconstruction results using our sampling schemes than standard strategies such as equiangularly distributed radial lines.

cs.IT↗

arXiv2013

On Variant Strategies To Solve The Magnitude Least Squares Optimization Problem In Parallel Transmission Pulse Design And Under Strict SAR And Power Constraints

Parallel transmission has been a very promising candidate technology to mitigate the inevitable radio-frequency field inhomogeneity in magnetic resonance imaging (MRI) at ultra-high field (UHF). For the first few years, pulse design utilizing this technique was expressed as a least squares problem with crude power regularizations aimed at controlling the specific absorption rate (SAR), hence the patient safety. This approach being suboptimal for many applications sensitive mostly to the magnitude of the spin excitation, and not its phase, the magnitude least squares (MLS) problem then was first formulated in 2007. Despite its importance and the availability of other powerful numerical optimization methods, this problem yet has been faced exclusively by the pulse designer with the so-called variable exchange method. In this paper, we investigate other strategies and incorporate directly the strict SAR and hardware constraints. Different schemes such as sequential quadratic programming (SQP), interior point (I-P) methods, semi-definite programming (SDP) and magnitude squared least squares (MSLS) relaxations are studied both in the small and large tip angle regimes with real data sets obtained in-vivo on a human brain at 7 Tesla. Convergence and robustness of the different approaches are analyzed, and recommendations to tackle this specific problem are finally given. Small tip angle and inversion pulses are returned in a few seconds and in under a minute respectively while respecting the constraints, allowing the use of the proposed approach in routine.

physics.ins-det↗

arXiv2013

From variable density sampling to continuous sampling using Markov chains

Since its discovery over the last decade, Compressed Sensing (CS) has been successfully applied to Magnetic Reso- nance Imaging (MRI). It has been shown to be a powerful way to reduce scanning time without sacrificing image quality. MR images are actually strongly compressible in a wavelet basis, the latter being largely incoherent with the k-space or spatial Fourier domain where acquisition is performed. Nevertheless, since its first application to MRI [1], the theoretical justification of actual k-space sampling strategies is questionable. Indeed, the vast majority of k-space sampling distributions have been heuris- tically designed (e.g., variable density) or driven by experimental feasibility considerations (e.g., random radial or spiral sampling to achieve smoothness k-space trajectory). In this paper, we try to reconcile very recent CS results with the MRI specificities (mag- netic field gradients) by enforcing the measurements, i.e. samples of k-space, to fit continuous trajectories. To this end, we propose random walk continuous sampling based on Markov chains and we compare the reconstruction quality of this scheme to the state- of-the art.

stat.AP↗

arXiv2013

Variable Density Compressed Sensing In MRI. Theoretical vs Heuristic Sampling Strategies

The structure of Magnetic Resonance Images (MRI) and especially their compressibility in an appropriate representation basis enables the application of the compressive sensing theory, which guarantees exact image recovery from incomplete measurements. According to recent theoretical conditions on the reconstruction guarantees, the optimal strategy is to downsample the k-space using an independent drawing of the acquisition basis entries. Here, we first bring a novel answer to the synthesis problem, which amounts to deriving the op- timal distribution (according to a given criterion) from which the data should be sampled. Then, given that the sparsity hypothesis is not fulfilled in the k-space center in MRI, we extend this approach by densely sampling this center and drawing the remaining samples from the optimal distribution. We compare this theoretical approach to heuristic strategies, and show that the proposed two-stage process drastically improves reconstruction results on anatomical MRI.

math.ST↗