Searcharxiv⌕ Search

arXiv subjects

Tatiana A. Bubba

Publications and source records attributed to Tatiana A. Bubba.

At least 19 recordsLinked to original sources

Statistical inverse learning and $\ell^1$-regularization

We study the recovery of sparse functions from finite, noisy, and indirect observations in the framework of statistical inverse learning. The unknown is modeled as an element of $\ell^1$, and observations are generated through a possibly nonlinear forward operator $A:\ell^1\to H$, where $H$ is a vector-valued reproducing kernel Hilbert space. We propose an $\ell^1$-regularized empirical risk minimizer and develop a theoretical analysis of its statistical properties. Under mild assumptions, we establish almost-sure consistency and derive non-asymptotic high-probability convergence rates in both the prediction and $\ell^1$ reconstruction norms. The rates depend on the source smoothness parameter $r$, characterized by a variational source condition, and the effective dimension exponent $b$, describing the polynomial spectral decay of the covariance operator. We further prove matching minimax lower bounds, showing that the obtained convergence rates are optimal. To relate the theory to practical sparsity models, we consider finitely smoothing operators of the form $A=G\circ S$, where $S$ is a synthesis operator, and show that approximation-space assumptions imply the required variational source conditions. In particular, we prove that membership in the approximation space $k_t$ is equivalent to polynomial decay of the best $n$-term approximation error. Finally, we verify the assumptions for two representative inverse problems: reaction coefficient identification in elliptic PDEs and sparse computed tomography. For filtered Radon transforms, we derive explicit effective-dimension asymptotics, yielding concrete convergence rates for standard image models and sparsifying systems.

stat.ML↗

A Line--Search--Based Stochastic Gradient Method for 3D Computed Tomography

We introduce FB-LISA, a forward-backward (FB) generalization of a recently proposed line-search-based stochastic gradient algorithm to address the imaging problem of volumetric reconstruction in Computed Tomography, a substantially high demanding problem, which involves orders of magnitude of data, a high computational burden for forward and backprojection, and memory requirements that push current GPU architectures to their limits. Our formulation employs stochastic mini-batches composed of full 2D projections, preserving the physical structure of the acquisition process while enabling significant speed-ups during early iterations. The resulting method demonstrates how concepts traditionally associated with deep learning can be repurposed to accelerate large-scale inverse problems, without relying on training data or learned priors.

math.NA↗

Regularization with optimal space-time priors

We propose a variational regularization approach based on a multiscale representation called cylindrical shearlets aimed at dynamic imaging problems, especially dynamic tomography. The intuitive idea of our approach is to integrate a sequence of separable static problems in the mismatch term of the cost function, while the regularization term handles the nonstationary target as a spatio-temporal object. This approach is motivated by the fact that cylindrical shearlets provide (nearly) optimally sparse approximations on an idealized class of functions modeling spatio-temportal data and the numerical observation that they provide highly sparse approximations even for more general spatio-temporal image sequences found in dynamic tomography applications. To formulate our regularization model, we introduce cylindrical shearlet smoothness spaces, which are instrumental for defining suitable embeddings in functional spaces. We prove that the proposed regularization strategy is well-defined, and the minimization problem has a unique solution (for $ p > 1$). Furthermore, we provide convergence rates (in terms of the symmetric Bregman distance) under deterministic and random noise conditions, within the context of statistical inverse learning. We numerically validate our theoretical results using both simulated and measured dynamic tomography data, showing that our approach leads to an efficient and robust reconstruction strategy.

math.NA↗

Fast Inexact Bilevel Optimization for Analytical Deep Image Priors

The analytical deep image prior (ADP) introduced by Dittmer et al. (2020) establishes a link between deep image priors and classical regularization theory via bilevel optimization. While this is an elegant construction, it involves expensive computations if the lower-level problem is to be solved accurately. To overcome this issue, we propose to use adaptive inexact bilevel optimization to solve ADP problems. We discuss an extension of a recent inexact bilevel method called the method of adaptive inexact descent of Salehi et al.(2024) to an infinite-dimensional setting required by the ADP framework. In our numerical experiments we demonstrate that the computational speed-up achieved by adaptive inexact bilevel optimization allows one to use ADP on larger-scale problems than in the previous literature, e.g. in deblurring of 2D color images.

math.OC↗

TomoSelfDEQ: Self-Supervised Deep Equilibrium Learning for Sparse-Angle CT Reconstruction

Deep learning has emerged as a powerful tool for solving inverse problems in imaging, including computed tomography (CT). However, most approaches require paired training data with ground truth images, which can be difficult to obtain, e.g., in medical applications. We present TomoSelfDEQ, a self-supervised Deep Equilibrium (DEQ) framework for sparse-angle CT reconstruction that trains directly on undersampled measurements. We establish theoretical guarantees showing that, under suitable assumptions, our self-supervised updates match those of fully-supervised training with a loss including the (possibly non-unitary) forward operator like the CT forward map. Numerical experiments on sparse-angle CT data confirm this finding, also demonstrating that TomoSelfDEQ outperforms existing self-supervised methods, achieving state-of-the-art results with as few as 16 projection angles.

eess.IV↗

Revisiting $Ψ$DONet: microlocally inspired filters for incomplete-data tomographic reconstructions

In this paper, we revisit a supervised learning approach based on unrolling, known as $Ψ$DONet, by providing a deeper microlocal interpretation for its theoretical analysis, and extending its study to the case of sparse-angle tomography. Furthermore, we refine the implementation of the original $Ψ$DONet considering special filters whose structure is specifically inspired by the streak artifact singularities characterizing tomographic reconstructions from incomplete data. This allows to considerably lower the number of (learnable) parameters while preserving (or even slightly improving) the same quality for the reconstructions from limited-angle data and providing a proof-of-concept for the case of sparse-angle tomographic data.

math.OC↗

Trust your source: quantifying source condition elements for variational regularisation methods

Source conditions are a key tool in regularisation theory that are needed to derive error estimates and convergence rates for ill-posed inverse problems. In this paper, we provide a recipe to practically compute source condition elements as the solution of convex minimisation problems that can be solved with first-order algorithms. We demonstrate the validity of our approach by testing it on two inverse problem case studies in machine learning and image processing: sparse coefficient estimation of a polynomial via LASSO regression and recovering an image from a subset of the coefficients of its discrete Fourier transform. We further demonstrate that the proposed approach can easily be modified to solve the machine learning task of identifying the optimal sampling pattern in the Fourier domain for a given image and variational regularisation method, which has applications in the context of sparsity promoting reconstruction from magnetic resonance imaging data.

math.NA↗

Bilevel learning of regularization models and their discretization for image deblurring and super-resolution

Bilevel learning is a powerful optimization technique that has extensively been employed in recent years to bridge the world of model-driven variational approaches with data-driven methods. Upon suitable parametrization of the desired quantities of interest (e.g., regularization terms or discretization filters), such approach computes optimal parameter values by solving a nested optimization problem where the variational model acts as a constraint. In this work, we consider two different use cases of bilevel learning for the problem of image restoration. First, we focus on learning scalar weights and convolutional filters defining a Field of Experts regularizer to restore natural images degraded by blur and noise. For improving the practical performance, the lower-level problem is solved by means of a gradient descent scheme combined with a line-search strategy based on the Barzilai-Borwein rule. As a second application, the bilevel setup is employed for learning a discretization of the popular total variation regularizer for solving image restoration problems (in particular, deblurring and super-resolution). Numerical results show the effectiveness of the approach and their generalization to multiple tasks.

math.NA↗

Efficient representation of spatio-temporal data using cylindrical shearlets

Efficient representations of multivariate functions are critical for the design of state-of-the-art methods of data restoration and image reconstruction. In this work, we consider the representation of spatio-temporal data such as temporal sequences (videos) of 2- and 3-dimensional images, where conventional separable representations are usually very inefficient, due to their limitations in handling the geometry of the data. To address this challenge, we define a class $\mathcal{E}(A) \subset L^2(\mathbb{R}^4)$ of functions of 4 variables dominated by hypersurface singularities in the first three coordinates that we apply to model 4-dimensional data corresponding to temporal sequences (videos) of 3-dimensional objects. To provide an efficient representation for this type of data, we introduce a new multiscale directional system of functions based on cylindrical shearlets and prove that this new approach achieves superior approximation properties with respect to conventional multiscale representations. We illustrate the advantages of our approach by applying a discrete implementation of the new representation to a challenging problem from dynamic tomography. Numerical results confirm the potential of our novel approach with respect to conventional multiscale methods.

math.FA↗

Learning a microlocal prior for limited-angle tomography

Limited-angle tomography is a highly ill-posed linear inverse problem. It arises in many applications, such as digital breast tomosynthesis. Reconstructions from limited-angle data typically suffer from severe stretching of features along the central direction of projections, leading to poor separation between slices perpendicular to the central direction. A new method is introduced, based on machine learning and geometry, producing an estimate for interfaces between regions of different X-ray attenuation. The estimate can be presented on top of the reconstruction, indicating more reliably the true form and extent of features. The method uses directional edge detection, implemented using complex wavelets and enhanced with morphological operations. By using machine learning, the visible part of the wavefront set is first extracted and then extended to the full domain, filling in the parts of the wavefront set that would otherwise be hidden due to the lack of measurement directions.

eess.IV↗

Shearlet-based regularization in statistical inverse learning with an application to X-ray tomography

Statistical inverse learning theory, a field that lies at the intersection of inverse problems and statistical learning, has lately gained more and more attention. In an effort to steer this interplay more towards the variational regularization framework, convergence rates have recently been proved for a class of convex, $p$-homogeneous regularizers with $p \in (1,2]$, in the symmetric Bregman distance. Following this path, we take a further step towards the study of sparsity-promoting regularization and extend the aforementioned convergence rates to work with $\ell^p$-norm regularization, with $p \in (1,2)$, for a special class of non-tight Banach frames, called shearlets, and possibly constrained to some convex set. The $p = 1$ case is approached as the limit case $(1,2) \ni p \rightarrow 1$, by complementing numerical evidence with a (partial) theoretical analysis, based on arguments from $Γ$-convergence theory. We numerically demonstrate our theoretical results in the context of X-ray tomography, under random sampling of the imaging angles, using both simulated and measured data.

math.ST↗

Convex regularization in statistical inverse learning problems

We consider a statistical inverse learning problem, where the task is to estimate a function $f$ based on noisy point evaluations of $Af$, where $A$ is a linear operator. The function $Af$ is evaluated at i.i.d. random design points $u_n$, $n=1,...,N$ generated by an unknown general probability distribution. We consider Tikhonov regularization with general convex and $p$-homogeneous penalty functionals and derive concentration rates of the regularized solution to the ground truth measured in the symmetric Bregman distance induced by the penalty functional. We derive concrete rates for Besov norm penalties and numerically demonstrate the correspondence with the observed rates in the context of X-ray tomography.

stat.ML↗

4D Dual-Tree Complex Wavelets for Time-Dependent Data

The dual-tree complex wavelet transform (DT-$\mathbb{C}$WT) is extended to the 4D setting. Key properties of 4D DT-$\mathbb{C}$WT, such as directional sensitivity and shift-invariance, are discussed and illustrated in a tomographic application. The inverse problem of reconstructing a dynamic three-dimensional target from X-ray projection measurements can be formulated as 4D space-time tomography. The results suggest that 4D DT-$\mathbb{C}$WT offers simple implementations combined with useful theoretical properties for tomographic reconstruction.

math.NA↗

Fuel rod classification from Passive Gamma Emission Tomography (PGET) of spent nuclear fuel assemblies

Safeguarding the disposal of spent nuclear fuel in a geological repository needs an effective, efficient, reliable and robust non-destructive assay (NDA) system to ensure the integrity of the fuel prior to disposal. In the context of the Finnish geological repository, Passive Gamma Emission Tomography (PGET) will be a part of such an NDA system. We report here on the results of PGET measurements at the Finnish nuclear power plants during the years 2017-2020. Gamma activity profiles are recorded from all angles by rotating the detector arrays around the fuel assembly that has been inserted into the center of the torus. Image reconstruction from the resulting tomographic data is defined as a constrained minimization problem with a data fidelity term and regularization terms. The activity and attenuation maps, as well as detector sensitivity corrections, are the variables in the minimization process. The regularization terms ensure that prior information on the (possible) locations of fuel rods and their diameter are taken into account. Fuel rod classification, the main purpose of the PGET method, is based on the difference of the activity of a fuel rod from its immediate neighbors, taking into account its distance from the assembly center. The classification is carried out by a support vector machine. We report on the results for ten different fuel types with burnups between 5.72 and 55.0 GWd/tU, cooling times between 1.87 and 34.6 years and initial enrichments between 1.9 and 4.4%. For all fuel assemblies measured, missing fuel rods, partial fuel rods and water channels were correctly classified. Burnable absorber fuel rods were classified as fuel rods. On rare occasions, a fuel rod that is present was falsely classified as missing. We conclude that the combination of the PGET device and our image reconstruction method provides a reliable base for fuel rod classification.

physics.ins-det↗

Deep neural networks for inverse problems with pseudodifferential operators: an application to limited-angle tomography

We propose a novel convolutional neural network (CNN), called $Ψ$DONet, designed for learning pseudodifferential operators ($Ψ$DOs) in the context of linear inverse problems. Our starting point is the Iterative Soft Thresholding Algorithm (ISTA), a well-known algorithm to solve sparsity-promoting minimization problems. We show that, under rather general assumptions on the forward operator, the unfolded iterations of ISTA can be interpreted as the successive layers of a CNN, which in turn provides fairly general network architectures that, for a specific choice of the parameters involved, allow to reproduce ISTA, or a perturbation of ISTA for which we can bound the coefficients of the filters. Our case study is the limited-angle X-ray transform and its application to limited-angle computed tomography (LA-CT). In particular, we prove that, in the case of LA-CT, the operations of upscaling, downscaling and convolution, which characterize our $Ψ$DONet and most deep learning schemes, can be exactly determined by combining the convolutional nature of the limited angle X-ray transform and basic properties defining an orthogonal wavelet system. We test two different implementations of $Ψ$DONet on simulated data from limited-angle geometry, generated from the ellipse data set. Both implementations provide equally good and noteworthy preliminary results, showing the potential of the approach we propose and paving the way to applying the same idea to other convolutional operators which are $Ψ$DOs or Fourier integral operators.

math.OC↗

Sparse dynamic tomography. A shearlet-based approach for iodine perfusion in plant stems

In this paper we propose a motion-aware variational approach to reconstruct moving objects from sparse dynamic data. The motivation of this work stems from X-ray imaging of plants perfused with a liquid contrast agent, aimed at increasing the contrast of the images and studying the phloem transport in plants over time. The key idea of our approach is to deploy 3D shearlets as a space-temporal prior, treating time as the third dimension. The rationale behind this model is that a continuous evolution of a cartoon-like object is well suited for the use of 3D shearlets. We provide a basic mathematical analysis of the variational model for the image reconstruction. The numerical minimization is carried out with primal-dual scheme coupled with an automated choice of regularization parameter. We test our model on different measurement setups: a simulated phantom especially designed to resemble a plant stem, with spreading points to simulate a spreading contrast agent; a measured agarose gel phantom to demonstrate iodide diffusion and geometry prior to imaging living sample; a measured living tree grown \textit{in vitro} and perfused with a liquid sugar-iodine-mix. The results, compared against a 2D static model, show that our approach provides reconstructions that capture well the time dynamic of the contrast agent onset and are encouraging to develop microCT as a tool to study phloem transport using iodine tracer.

eess.IV↗

Simultaneous Reconstruction of Emission and Attenuation in Passive Gamma Emission Tomography of Spent Nuclear Fuel

The International Atomic Energy Agency (IAEA) has recently approved passive gamma emission tomography (PGET) as a method for inspecting spent nuclear fuel assemblies (SFAs), an important aspect of international nuclear safeguards which aim at preventing the proliferation of nuclear weapons. The PGET instrument is essentially a single photon emission computed tomography (SPECT) system that allows the reconstruction of axial cross-sections of the emission map of the SFA. The fuel material heavily self-attenuates its gamma-ray emissions, so that correctly accounting for the attenuation is a critical factor in producing accurate images. Due to the nature of the inspections, it is desirable to use as little a priori information as possible about the fuel, including the attenuation map, in the reconstruction process. Current reconstruction methods either do not correct for attenuation, assume a uniform attenuation throughout the fuel assembly, or assume an attenuation map based on an initial filtered back projection (FBP) reconstruction. Here, we propose a method to simultaneously reconstruct the emission and attenuation maps by formulating the reconstruction as a constrained minimization problem with a least squares data fidelity term and regularization terms. Using simulated data, we compare the proposed method to FBP, showing that our approach produces significantly better reconstructions by various numerical metrics and a much better classification of spent, missing, and fresh fuel rods.

physics.ins-det↗

Tomographic X-ray data of carved cheese

This is the documentation of the tomographic X-ray data of a carved cheese slice. Data are available at www.fips.fi/dataset.php, and can be freely used for scientific purposes with appropriate references to them, and to this document in http://arxiv.org/. The data set consists of (1) the X-ray sinogram of a single 2D slice of the cheese slice with three different resolutions and (2) the corresponding measurement matrices modeling the linear operation of the X-ray transform. Each of these sinograms was obtained from a measured 360-projection fan-beam sinogram by down-sampling and taking logarithms. The original (measured) sinogram is also provided in its original form and resolution.

physics.med-ph↗