arXiv subjects

Marco Donatelli

Publications and source records attributed to Marco Donatelli.

At least 19 recordsLinked to original sources

arXiv2026

Iterated graph Laplacian for image restoration problems

We study the graph Laplacian operator as a regularizer in a generalized Tikhonov framework for linear ill-posed problems. The Laplacian is updated iteratively from the current reconstruction, so that progressively sharper structural information about the solution is fed into the regularization term. We introduce three schemes: a standard one that rebuilds the Laplacian from each new iterate; an error-equation scheme that, following the error-based formulation of iterated Tikhonov regularization, builds the Laplacian from an estimate of the reconstruction error rather than of the image itself; and a mixed scheme combining the two. We establish convergence of all three schemes for noisy data under a priori parameter and stopping rules as the noise level tends to zero. Numerical experiments in two-dimensional computed tomography and image deblurring show consistent gains in reconstruction quality and sharper recovery of fine details.

math.NA↗

arXiv2026

Multilevel Preconditioning Strategies for Convex Optimization Methods in Image Deblurring

Proximal gradient methods are widely used in imaging, and their speed of convergence can be accelerated by incorporating variable metrics and/or extrapolation steps. Recent works have shown that preconditioning strategies can significantly enhance this acceleration, in particular, for image deblurring problems. In parallel, a multilevel framework has been introduced to speed up inertial and inexact forward-backward schemes for image restoration problems. In this paper, we combine preconditioning and multilevel strategies to design a robust and consistent acceleration framework for both standard and inexact forward-backward schemes applied to regularized convex optimization problems. Numerical experiments in image deblurring confirm that our approach yields a substantial improvement in convergence speed compared to standard methods.

math.NA↗

arXiv2026

Graph Iterative Filtering methods for the analysis of nonstationary signals on graphs

In the analysis of real-world data, extracting meaningful features from signals is a crucial task. This is particularly challenging when signals contain non-stationary frequency components. The Iterative Filtering (IF) method has proven to be an effective tool for decomposing such signals. However, such a technique cannot handle directly data that have been sampled non-uniformly. On the other hand, graph signal processing has gained increasing attention due to its versatility and wide range of applications, and it can handle data sampled both uniformly and non-uniformly. In this work, we propose two algorithms that extend the IF method to signals defined on graphs. In addition, we provide a unified convergence analysis for the different IF variants. Finally, numerical experiments on a variety of graphs, including real-world data, confirm the effectiveness of the proposed methods. In particular, we test our algorithms on seismic data and the total electron content of the ionosphere. Those data are by their nature non-uniformly sampled, and, therefore, they cannot be directly analyzed by the standard IF method.

math.NA↗

arXiv2026

The iterated Golub-Kahan-Tikhonov method

The Golub-Kahan-Tikhonov method is a popular solution technique for large linear discrete ill-posed problems. This method first applies partial Golub-Kahan bidiagonalization to reduce the size of the given problem and then uses Tikhonov regularization to compute a meaningful approximate solution of the reduced problem. It is well known that iterated variants of this method often yield approximate solutions of higher quality than the standard non-iterated method. Moreover, it produces more accurate computed solutions than the Arnoldi method when the matrix that defines the linear discrete ill-posed problem is far from symmetric. This paper starts with an ill-posed operator equation in infinite-dimensional Hilbert space, discretizes the equation, and then applies the iterated Golub-Kahan-Tikhonov method to the solution of the latter problem. An error analysis that addresses all discretization and approximation errors is provided. Additionally, a new approach for choosing the regularization parameter is described. This solution scheme produces more accurate approximate solutions than the standard (non-iterated) Golub-Kahan-Tikhonov method and the iterated Arnoldi-Tikhonov method.

math.NA↗

arXiv2025

Trust-Region Methods with Low-Fidelity Objective Models

We introduce two multifidelity trust-region methods based on the Magical Trust Region (MTR) framework. MTR augments the classical trust-region step with a secondary, informative direction. In our approaches, the secondary ``magical'' directions are determined by solving coarse trust-region subproblems based on low-fidelity objective models. The first proposed method, Sketched Trust-Region (STR), constructs this secondary direction using a sketched matrix to reduce the dimensionality of the trust-region subproblem. The second method, SVD Trust-Region (SVDTR), defines the magical direction via a truncated singular value decomposition of the dataset, capturing the leading directions of variability. Several numerical examples illustrate the potential gain in efficiency.

math.NA↗

arXiv2025

Improved parameter selection strategy for the iterated Arnoldi-Tikhonov method

The iterated Arnoldi-Tikhonov (iAT) method is a regularization technique particularly suited for solving large-scale ill-posed linear inverse problems. Indeed, it reduces the computational complexity through the projection of the discretized problem into a lower-dimensional Krylov subspace, where the problem is then solved. This paper studies iAT under an additional hypothesis on the discretized operator. It presents a theoretical analysis of the approximation errors, leading to an a posteriori rule for choosing the regularization parameter. Our proposed rule results in more accurate computed approximate solutions compared to the a posteriori rule recently proposed in arXiv:2311.11823. The numerical results confirm the theoretical analysis, providing accurate computed solutions even when the new assumption is not satisfied.

math.NA↗

arXiv2025

Convergence analysis and parameter estimation for the iterated Arnoldi-Tikhonov method

The Arnoldi-Tikhonov method is a well-established regularization technique for solving large-scale ill-posed linear inverse problems. This method leverages the Arnoldi decomposition to reduce computational complexity by projecting the discretized problem into a lower-dimensional Krylov subspace, in which it is solved. This paper explores the iterated Arnoldi-Tikhonov method, conducting a comprehensive analysis that addresses all approximation errors. Additionally, it introduces a novel strategy for choosing the regularization parameter, leading to more accurate approximate solutions compared to the standard Arnoldi-Tikhonov method. Moreover, the proposed method demonstrates robustness with respect to the regularization parameter, as confirmed by the numerical results.

math.NA↗

arXiv2025

Blocking structures, approximation, and preconditioning

We consider block-structured matrices $A_n$, where the blocks are of (block) unilevel Toeplitz type with $s\times t$ matrix-valued generating functions. Under mild assumptions on the size of the (rectangular) blocks, the asymptotic distribution of the singular values of {the} associated matrix-sequences is identified and, when the related singular value symbol is Hermitian, it coincides with the spectral symbol. Building on the theoretical derivations, we approximate the matrices with simplified block structures that show two important features: a) the related simplified matrix-sequence has the same distributions as $\{A_{n}\}_{n}$; b) a generic linear system involving the simplified structures can be solved in $O(n\log n)$ arithmetic operations. The two key properties a) and b) suggest a natural way for preconditioning a linear system with coefficient matrix $A_n$. Under mild assumptions, the singular value analysis and the spectral analysis of the preconditioned matrix-sequences is provided, together with a wide set of numerical experiments.

math.NA↗

arXiv2024

A data-dependent regularization method based on the graph Laplacian

We investigate a variational method for ill-posed problems, named $\texttt{graphLa+}Ψ$, which embeds a graph Laplacian operator in the regularization term. The novelty of this method lies in constructing the graph Laplacian based on a preliminary approximation of the solution, which is obtained using any existing reconstruction method $Ψ$ from the literature. As a result, the regularization term is both dependent on and adaptive to the observed data and noise. We demonstrate that $\texttt{graphLa+}Ψ$ is a regularization method and rigorously establish both its convergence and stability properties. We present selected numerical experiments in 2D computerized tomography, wherein we integrate the $\texttt{graphLa+}Ψ$ method with various reconstruction techniques $Ψ$, including Filter Back Projection ($\texttt{graphLa+FBP}$), standard Tikhonov ($\texttt{graphLa+Tik}$), Total Variation ($\texttt{graphLa+TV}$), and a trained deep neural network ($\texttt{graphLa+Net}$). The $\texttt{graphLa+}Ψ$ approach significantly enhances the quality of the approximated solutions for each method $Ψ$. Notably, $\texttt{graphLa+Net}$ is outperforming, offering a robust and stable application of deep neural networks in solving inverse problems.

math.NA↗

arXiv2024

A Preconditioned Version of a Nested Primal-Dual Algorithm for Image Deblurring

Variational models for image deblurring problems typically consist of a smooth term and a potentially non-smooth convex term. A common approach to solving these problems is using proximal gradient methods. To accelerate the convergence of these first-order iterative algorithms, strategies such as variable metric methods have been introduced in the literature. In this paper, we prove that, for image deblurring problems, the variable metric strategy can be reinterpreted as a right preconditioning method. Consequently, we explore an inexact left-preconditioned version of the same proximal gradient method. We prove the convergence of the new iteration to the minimum of a variational model where the norm of the data fidelity term depends on the preconditioner. The numerical results show that left and right preconditioning are comparable in terms of the number of iterations required to reach a prescribed tolerance, but left preconditioning needs much less CPU time, as it involves fewer evaluations of the preconditioner matrix compared to right preconditioning. The quality of the computed solutions with left and right preconditioning are comparable. Finally, we propose some non-stationary sequences of preconditioners that allow for fast and stable convergence to the solution of the variational problem with the classical $\ell^2$--norm on the fidelity term.

math.NA↗

arXiv2024

A note on the convergence of multigrid methods for the Riesz-space equation and an application to image deblurring

In the past decades, a remarkable amount of research has been carried out regarding fast solvers for large linear systems resulting from various discretizations of fractional differential equations (FDEs). In the current work, we focus on multigrid methods for a Riesz-space FDE whose theoretical convergence analysis of such multigrids is currently limited to the two-grid method. Here we provide a detailed theoretical convergence study in the case of V-cycle and W-cycle. Moreover, we discuss its use combined with a band approximation and we compare the result with both $τ$ and circulant preconditionings. The numerical tests include 2D problems as well as the extension to the case of a Riesz-FDE with variable coefficients. Finally, we apply the best-performing method to an image deblurring problem with Tikhonov regularization.

math.NA↗

arXiv2024

Whiteness-based bilevel learning of regularization parameters in imaging

We consider an unsupervised bilevel optimization strategy for learning regularization parameters in the context of imaging inverse problems in the presence of additive white Gaussian noise. Compared to supervised and semi-supervised metrics relying either on the prior knowledge of reference data and/or on some (partial) knowledge on the noise statistics, the proposed approach optimizes the whiteness of the residual between the observed data and the observation model with no need of ground-truth data.We validate the approach on standard Total Variation-regularized image deconvolution problems which show that the proposed quality metric provides estimates close to the mean-square error oracle and to discrepancy-based principles.

math.OC↗

arXiv2024

Analysis on aggregation and block smoothers in multigrid methods for block Toeplitz linear systems

We present novel improvements in the context of symbol-based multigrid procedures for solving large block structured linear systems. We study the application of an aggregation-based grid transfer operator that transforms the symbol of a block Toeplitz matrix from matrix-valued to scalar-valued at the coarser level. Our convergence analysis of the Two-Grid Method (TGM) reveals the connection between the features of the scalar-valued symbol at the coarser level and the properties of the original matrix-valued one. This allows us to prove the convergence of a V-cycle multigrid with standard grid transfer operators for scalar Toeplitz systems at the coarser levels. Consequently, we extend the class of suitable smoothers for block Toeplitz matrices, focusing on the efficiency of block strategies, particularly the relaxed block Jacobi method. General conditions on smoothing parameters are derived, with emphasis on practical applications where these parameters can be calculated with negligible computational cost. We test the proposed strategies on linear systems stemming from the discretization of differential problems with $\mathbb{Q}_{d} $ Lagrangian FEM or B-spline with non-maximal regularity. The numerical results show in both cases computational advantages compared to existing methods for block structured linear systems.

math.NA↗

arXiv2023

Symbol based Convergence Analysis in Block Multigrid Methods with Applications for Stokes Problems

The main focus of this paper is the study of efficient multigrid methods for large linear systems with a particular saddle-point structure. Indeed, when the system matrix is symmetric, but indefinite, the variational convergence theory that is usually used to prove multigrid convergence cannot be directly applied. However, different algebraic approaches analyze properly preconditioned saddle-point problems, proving convergence of the Two-Grid method. In particular, this is efficient when the blocks of the coefficient matrix possess a Toeplitz or circulant structure. Indeed, it is possible to derive sufficient conditions for convergence and provide optimal parameters for the preconditioning of the saddle-point problem in terms of the associated generating symbols. In this paper, we propose a symbol-based convergence analysis for problems that have a hidden block Toeplitz structure. Then, they can be investigated focusing on the properties of the associated generating function f, which consequently is a matrix-valued function with dimension depending on the block size of the problem. As numerical tests we focus on the matrix sequence stemming from the finite element approximation of the Stokes problem. We show the efficiency of the methods studying the hidden 9-by-9 block multilevel structure of the obtained matrix sequence. Moreover, we propose an efficient algebraic multigrid method with convergence rate independent of the matrix size. Finally, we present several numerical tests comparing the results with state-of-the-art strategies.

math.NA↗

arXiv2022

Symmetrization Techniques in Image Deblurring

This paper presents a couple of preconditioning techniques that can be used to enhance the performance of iterative regularization methods applied to image deblurring problems with a variety of point spread functions (PSFs) and boundary conditions. More precisely, we first consider the anti-identity preconditioner, which symmetrizes the coefficient matrix associated to problems with zero boundary conditions, allowing the use of MINRES as a regularization method. When considering more sophisticated boundary conditions and strongly nonsymmetric PSFs, the anti-identity preconditioner improves the performance of GMRES. We then consider both stationary and iteration-dependent regularizing circulant preconditioners that, applied in connection with the anti-identity matrix and both standard and flexible Krylov subspaces, speed up the iterations. A theoretical result about the clustering of the eigenvalues of the preconditioned matrices is proved in a special case. The results of many numerical experiments are reported to show the effectiveness of the new preconditioning techniques, including when considering the deblurring of sparse images.

math.NA↗

arXiv2022

Multigrid for two-sided fractional differential equations discretized by finite volume elements on graded meshes

It is known that the solution of a conservative steady-state two-sided fractional diffusion problem can exhibit singularities near the boundaries. As consequence of this, and due to the conservative nature of the problem, we adopt a finite volume elements discretization approach over a generic non-uniform mesh. We focus on grids mapped by a smooth function which consist in a combination of a graded mesh near the singularity and a uniform mesh where the solution is smooth. Such a choice gives rise to Toeplitz-like discretization matrices and thus allows a low computational cost of the matrix-vector product and a detailed spectral analysis. The obtained spectral information is used to develop an ad-hoc parameter free multigrid preconditioner for GMRES, which is numerically shown to yield good convergence results in presence of graded meshes mapped by power functions that accumulate points near the singularity. The approximation order of the considered graded meshes is numerically compared with the one of a certain composite mesh given in literature that still leads to Toeplitz-like linear systems and is then still well-suited for our multigrid method. Several numerical tests confirm that power graded meshes result in lower approximation errors than composite ones and that our solver has a wide range of applicability.

math.NA↗

arXiv2022

Symbol based convergence analysis in multigrid methods for saddle point problems

Saddle point problems arise in a variety of applications, e.g., when solving the Stokes equations. They can be formulated such that the system matrix is symmetric, but indefinite, so the variational convergence theory that is usually used to prove multigrid convergence cannot be applied. In a 2016 paper in Numerische Mathematik Notay has presented a different algebraic approach that analyzes properly preconditioned saddle point problems, proving convergence of the Two-Grid method. In the present paper we analyze saddle point problems where the blocks are circulant within this framework. We are able to derive sufficient conditions for convergence and provide optimal parameters for the preconditioning of the saddle point problem and for the point smoother that is used. The analysis is based on the generating symbols of the circulant blocks. Further, we show that the structure can be kept on the coarse level, allowing for a recursive application of the approach in a W- or V-cycle and proving the "level independency" property. Numerical results demonstrate the efficiency of the proposed method in the circulant and the Toeplitz case.

math.NA↗

arXiv2021

A symbol based analysis for multigrid methods for Block-Circulant and Block-Toeplitz Systems

In the literature, there exist several studies on symbol-based multigrid methods for the solution of linear systems having structured coefficient matrices. In particular, the convergence analysis for such methods has been obtained in an elegant form in the case of Toeplitz matrices generated by a scalar-valued function. In the block-Toeplitz setting, that is, in the case where the matrix entries are small generic matrices instead of scalars, some algorithms have already been proposed regarding specific applications and a first rigorous convergence analysis has been performed in [7]. However, with the existent symbol-based theoretical tools, it is still not possible to prove the convergence of many multigrid methods known in the literature. This paper aims to generalize the previous results giving more general sufficient conditions on the symbol of the grid transfer operators.In particular, we treat matrix-valued trigonometric polynomials which can be non-diagonalizable and singular at all points and we express the new conditions in terms of the eigenvectors associated with the ill-conditioned subspace. Moreover, we extend the analysis to the V-cycle method proving a linear convergence rate under stronger conditions, which resemble those given in the scalar case. In order to validate our theoretical findings, we present a classical block structured problem stemming from a FEM approximation of a second order differential problem. We focus on two multigrid strategies that use the geometric and the standard bisection grid transfer operators and we prove that both fall into the category of projectors satisfying the proposed conditions. In addition, using a tensor product argument, we provide a strategy to construct efficient V-cycle procedures in the block multilevel setting.

math.NA↗