arXiv subjects

Francisco J. Aragón-Artacho

Publications and source records attributed to Francisco J. Aragón-Artacho.

12 recordsLinked to original sources

arXiv2026

Nonmonotone subgradient methods based on a local descent lemma

In this paper we present a nonmonotone line search subgradient algorithm tailored to upper-$\mathcal{C}^2$ functions. This is a family of nonsmooth and nonconvex functions that satisfies a nonsmooth and local version of the descent lemma, making them suitable for line searches. We prove subsequential convergence of the proposed algorithm to a stationary point of the optimization problem. Our approach allows us to cover the setting of various subgradient algorithms, including Newton and quasi-Newton methods. In addition, we propose a specification of the general scheme, named Self-adaptive Nonmonotone Subgradient Method (SNSM), which automatically updates the parameters of the line search. Particular attention is paid to the minimum sum-of-squares clustering problem, for which we provide a concrete implementation of SNSM. We conclude with some numerical experiments where we exhibit the advantages of SNSM in comparison with some known algorithms.

math.OC↗

arXiv2026

On the optimal relaxation parameter of graph-based splitting methods for subspaces

In this paper, we investigate the behavior of the family of graph-based splitting algorithms specialized to the problem of finding a point in the intersection of linear subspaces. The algorithms in this family, which encompasses several classical methods such as the Douglas-Rachford algorithm, are defined by a connected graph and a subgraph. Our main result establishes that when the graph and subgraph coincide, the optimal relaxation parameter is exactly $1$, thereby extending known results for the Douglas-Rachford algorithm to a much broader class of methods. Our analysis hinges on some properties of iso-averaged linear operators, which are defined as the average of an isometry and the identity, and are characterized by a specific symmetry of the norm of their relaxation.

math.OC↗

arXiv2026

Graph splitting methods: Fixed points and strong convergence for linear subspaces

In this paper, we develop a general analysis for the fixed points of the operators defining the graph splitting methods from [SIAM J. Optim., 34 (2024), pp. 1569-1594] by Bredies, Chenchene and Naldi. We particularize it to the case where the maximally monotone operators are normal cones of closed linear subspaces and provide an explicit formula for the limit points of the graph splitting schemes. We exemplify these results on some particular algorithms, unifying in this way some results previously derived as well as obtaining new ones.

math.OC↗

arXiv2026

A comparative numerical study of graph-based splitting algorithms for linear subspaces

In this note, we test the performance of six algorithms from the family of graph-based splitting methods [SIAM J. Optim., 34 (2024), pp. 1569-1594] specialized to normal cones of linear subspaces. To do this, we first implement some numerical experiments to determine the best relaxation parameter for each algorithm. Then, we compare the number of iterations each algorithm requires to reach a given stopping criterion, using the previously identified best relaxation parameter. The numerical results allow us to identify some relevant patterns and provide numerical evidence that may guide further theoretical analysis.

math.NA↗

arXiv2025

Projection onto the parabola

In this note, we provide explicit expressions for the projections onto the graph of a quadratic polynomial. The projections are obtained by examining the critical points of the associated quartic polynomial, that is, the roots of the cubic polynomial defining its derivative. We also focus on the case where the point we project lies on the vertical line defined by the parabola. Lastly, an explicit formula for the projection onto a higher dimensional parabola is derived.

math.GM↗

arXiv2024

Forward-backward algorithms devised by graphs

In this work, we present a methodology for devising forward-backward methods for finding zeros in the sum of a finite number of maximally monotone operators. We extend the framework and techniques from [SIAM J. Optim., 34 (2024), pp. 1569-1594] to cover the case involving a finite number of cocoercive operators, which should be directly evaluated instead of computing their resolvent. The algorithms are induced by three graphs that determine how the algorithm variables interact with each other and how they are combined to compute each resolvent. The hypotheses on these graphs ensure that the algorithms obtained have minimal lifting and are frugal, meaning that the ambient space of the underlying fixed point operator has minimal dimension and that each resolvent and each cocoercive operator is evaluated only once per iteration. This framework not only allows to recover some known methods, but also to generate new ones, as the forward-backward algorithm induced by a complete graph. We conclude with a numerical experiment showing how the choice of graphs influences the performance of the algorithms.

math.OC↗

arXiv2024

The superiorization method with restarted perturbations for split minimization problems with an application to radiotherapy treatment planning

In this paper we study the split minimization problem that consists of two constrained minimization problems in two separate spaces that are connected via a linear operator that maps one space into the other. To handle the data of such a problem we develop a superiorization approach that can reach a feasible point with reduced (not necessarily minimal) objective function values. The superiorization methodology is based on interlacing the iterative steps of two separate and independent iterative processes by perturbing the iterates of one process according to the steps dictated by the other process. We include in our developed method two novel elements. The first one is the permission to restart the perturbations in the superiorized algorithm which results in a significant acceleration and increases the computational efficiency. The second element is the ability to independently superiorize subvectors. This caters to the needs of real-world applications, as demonstrated here for a problem in intensity-modulated radiation therapy treatment planning.

math.OC↗

arXiv2023

The Boosted Double-Proximal Subgradient Algorithm for Nonconvex Optimization

In this paper we introduce the Boosted Double-proximal Subgradient Algorithm (BDSA), a novel splitting algorithm designed to address general structured nonsmooth and nonconvex mathematical programs expressed as sums and differences of composite functions. BDSA exploits the combined nature of subgradients from the data and proximal steps, and integrates a line-search procedure to enhance its performance. While BDSA encompasses existing schemes proposed in the literature, it extends its applicability to more diverse problem domains. We establish the convergence of BDSA under the Kurdyka--Lojasiewicz property and provide an analysis of its convergence rate. To evaluate the effectiveness of BDSA, we introduce a novel family of challenging test functions with an abundance of critical points. We conduct comparative evaluations demonstrating its ability to effectively escape non-optimal critical points. Additionally, we present two practical applications of BDSA for testing its efficacy, namely, a constrained minimum-sum-of-squares clustering problem and a nonconvex generalization of Heron's problem.

math.OC↗

arXiv2023

Coderivative-Based Semi-Newton Method in Nonsmooth Difference Programming

This paper addresses the study of a new class of nonsmooth optimization problems, where the objective is represented as a difference of two generally nonconvex functions. We propose and develop a novel Newton-type algorithm to solving such problems, which is based on the coderivative generated second-order subdifferential (generalized Hessian) and employs advanced tools of variational analysis. Well-posedness properties of the proposed algorithm are derived under fairly general requirements, while constructive convergence rates are established by using additional assumptions including the Kurdyka--Łojasiewicz condition. We provide applications of the main algorithm to solving a general class of nonsmooth nonconvex problems of structured optimization that encompasses, in particular, optimization problems with explicit constraints. Finally, applications and numerical experiments are given for solving practical problems that arise in biochemical models, constrained quadratic programming, etc., where advantages of our algorithms are demonstrated in comparison with some known techniques and results.

math.OC↗

arXiv2022

Distributed Forward-Backward Methods for Ring Networks

In this work, we propose and analyse forward-backward-type algorithms for finding a zero of the sum of finitely many monotone operators, which are not based on reduction to a two operator inclusion in the product space. Each iteration of the studied algorithms requires one resolvent evaluation per set-valued operator, one forward evaluation per cocoercive operator, and two forward evaluations per monotone operator. Unlike existing methods, the structure of the proposed algorithms are suitable for distributed, decentralised implementation in ring networks without needing global summation to enforce consensus between nodes.

math.OC↗

arXiv2022

A primal-dual splitting algorithm for composite monotone inclusions with minimal lifting

In this work, we study resolvent splitting algorithms for solving composite monotone inclusion problems. The objective of these general problems is finding a zero in the sum of maximally monotone operators composed with linear operators. Our main contribution is establishing the first primal-dual splitting algorithm for composite monotone inclusions with minimal lifting. Specifically, the proposed scheme reduces the dimension of the product space where the underlying fixed point operator is defined, in comparison to other algorithms, without requiring additional evaluations of the resolvent operators. We prove the convergence of this new algorithm and analyze its performance in a problem arising in image deblurring and denoising. This work also contributes to the theory of resolvent splitting algorithms by extending the minimal lifting theorem recently proved by Malitsky and Tam to schemes with resolvent parameters.

math.OC↗

arXiv2022

A direct proof of convergence of Davis-Yin splitting algorithm allowing larger stepsizes

This note is devoted to the splitting algorithm proposed by Davis and Yin in 2017 for computing a zero of the sum of three maximally monotone operators, with one of them being cocoercive. We provide a direct proof that guarantees its convergence when the stepsizes are smaller than four times the cocoercivity constant, thus doubling the size of the interval established by Davis and Yin. As a by-product, the same conclusion applies to the forward-backward splitting algorithm. Further, we use the notion of "strengthening" of a set-valued operator to derive a new splitting algorithm for computing the resolvent of the sum. Last but not least, we provide some numerical experiments illustrating the importance of appropriately choosing the stepsize and relaxation parameters of the algorithms.

math.OC↗