Searcharxiv⌕ Search

arXiv subjects

Luis Briceño-Arias

Publications and source records attributed to Luis Briceño-Arias.

12 recordsLinked to original sources

Multi-Principal Competition for an Exclusive Agent: characterization and approximation of Nash Equilibria

This paper introduces and studies a Principal-Agent competition model in which two risk-neutral Principals compete to hire a single Agent. The Agent chooses to work exclusively for one Principal, making the Agent's reservation utility endogenous, as it is determined by the competing offers. We characterize the Nash equilibria of the resulting game by relating them to the individual Principal-Agent contracting problems and analyzing the Agent's selection bias. We further introduce two numerical algorithms to approximate Nash equilibria by locating sign changes of the value functions of the Principals' individual problems. The first is a Newton-type method that exploits differentiability of the value functions, while the second is a bisection method that does not require differentiability. The proposed procedures are illustrated through several examples involving exponential, logarithmic, and constant relative risk aversion (CRRA) utility functions within the polynomial framework of Renner and Schmedders (2015). We also provide technical results regarding the regularity of the value function of a classical Principal-Agent problem, including differentiability under suitable conditions.

math.OC↗

Optimal Leveraging of Smoothness and Strong Convexity for Peaceman--Rachford Splitting

In this paper, we introduce a simple methodology to leverage strong convexity and smoothness in order to obtain an optimal linear convergence rate for the Peaceman--Rachford splitting (PRS) scheme applied to optimization problems involving two smooth strongly convex functions. The approach consists of adding and subtracting suitable quadratic terms from one function to the other so as to redistribute strong convexity in the primal formulation and smoothness in the dual formulation. This yields an equivalent modified optimization problem in which each term has adjustable levels of strong convexity and smoothness. In this setting, the Peaceman--Rachford splitting method converges linearly to the solution of the modified problem with a convergence rate that can be optimized with respect to the introduced parameters. Upon returning to the original formulation, this procedure gives rise to a modified variant of PRS. The optimal linear rate established in this work is strictly better than the best rates previously available in the general setting. The practical performance of the method is illustrated through an academic example and applications in image processing.

math.OC↗

A flexible block-coordinate forward-backward algorithm for non-smooth and non-convex optimization

Block coordinate descent (BCD) methods are prevalent in large scale optimization problems due to the low memory and computational costs per iteration, the predisposition to parallelization, and the ability to exploit the structure of the problem. The theoretical and practical performance of BCD relies heavily on the rules defining the choice of the blocks to be updated at each iteration. We propose a new deterministic BCD framework that allows for very flexible updates, while guaranteeing state-of-the-art convergence guarantees on non-smooth nonconvex optimization problems. While encompassing several update rules from the literature, this framework allows for priority on updates of particular blocks and correlations in the block selection between iterations, which is not permitted under the classical convergent stochastic framework. This flexibility is leveraged in the context of multilevel optimization algorithms and, in particular, in multilevel image restoration problems, where the efficiency of the approach is illustrated.

math.OC↗

Splitting Algorithms for Distributionally Robust Optimization

In this paper, we provide different splitting methods for solving distributionally robust optimization problems in cases where the uncertainties are described by discrete distributions. The first method involves computing the proximity operator of the supremum function that appears in the optimization problem. The second method solves an equivalent monotone inclusion formulation derived from the first-order optimality conditions, where the resolvents of the monotone operators involved in the inclusion are computable. The proposed methods are applied to solve the Couette inverse problem with uncertainty and the denoising problem with uncertainty. We present numerical results to compare the efficiency of the algorithms.

math.OC↗

Resolvent of the parallel composition and proximity operator of the infimal postcomposition

In this paper we provide the resolvent computation of the parallel composition of a maximally monotone operator by a linear operator under mild assumptions. Connections with a modification of the warped resolvent are provided. In the context of convex optimization, we obtain the proximity operator of the infimal postcomposition of a convex function by a linear operator and we extend full range conditions on the linear operator to mild qualification conditions. We also introduce a generalization of the proximity operator involving a general linear bounded operator leading to a generalization of Moreau's decomposition for composite convex optimization.

math.OC↗

Four Operator Splitting via a Forward-Backward-Half-Forward Algorithm with Line Search

In this article we provide a splitting method for solving monotone inclusions in a real Hilbert space involving four operators: a maximally monotone, a monotone-Lipschitzian, a cocoercive, and a monotone-continuous operator. The proposed method takes advantage of the intrinsic properties of each operator, generalizing the forward-back-half forward splitting and the Tseng's algorithm with line-search. At each iteration, our algorithm defines the step-size by using a line search in which the monotone-Lipschitzian and the cocoercive operators need only one activation. We also derive a method for solving non-linearly constrained composite convex optimization problems in real Hilbert spaces. Finally, we implement our algorithm in a non-linearly constrained least-square problem, and we compare its performance with available methods in the literature.

math.OC↗

Theoretical and numerical comparison of first-order algorithms for cocoercive equations and smooth convex optimization

This paper provides a theoretical and numerical comparison of classical first-order splitting methods for solving smooth convex optimization problems and cocoercive equations. From a theoretical point of view, we compare convergence rates of gradient descent, forward-backward, Peaceman-Rachford, and Douglas-Rachford algorithms for minimizing the sum of two smooth convex functions when one of them is strongly convex. A similar comparison is given in the more general cocoercive setting under the presence of strong monotonicity and we observe that the convergence rates in optimization are strictly better than the corresponding rates for cocoercive equations for some algorithms. We obtain improved rates with respect to the literature in several instances by exploiting the structure of our problems. Moreover, we indicate which algorithm has the lowest convergence rate depending on strong convexity and cocoercive parameters. From a numerical point of view, we verify our theoretical results by implementing and comparing previous algorithms in well-established signal and image inverse problems involving sparsity. We replace the widely used $\ell_1$ norm with the Huber loss and we observe that fully proximal-based strategies have numerical and theoretical advantages with respect to methods using gradient steps.

math.OC↗

A Primal-Dual Partial Inverse Splitting for Constrained Monotone Inclusions: Applications to stochastic Programming and Mean Field Games

In this work we study a constrained monotone inclusion involving the normal cone to a closed vector subspace and a priori information on primal solutions. We model this information by imposing that solutions belongs to the fixed point set of an averaged nonexpansive mapping. We characterize the solutions using an auxiliary inclusion that involves the partial inverse operator. Then, we propose the primal-dual partial inverse splitting and we prove its weak convergence to a solution of the inclusion, generalizing several methods in the literature. The efficiency of the proposed method is illustrated in two non-smooth convex optimization problems whose constraints have vector subspace structure. Finally, the proposed algorithm is applied to find a solution to a stochastic arc capacity expansion problem in transport networks.

math.OC↗

Primal-dual splittings as fixed point iterations in the range of linear operators

In this paper we study the relaxed primal-dual algorithm for solving composite monotone inclusions in real Hilbert spaces with critical preconditioners. Our approach is based in new results on the asymptotic behaviour of Krasnosel'ski\uı-Mann (KM) iterations defined in the range of monotone self-adjoint linear operators. These results generalize the convergence of classical KM iterations aiming at approximating fixed points. We prove that the relaxed primal-dual algorithm with critical preconditioners define KM iterations in the range of a particular monotone self-adjoint linear operator with non-trivial kernel. We then deduce from our fixed point approach that the shadows of primal-dual iterates on the range of the linear operator converges weakly to some point in this vector subspace from which we obtain a solution. This generalizes (Condat 2013 Theorem 3.3) to infinite dimensional relaxed primal-dual monotone inclusions involving critical preconditioners. The Douglas-Rachford splitting (DRS) is interpreted as a particular instance of the primal-dual algorithm when the step-sizes are critical and we recover classical results from this new perspective. We implement the relaxed primal-dual algorithm with critical preconditioners in total variation reconstruction and we illustrate its flexibility and efficiency.

math.OC↗

Random Activations in Primal-Dual Splittings for Monotone Inclusions with a priori Information

In this paper, we propose a numerical approach for solving composite primal-dual monotone inclusions with a priori information. The underlying a priori information set is represented by the intersection of fixed point sets of a finite number of operators, and we propose and algorithm that activates the corresponding set by following a finite-valued random variable at each iteration. Our formulation is flexible and includes, for instance, deterministic and Bernoulli activations over cyclic schemes, and Kaczmarz-type random activations. The almost sure convergence of the algorithm is obtained by means of properties of stochastic Quasi-Fejér sequences. We also recover several primal-dual algorithms for monotone inclusions in the context without a priori information and classical algorithms for solving convex feasibility problems and linear systems. In the context of convex optimization with inequality constraints, any selection of the constraints defines the a priori information set, in which case the operators involved are simply projections onto half spaces. By incorporating random projections onto a selection of the constraints to classical primal-dual schemes, we obtain faster algorithms as we illustrate by means of a numerical application to a stochastic arc capacity expansion problem in a transport network.

math.OC↗

On the implementation of a primal-dual algorithm for second order time-dependent mean field games with local couplings

We study a numerical approximation of a time-dependent Mean Field Game (MFG) system with local couplings. The discretization we consider stems from a variational approach described in [Briceno-Arias, Kalise, and Silva, SIAM J. Control Optim., 2017] for the stationary problem and leads to the finite difference scheme introduced by Achdou and Capuzzo-Dolcetta in [SIAM J. Numer. Anal., 48(3):1136-1162, 2010]. In order to solve the finite dimensional variational problems, in [Briceno-Arias, Kalise, and Silva, SIAM J. Control Optim., 2017] the authors implement the primal-dual algorithm introduced by Chambolle and Pock in [J. Math. Imaging Vision, 40(1):120-145, 2011], whose core consists in iteratively solving linear systems and applying a proximity operator. We apply that method to time-dependent MFG and, for large viscosity parameters, we improve the linear system solution by replacing the direct approach used in [Briceno-Arias, Kalise, and Silva, SIAM J. Control Optim., 2017] by suitable preconditioned iterative algorithms.

math.OC↗

A projected primal-dual splitting for solving constrained monotone inclusions

In this paper we provide an algorithm for solving constrained composite primal-dual monotone inclusions, i.e., monotone inclusions in which a priori information on primal-dual solutions is represented via closed convex sets. The proposed algorithm incorporates a projection step onto the a priori information sets and generalizes the method proposed in [Vũ, B.C.: A splitting algorithm for dual monotone inclusions involving cocoercive operators. Adv. Comput. Math. 38, 667-681 (2013)]. Moreover, under the presence of strong monotonicity, we derive an accelerated scheme inspired on [Chambolle, A.; Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40, 120-145 (2011)] applied to the more general context of constrained monotone inclusions. In the particular case of convex optimization, our algorithm generalizes the methods proposed in [Condat, L.: A primal-dual splitting method for convex optimization involving lipschitzian, proximable and linear composite terms. J. Optim. Theory Appl. 158,460-479 (2013)] allowing a priori information on solutions and we provide an accelerated scheme under strong convexity. An application of our approach with a priori information is constrained convex optimization problems, in which available primal-dual methods impose constraints via Lagrange multiplier updates, usually leading to slow algorithms with unfeasible primal iterates. The proposed modification forces primal iterates to satisfy a selection of constraints onto which we can project, obtaining a faster method as numerical examples exhibit. The obtained results extend and improve several results in the literature.

math.OC↗