Searcharxiv⌕ Search

arXiv subjects

Tran T. A. Nghia

Publications and source records attributed to Tran T. A. Nghia.

16 recordsLinked to original sources

Nonsmooth Newton methods with effective subspaces for polyhedral regularization

We propose several new nonsmooth Newton methods for solving convex composite optimization problems with polyhedral regularizers, while avoiding the computation of complicated second-order information on these functions. Under the tilt-stability condition at the optimal solution, these methods achieve the quadratic convergence rates expected of Newton schemes. Numerical experiments on Lasso, generalized Lasso, OSCAR-regularized least-square problems, and an image super-resolution task illustrate both the broad applicability and the accelerated convergence profile of the proposed algorithms, in comparison with first-order and several recently developed nonsmooth Newton schemes.

math.OC↗

Isolated calmness of regularized linear inverse problems

This paper studies the isolated calmness property of solution mappings arising from convex regularized linear inverse problems. We mainly establish a tangent-cone characterization of this property. For convex piecewise linear-quadratic regularizers, the isolated calmness coincides with the solution uniqueness, leading to simple verification procedures. In particular, for analysis sparsity regularization, our condition can be verified by linear programming.

math.OC↗

Stability results for regularized least-squares problems via generalized Hessian expressions and monotone generalized equations

We study perturbation and stability properties of solution mappings associated with convex regularized least-squares problems. We first establish an implicit function theorem for generalized equations governed by maximally monotone operators and smooth perturbations, yielding conditions for local Lipschitz continuity, directional differentiability, and semismoothness of solution mappings. We then characterize the kernel of generalized Hessians of convex functions through the subspace parallel to the subdifferential under $C^2$-cone reducibility assumptions on the conjugate of the regularizer, thereby replacing difficult second-order objects by tractable first-order conditions. As applications, we derive stability results for broad classes of regularized least-squares problems, including weighted polyhedral support-function regularizers and piecewise linear-quadratic penalties. Our framework unifies and extends several recent results on Lipschitz stability for LASSO-type models and monotone generalized equations.

math.OC↗

Isolated Calmness in Regularized Convex Optimization

This paper studies the isolated calmness of the optimal solution mapping and the associated Lagrange system for regularized convex composite optimization problems. Several necessary and sufficient conditions for this property are established. These conditions are geometric in nature and relatively simple to verify. To support the analysis, we also develop a so-called zero-product property for second-order structures, namely the graphical derivative of the subgradient mapping of convex functions.

math.OC↗

Stable Recovery of Regularized Linear Inverse Problems

Recovering a low-complexity signal from its noisy observations by regularization methods is a cornerstone of inverse problems and compressed sensing. Stable recovery ensures that the original signal can be approximated linearly by optimal solutions of the corresponding Morozov or Tikhonov regularized optimization problems. In this paper, we propose new characterizations for stable recovery in finite-dimensional spaces, uncovering the role of nonsmooth second-order information. These insights enable a deeper understanding of stable recovery and their practical implications. As a consequence, we apply our theory to derive new sufficient conditions for stable recovery of the analysis group sparsity problems, including the group sparsity and isotropic total variation problems. Numerical experiments on these two problems give favorable results about using our conditions to test stable recovery.

math.OC↗

A Linearized Alternating Direction Multiplier Method for Federated Matrix Completion Problems

Matrix completion is fundamental for predicting missing data with a wide range of applications in personalized healthcare, e-commerce, recommendation systems, and social network analysis. Traditional matrix completion approaches typically assume centralized data storage, which raises challenges in terms of computational efficiency, scalability, and user privacy. In this paper, we address the problem of federated matrix completion, focusing on scenarios where user-specific data is distributed across multiple clients, and privacy constraints are uncompromising. Federated learning provides a promising framework to address these challenges by enabling collaborative learning across distributed datasets without sharing raw data. We propose \texttt{FedMC-ADMM} for solving federated matrix completion problems, a novel algorithmic framework that combines the Alternating Direction Method of Multipliers with a randomized block-coordinate strategy and alternating proximal gradient steps. Unlike existing federated approaches, \texttt{FedMC-ADMM} effectively handles multi-block nonconvex and nonsmooth optimization problems, allowing efficient computation while preserving user privacy. We analyze the theoretical properties of our algorithm, demonstrating subsequential convergence and establishing a convergence rate of $\mathcal{O}(K^{-1/2})$, leading to a communication complexity of $\mathcal{O}(ε^{-2})$ for reaching an $ε$-stationary point. This work is the first to establish these theoretical guarantees for federated matrix completion in the presence of multi-block variables. To validate our approach, we conduct extensive experiments on real-world datasets, including MovieLens 1M, 10M, and Netflix. The results demonstrate that \texttt{FedMC-ADMM} outperforms existing methods in terms of convergence speed and testing accuracy.

cs.LG↗

Geometric characterizations of Lipschitz stability for convex optimization problems

In this paper, we mainly study tilt stability and Lipschitz stability of convex optimization problems. Our characterizations are geometric and fully computable in many important cases. As a result, we apply our theory to the group Lasso problem and the nuclear norm minimization problem and reveal that the Lipschitz stability of the solution mapping in these problems is automatic whenever the solution mapping is single-valued.

math.OC↗

Lipschitz stability of least-squares problems regularized by functions with $\mathcal{C}^2$-cone reducible conjugates

In this paper, we study Lipschitz continuity of the solution mappings of regularized least-squares problems for which the convex regularizers have (Fenchel) conjugates that are $\mathcal{C}^2$-cone reducible. Our approach, by using Robinson's strong regularity on the dual problem, allows us to obtain new characterizations of Lipschitz stability that rely solely on first-order information, thus bypassing the need to explore second-order information (curvature) of the regularizer. We show that these solution mappings are automatically Lipschitz continuous around the points in question whenever they are locally single-valued. We leverage our findings to obtain new characterizations of full stability and tilt stability for a broader class of convex additive-composite problems.

math.OC↗

Solution uniqueness of convex optimization problems via the radial cone

In this paper, we mainly study solution uniqueness of some convex optimization problems. Our characterizations of solution uniqueness are in terms of the radial cone. This approach allows us to know when a unique solution is a strong solution or even a tilt-stable one without checking second-order information. Consequently, we apply our theory to low-rank optimization problems. The radial cone is fully calculated in this case and numerical experiments show that our characterizations are sharp.

math.OC↗

Geometric characterizations for strong minima with applications to nuclear norm minimization problems

In this paper, we introduce several geometric characterizations for strong minima of optimization problems. Applying these results to nuclear norm minimization problems allows us to obtain new necessary and sufficient quantitative conditions for this important property. Our characterizations for strong minima are weaker than the Restricted Injectivity and Nondegenerate Source Condition, which are usually used to identify solution uniqueness of nuclear norm minimization problems. Consequently, we obtain the minimum (tight) bound on the number of measurements for (strong) exact recovery of low-rank matrices.

math.OC↗

Sharp, strong and unique minimizers for low complexity robust recovery

In this paper, we show the important roles of sharp minima and strong minima for robust recovery. We also obtain several characterizations of sharp minima for convex regularized optimization problems. Our characterizations are quantitative and verifiable especially for the case of decomposable norm regularized problems including sparsity, group-sparsity, and low-rank convex problems. For group-sparsity optimization problems, we show that a unique solution is a strong solution and obtain quantitative characterizations for solution uniqueness.

math.OC↗

Second order optimality conditions for strong local minimizers via subgradient graphical derivative

This paper is devoted to the study of second order optimality conditions for strong local minimizers in the frameworks of unconstrained and constrained optimization problems in finite dimensions via subgradient graphical derivative. We prove that the positive definiteness of the subgradient graphical derivative of an extended-real-valued lower semicontinuous proper function at a proximal stationary point is sufficient for the quadratic growth condition. It is also a necessary condition for the latter property when the function is either subdifferentially continuous, prox-regular, twice epi-differentiable or variationally convex. By applying our results to the $\mathcal{C}^2$-cone reducible constrained programs, we establish no-gap second order optimality conditions for (strong) local minimizers under the metric subregularity constraint qualification. These results extend the classical second order optimality conditions by surpassing the well-known Robinson's constraint qualification. Our approach also highlights the interconnection between the strong metric subregularity of subdifferential and quadratic growth condition in optimization problems.

math.OC↗

Full stability of general parametric variational systems

The paper introduces and studies the notions of Lipschitzian and Hölderian full stability of solutions to three-parametric variational systems described in the generalized equation formalism involving nonsmooth base mappings and partial subgradients of prox-regular functions acting in Hilbert spaces. Employing advanced tools and techniques of second-order variational analysis allows us to establish complete characterizations of, as well as directly verifiable sufficient conditions for, such full stability notions under mild assumptions. Furthermore, we derive exact formulas and effective quantitative estimates for the corresponding moduli. The obtained results are specified for important classes of variational inequalities and variational conditions in both finite and infinite dimensions.

math.OC↗

Characterization of tilt stability via subgradient graphical derivative with applications to nonlinear programming

This paper is devoted to the study of tilt stability in finite dimensional optimization via the approach of using the subgradient graphical derivative. We establish a new characterization of tilt-stable local minimizers for a broad class of unconstrained optimization problems in terms of a uniform positive definiteness of the subgradient graphical derivative of the objective function around the point in question. By applying this result to nonlinear programming under the metric subregularity constraint qualification, we derive a second-order characterization and several new sufficient conditions for tilt stability. In particular, we show that each stationary point of a nonlinear programming problem satisfying the metric subregularity constraint qualification is a tilt-stable local minimizer if the classical strong second-order sufficient condition holds.

math.OC↗

Optimal rates of convergence of matrices with applications

We present a systematic study on the linear convergence rates of the powers of (real or complex) matrices. We derive a characterization when the optimal convergence rate is attained. This characterization is given in terms of semi-simpleness of all eigenvalues having the second-largest modulus after 1. We also provide applications of our general results to analyze the optimal convergence rates for several relaxed alternating projection methods and the generalized Douglas-Rachford splitting methods for finding the projection on the intersection of two subspaces. Numerical experiments confirm our convergence analysis.

math.OC↗

The rate of linear convergence of the Douglas-Rachford algorithm for subspaces is the cosine of the Friedrichs angle

The Douglas-Rachford splitting algorithm is a classical optimization method that has found many applications. When specialized to two normal cone operators, it yields an algorithm for finding a point in the intersection of two convex sets. This method for solving feasibility problems has attracted a lot of attention due to its good performance even in nonconvex settings. In this paper, we consider the Douglas-Rachford algorithm for finding a point in the intersection of two subspaces. We prove that the method converges strongly to the projection of the starting point onto the intersection. Moreover, if the sum of the two subspaces is closed, then the convergence is linear with the rate being the cosine of the Friedrichs angle between the subspaces. Our results improve upon existing results in three ways: First, we identify the location of the limit and thus reveal the method as a best approximation algorithm; second, we quantify the rate of convergence, and third, we carry out our analysis in general (possibly infinite-dimensional) Hilbert space. We also provide various examples as well as a comparison with the classical method of alternating projections.

math.OC↗