Searcharxiv⌕ Search

arXiv · 2610.08587

Primal-Dual Error Bounds and KKT Metric Subregularity in Convex Composite Optimization

Abstract

We study primal and dual error bounds for convex composite optimization problems and their Fenchel duals. For the primal problem, we use a proximal-gradient residual, while for the generally nonsmooth dual problem we use a subdifferential residual. We introduce a reduced primal--dual KKT mapping whose zero set coincides with the Cartesian product of the primal and dual solution sets under the standing solvability and strong-duality assumptions. We establish implications in both directions between metric subregularity of the reduced KKT mapping and the primal and dual local error bounds. If the composite matrix has full row rank and the smooth gradient is locally Lipschitz continuous, KKT metric subregularity is equivalent to the primal local error bound. If the smooth term is strongly convex, it is equivalent to the dual local error bound. Under full row rank and strong convexity, KKT metric subregularity is equivalent to the simultaneous validity of both error bounds. We also establish relations between the Luo--Tseng and local error bounds. The framework is then applied to quadratic--polyhedral models, strongly convex smooth models with general convex regularizers, and regularized least-squares models beyond polyhedrality and strong convexity, providing a unified treatment of primal, dual, and KKT error-bound properties.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Jiani Li, Qingna Li. 2026-10-06. Primal-Dual Error Bounds and KKT Metric Subregularity in Convex Composite Optimization. https://arxiv.org/abs/2610.08587

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Multilevel Regularized Newton Methods with Fast Convergence Rates

We introduce new multilevel methods for solving large-scale unconstrained optimization problems. Specifically, the philosophy of multilevel methods is applied to Newton-type methods that regularize the Newton sub-problem using second order information from a coarse (low dimensional) sub-problem. The new \emph{regularized multilevel methods} provably converge from any initialization point and enjoy faster convergence rates than Gradient Descent. In particular, for arbitrary functions with Lipschitz continuous Hessians, we show that their convergence rate interpolates between the rate of Gradient Descent and that of the cubic Newton method. If, additionally, the objective function is assumed to be convex, then the proposed method converges with the fast $\mathcal{O}(k^{-2})$ rate. Hence, since the updates are generated using a \emph{coarse} model in low dimensions, the theoretical results of this paper significantly speed-up the convergence of Newton-type or preconditioned gradient methods in practical applications. Preliminary numerical results suggest that the proposed multilevel algorithms are significantly faster than current state-of-the-art methods.

math.OC↗

Adaptive Algorithms for Robust Phase Retrieval

This paper considers robust phase retrieval, which can be cast as a nonsmooth and nonconvex optimization problem. We propose two first-order algorithms with adaptive step sizes: the subgradient algorithm (AdaSubGrad) and the inexact proximal linear algorithm (AdaIPL). Our contribution lies in a novel design of adaptive step sizes based on quantiles of the absolute residuals. We analyze local linear convergence of both algorithms across different hyperparameter regimes under i.i.d. centered sub-Gaussian measurements, a stability condition linking the measurement distribution and the corruption level, and an additional uniform small-ball condition. Numerical experiments on synthetic datasets and image recovery also demonstrate that our methods are competitive with existing methods in the literature that utilize predetermined (possibly impractical) step sizes, such as subgradient methods and the inexact proximal linear method.

math.OC↗

A Simple yet Highly Accurate Prediction-Correction Algorithm for Time-Varying Optimization

This paper proposes a simple yet highly accurate prediction-correction algorithm, SHARP, for unconstrained time-varying optimization problems. Its prediction is based on an extrapolation derived from the Lagrange interpolation of past solutions. Since this extrapolation can be computed without Hessian matrices or even gradients, the computational cost is low. To ensure the stability of the prediction, the algorithm includes an acceptance condition that rejects the prediction when the update is excessively large. The proposed method achieves a tracking error of $O(h^{p})$, where $h$ is the sampling period, assuming that the $p$-th derivative of the target trajectory is bounded and the convergence of the correction step is locally linear. We also prove that the method can track a trajectory of stationary points even if the objective function is non-convex. Numerical experiments demonstrate the high accuracy of the proposed algorithm.

math.OC↗