SearcharxivSearch

arXiv subjects

Javier F. Pena

Publications and source records attributed to Javier F. Pena.

5 recordsLinked to original sources

Duality of Hoffman constants

We show that a suitable Slater condition implies a duality inequality between the Hoffman constants of the following feasibility problems: $$ \begin{array}{r} Ax-b \in S\\ x \in R \end{array} \qquad\text{ and }\qquad \begin{array}{r} c-A^T y \in R^*\\ y \in S^*. \end{array} $$ where $A\in \mathbb{R}^{m\times n}$, and $R\subseteq \mathbb{R}^n$ and $S\subseteq \mathbb{R}^m$ are reference polyhedral cones, with respective dual cones $R^*\subseteq \mathbb{R}^n$ and $S^*\subseteq \mathbb{R}^m$. Our approach relies on an exact characterization of Hoffman constants and introduces a novel Hoffman duality inequality for polyhedral set-valued mappings. These two fundamental results also yield a striking identity between the Hoffman constants of box-constrained feasibility problems, which feature a similar primal-dual structure with a box and a linear subspace as reference sets. Additionally, we establish a surprising identity between the Hoffman constants of box-constrained feasibility problems and the chi condition measures for weighted least-squares problems

math.OC

Equivalence and invariance of the chi and Hoffman constants of a matrix

We show that the following two condition measures of a full column rank matrix $A \in \mathbb{R}^{m\times n}$ are identical: the chi constant and a signed Hoffman constant. This identity is naturally suggested by the evident invariance of the chi constant under sign changes of the rows of $A$. We also show that similar equivalence and invariance properties extend to variants of the chi and Hoffman constants that depend only on the linear subspace $A(\mathbb{R}^n):=\{Ax: x\in\mathbb{R}^n\} \subseteq \mathbb{R}^m$. Finally, we show similar identities between the chi constants and signed versions of Renegar's and Grassmannian condition measures.

math.OC

The condition number of a function relative to a set

The condition number of a differentiable convex function, namely the ratio of its smoothness to strong convexity constants, is closely tied to fundamental properties of the function. In particular, the condition number of a quadratic convex function is the square of the aspect ratio of a canonical ellipsoid associated to the function. Furthermore, the condition number of a function bounds the linear rate of convergence of the gradient descent algorithm for unconstrained convex minimization. We propose a condition number of a differentiable convex function relative to a reference convex set and distance function pair. This relative condition number is defined as the ratio of a relative smoothness to a relative strong convexity constants. We show that the relative condition number extends the main properties of the traditional condition number both in terms of its geometric insight and in terms of its role in characterizing the linear convergence of first-order methods for constrained convex minimization. When the reference set $X$ is a convex cone or a polyhedron and the function $f$ is of the form $f = g\circ A$, we provide characterizations of and bounds on the condition number of $f$ relative to $X$ in terms of the usual condition number of $g$ and a suitable condition number of the pair $(A,X)$.

math.OC

The condition of a function relative to a polytope

The condition number of a smooth convex function, namely the ratio of its smoothness to strong convexity constants, is closely tied to fundamental properties of the function. In particular, the condition number of a quadratic convex function is precisely the square of the diameter-to-width ratio of a canonical ellipsoid associated to the function. Furthermore, the condition number of a function bounds the linear rate of convergence of the gradient descent algorithm for unconstrained minimization. We propose a condition number of a smooth convex function relative to a reference polytope. This relative condition number is defined as the ratio of a relative smooth constant to a relative strong convexity constant of the function, where both constants are relative to the reference polytope. The relative condition number extends the main properties of the traditional condition number. In particular, we show that the condition number of a quadratic convex function relative to a polytope is precisely the square of the diameter-to-facial-distance ratio of a scaled polytope for a canonical scaling induced by the function. Furthermore, we illustrate how the relative condition number of a function bounds the linear rate of convergence of first-order methods for minimization of the function over the polytope.

math.OC

Convergence rates of proximal gradient methods via the convex conjugate

We give a novel proof of the $O(1/k)$ and $O(1/k^2)$ convergence rates of the proximal gradient and accelerated proximal gradient methods for composite convex minimization. The crux of the new proof is an upper bound constructed via the convex conjugate of the objective function.

math.OC