SearcharxivSearch

arXiv subjects

Luze Xu

Publications and source records attributed to Luze Xu.

At least 19 recordsLinked to original sources

The column number for 3-modular matrices

An integer-valued matrix $\mathbf{A}$ is $\Delta$-modular if each $\text{rank}(\mathbf{A}) \times \text{rank}(\mathbf{A})$ submatrix has determinant at most $\Delta$ in absolute value. The column number problem is to determine the maximum number of pairwise non-parallel columns of a rank-$r$, $\Delta$-modular matrix. Exact values for the column number are only known for $r \le 2$ or $\Delta \le 2$. We prove that if $r$ is sufficiently large, then the maximum number of pairwise non-parallel columns of a rank-$r$, $3$-modular matrix is $\binom{r+1}{2} + 2(r-1)$. This settles a conjecture by Lee, Paat, Stallknecht, and Xu on the column number in the case $\Delta = 3$. We complement this main result by showing that there are at least three $3$-modular matrices with pairwise non-isomorphic vector matroids that attain this upper bound. More generally, we show that if $r > \Delta$, then the number of $\Delta$-modular matrices with $\binom{r+1}{2} + (\Delta-1)(r-1)$ pairwise non-parallel columns and pairwise non-isomorphic vector matroids is at least exponential in $\sqrt{\Delta}$; previously only one matrix was known due to Lee et al.

math.CO

Semigroups of Integer Points in Convex Cones

We study the question whether the affine semigroup of integer points in a convex cone can be finitely generated up to symmetries of the cone. We establish general properties of finite generation up to symmetry, and then concentrate on the case of irrational polyhedral cones.

math.NT

Improved Mixing and Pressure Loss Formulations for Gas Network Optimization

Non-convex, nonlinear gas network optimization models are used to determine the feasibility of flows on existing networks given constraints on network flows, gas mixing, and pressure loss along pipes. This work improves two existing gas network models: a discrete mixed-integer nonlinear program (MINLP) that uses binary variables to model positive and negative flows, and a continuous nonlinear program (NLP) that implements complementarity constraints with continuous variables. We introduce cuts to expedite the MINLP and we formulate two new pressure loss models that leverage the flow-splitting variables: one that is highly accurate and another that is simpler but less accurate. In computational tests using the global solver BARON our cuts and accurate pressure loss improves: (1) the average run time of the MINLP by a factor of 35, (2) the stability of the MINLP by solving every tested instance within 2.5 minutes (the baseline model timed out on 25% of instances), (3) the stability of the NLP by solving more instances than the baseline. Our simpler pressure loss model further improved run times in the MINLP (by a factor of 48 versus the baseline MINLP), but was unstable in the context of the NLP.

math.OC

Equivariant Perturbation in Gomory and Johnson's Infinite Group Problem. IV. The General Unimodular Two-Dimensional Case

We study an abstract setting for cutting planes for integer programming called the infinite group problem. In this abstraction, cutting planes are computed via cut generating function that act on the simplex tableau. In this function space, cut generating functions are classified as minimal, extreme, and facets as a proxy for understanding the strength or potential importance of these functions. Prior work developed algorithms for testing minimality, extremality, and facetness for cut generating functions applied to 1-row tableau and to some 2-row tableau in a restricted setting. We complement and generalize this work by giving an algorithm for testing the extremality of a large class of minimal valid functions for the two-dimensional infinite group problem. Along the way, we develop results of independent interest on functional equations and infinite systems of linear equations.

math.OC

ADMM for 0/1 D-optimality and Maximum-Entropy Sampling Relaxations

The 0/1 D-optimality problem and the Maximum-Entropy Sampling problem are two well-known NP-hard discrete maximization problems in experimental design. Algorithms for exact optimization (of moderate-sized instances) are based on branch-and-bound. The best upper-bounding methods are based on convex relaxation. We present ADMM (Alternating Direction Method of Multipliers) algorithms for solving these relaxations and experimentally demonstrate their practical value.

math.OC

Gaining or losing perspective for convex multivariate functions on box domains

MINLO (mixed-integer nonlinear optimization) formulations of the disjunction between the origin and a polytope via a binary indicator variable is broadly used in nonlinear combinatorial optimization for modeling a fixed cost associated with carrying out a group of activities and a convex cost function associated with the levels of the activities. The perspective relaxation of such models is often used to solve to global optimality in a branch-and-bound context, but it typically requires suitable conic solvers and is not compatible with general-purpose NLP software in the presence of other classes of constraints. This motivates the investigation of when simpler but weaker relaxations may be adequate. Comparing the volume (i.e., Lebesgue measure) of the relaxations as a measure of tightness, we lift some of the results related to the simplex case to the box case. In order to compare the volumes of different relaxations in the box case, it is necessary to find an appropriate concave upper bound that preserves the convexity and is minimal, which is more difficult than in the simplex case. To address the challenge beyond the simplex case, the triangulation approach is used.

math.OC

Integer Points in Arbitrary Convex Cones: The Case of the PSD and SOC Cones

We investigate the semigroup of integer points inside a convex cone. We extend classical results in integer linear programming to integer conic programming. We show that the semigroup associated with nonpolyhedral cones can sometimes have a notion of finite generating set. We show this is true for the cone of positive semidefinite matrices (PSD) and the second-order cone (SOC). Both cones have a finite generating set of integer points, similar in spirit to Hilbert bases, under the action of a finitely generated group. We also extend notions of total dual integrality, Gomory-Chv\'{a}tal closure, and Carath\'{e}odory rank to integer points in arbitrary cones.

math.OC

Good and Fast Row-Sparse ah-Symmetric Reflexive Generalized Inverses

We present several algorithms aimed at constructing sparse and structured sparse (row-sparse) generalized inverses, with application to the efficient computation of least-squares solutions, for inconsistent systems of linear equations, in the setting of multiple right-hand sides and a rank-deficient constraint matrix. Leveraging our earlier formulations to minimize the 1- and 2,1- norms of generalized inverses that satisfy important properties of the Moore-Penrose pseudoinverse, we develop efficient and scalable ADMM algorithms to address these norm-minimization problems and to limit the number of nonzero rows in the solution. We establish a 2,1-norm approximation result for a local-search procedure that was originally designed for 1-norm minimization, and we compare the ADMM algorithms with the local-search procedure and with general-purpose optimization solvers.

math.OC

Extended formulations for the integer hull of strictly $\Delta$-modular cographic polyhedral cones

Conforti et al. give a compact extended formulation for a class of bimodular-constrained integer programs, namely those that model the stable set polytope of a graph with no disjoint odd cycles. We extend their techniques to design compact extended formulations for the integer hull of translated polyhedral cones whose constraint matrix is strictly $\Delta$-modular and has rows that represent a cographic matroid. Our work generalizes the important special case from Conforti et al. concerning $4$-connected graphs with odd cycle transversal number at least $4$. We also discuss the necessity of our assumptions.

math.OC

On computing sparse generalized inverses

The well-known M-P (Moore-Penrose) pseudoinverse is used in several linear-algebra applications; for example, to compute least-squares solutions of inconsistent systems of linear equations. It is uniquely characterized by four properties, but not all of them need to be satisfied for some applications. For computational reasons, it is convenient then, to construct sparse block-structured matrices satisfying relevant properties of the M-P pseudoinverse for specific applications. (Vector) 1-norm minimization has been used to induce sparsity in this context. Aiming at row-sparse generalized inverses motivated by the least-squares application, we consider 2,1-norm minimization (and generalizations). In particular, we show that a 2,1-norm minimizing generalized inverse satisfies two additional M-P pseudoinverse properties, including the one needed for computing least-squares solutions. We present mathematical-optimization formulations related to finding row-sparse generalized inverses that can be solved very efficiently, and compare their solutions numerically to generalized inverses constructed by other methodologies, also aiming at sparsity and row-sparse structure.

math.OC

Gaining or Losing Perspective for Convex Multivariate Functions on a Simplex

MINLO (mixed-integer nonlinear optimization) formulations of the disjunction between the origin and a polytope via a binary indicator variable have broad applicability in nonlinear combinatorial optimization, for modeling a fixed cost $c$ associated with carrying out a set of $d$ activities and a convex variable cost function $f$ associated with the levels of the activities. The perspective relaxation is often used to solve such models to optimality in a branch-and-bound context, especially in the context in which $f$ is univariate (e.g., in Markowitz-style portfolio optimization). But such a relaxation typically requires conic solvers and are typically not compatible with general-purpose NLP software which can accommodate additional classes of constraints. This motivates the study of weaker relaxations to investigate when simpler relaxations may be adequate. Comparing the volume (i.e., Lebesgue measure) of the relaxations as means of comparing them, we lift some of the results related to univariate functions $f$ to the multivariate case. Along the way, we survey, connect and extend relevant results on integration over a simplex, some of which we concretely employ, and others of which can be used for further exploration on our main subject.

math.OC

On the column number and forbidden submatrices for $Δ$-modular matrices

An integer matrix $\mathbf{A}$ is $Δ$-modular if the determinant of each $\text{rank}(\mathbf{A}) \times \text{rank}(\mathbf{A})$ submatrix of $\mathbf{A}$ has absolute value at most $Δ$. The study of $Δ$-modular matrices appears in the theory of integer programming, where an open conjecture is whether integer programs defined by $Δ$-modular constraint matrices can be solved in polynomial time if $Δ$ is considered constant. The conjecture is only known to hold true when $Δ\in \{1,2\}$. In light of this conjecture, a natural question is to understand structural properties of $Δ$-modular matrices. We consider the column number question -- how many nonzero, pairwise non-parallel columns can a rank-$r$ $Δ$-modular matrix have? We prove that for each positive integer $Δ$ and sufficiently large integer $r$, every rank-$r$ $Δ$-modular matrix has at most $\binom{r+1}{2} + 80Δ^7 \cdot r$ nonzero, pairwise non-parallel columns, which is tight up to the term $80Δ^7$. This is the first upper bound of the form $\binom{r+1}{2} + f(Δ)\cdot r$ with $f$ a polynomial function. Underlying our results is a partial list of matrices that cannot exist in a $Δ$-modular matrix. We believe this partial list may be of independent interest in future studies of $Δ$-modular matrices.

math.OC

Polynomial upper bounds on the number of differing columns of $Δ$-modular integer programs

We study integer-valued matrices with bounded determinants. Such matrices appear in the theory of integer programs (IP) with bounded determinants. For example, Artmann et al. showed that an IP can be solved in strongly polynomial time if the constraint matrix is bimodular, that is, the determinants are bounded in absolute value by two. Determinants are also used to bound the $\ell_1$-distance between IP solutions and solutions of its linear relaxation. One of the first works to quantify the complexity of IPs with bounded determinants was that of Heller, who identified the maximum number of differing columns in a totally unimodular matrix. Each extension of Heller's bound to general determinants has been super-polynomial in the determinants or the number of equations. We provide the first column bound that is polynomial in both values. For integer programs with box constraints, our result gives the first $\ell_1$-distance bound that is polynomial in the determinants and the number of equations. Our result can also be used to derive a bound on the height of Graver basis elements that is polynomial in the determinants and the number of equations. Furthermore, we show a tight bound on the number of differing columns in a bimodular matrix; this is the first tight bound since Heller. Our analysis reveals combinatorial properties of bimodular IPs that may be of independent interest.

math.OC

Experimental analysis of local searches for sparse reflexive generalized inverses

The well-known M-P (Moore-Penrose) pseudoinverse is used in several linear-algebra applications; for example, to compute least-squares solutions of inconsistent systems of linear equations. Irrespective of whether a given matrix is sparse, its M-P pseudoinverse can be completely dense, potentially leading to high computational burden and numerical difficulties, especially when we are dealing with high-dimensional matrices. The M-P pseudoinverse is uniquely characterized by four properties, but not all of them need to be satisfied for some applications. In this context, Fampa and Lee (Oper. Res. Letters, 46:605--610, 2018) and Xu, Fampa, Lee and Ponte (SIAM J. on Optimization, to appear) propose local-search procedures to construct sparse block-structured generalized inverses that satisfy only some of the M-P properties. (Vector) 1-norm minimization is used to induce sparsity and to keep the magnitude of the entries under control, and theoretical results limit the distance between the 1-norm of the solution of the local searches and the minimum 1-norm of generalized inverses with corresponding properties. We have implemented several local-search procedures based on results presented in these two papers and make here an experimental analysis of them, considering their application to randomly generated matrices of varied dimensions, ranks, and densities. Further, we carried out a case study on a real-world data set.

math.OC

Approximate 1-norm minimization and minimum-rank structured sparsity for various generalized inverses via local search

Fundamental in matrix algebra and its applications, a \emph{generalized inverse} of a real matrix $A$ is a matrix $H$ that satisfies the Moore-Penrose (M-P) property $AHA=A$. If $H$ also satisfies the additional useful M-P property, $HAH=H$, it is called a \emph{reflexive generalized inverse}. Reflexivity is equivalent to minimum rank, so we are particularly interested in reflexive generalized inverses. We consider aspects of symmetry related to the calculation of a \emph{sparse} reflexive generalized inverse of $A$. As is common, and following Lee and Fampa (2018) for calculating sparse generalized inverses, we use (vector) 1-norm minimization for inducing sparsity and for keeping the magnitude of entries under control. When $A$ is symmetric, we may naturally desire a symmetric $H$; while generally such a restriction on $H$ may not lead to a 1-norm minimizing reflexive generalized inverse. We investigate a block construction method to produce a symmetric reflexive generalized inverse that is structured and has guaranteed sparsity. We provide a theoretically-efficient and practical local-search algorithm to block-construct an approximate 1-norm minimizing symmetric reflexive generalized inverse. Another aspect of symmetry that we consider relates to another M-P property: $H$ is \emph{ah-symmetric} if $AH$ is symmetric. The ah-symmetry property is the key one for solving least-squares problems using $H$. Here we do not assume that $A$ is symmetric, and we do not impose symmetry on $H$. We investigate a column block construction method to produce an ah-symmetric reflexive generalized inverse that is structured and has guaranteed sparsity. We provide a theoretically-efficient and practical local-search algorithm to column block construct an approximate 1-norm minimizing ah-symmetric reflexive generalized inverse.

math.OC

1-norm minimization and minimum-rank structured sparsity for symmetric and ah-symmetric generalized inverses: rank one and two

Generalized inverses are important in statistics and other areas of applied matrix algebra. A \emph{generalized inverse} of a real matrix $A$ is a matrix $H$ that satisfies the Moore-Penrose (M-P) property $AHA=A$. If $H$ also satisfies the M-P property $HAH=H$, then it is called \emph{reflexive}. Reflexivity of a generalized inverse is equivalent to minimum rank, a highly desirable property. We consider aspects of symmetry related to the calculation of various \emph{sparse} reflexive generalized inverses of $A$. As is common, we use (vector) 1-norm minimization for both inducing sparsity and for keeping the magnitude of entries under control. When $A$ is symmetric, a symmetric $H$ is highly desirable, but generally such a restriction on $H$ will not lead to a 1-norm minimizing reflexive generalized inverse. We investigate a block construction method to produce a symmetric reflexive generalized inverse that is structured and has guaranteed sparsity. Letting the rank of $A$ be $r$, we establish that the 1-norm minimizing generalized inverse of this type is a 1-norm minimizing symmetric generalized inverse when (i) $r=1$ and when (ii) $r=2$ and $A$ is nonnegative. Another aspect of symmetry that we consider relates to another M-P property: $H$ is \emph{ah-symmetric} if $AH$ is symmetric. The ah-symmetry property is sufficient for a generalized inverse to be used to solve the least-squares problem $\min\{\|Ax-b\|_2:~x\in\mathbb{R}^n\}$ using $H$, via $x:=Hb$. We investigate a column block construction method to produce an ah-symmetric reflexive generalized inverse that is structured and has guaranteed sparsity. We establish that the 1-norm minimizing ah-symmetric generalized inverse of this type is a 1-norm minimizing ah-symmetric generalized inverse when (i) $r=1$ and when (ii) $r=2$ and $A$ satisfies a technical condition.

math.OC

Improving proximity bounds using sparsity

We refer to the distance between optimal solutions of integer programs and their linear relaxations as proximity. In 2018, Eisenbrand and Weismantel proved that proximity is independent of the dimension for programs in standard form. We improve their bounds using existing and novel results on the sparsity of integer solutions. We first bound proximity in terms of the largest absolute value of any full-dimensional minor in the constraint matrix, and this bound is tight up to a polynomial factor in the number of constraints. We also give an improved bound in terms of the largest absolute entry in the constraint matrix, after efficiently transforming the program into an equivalent one. Our results are stated in terms of general sparsity bounds, so any new results on sparse solutions immediately improves our work. Generalizations to mixed integer programs are also discussed.

math.OC