SearcharxivSearch

arXiv subjects

Lianghai Xiao

Publications and source records attributed to Lianghai Xiao.

8 recordsLinked to original sources

A Safeguarded Projected-Gradient Framework for Complementarity Constrained Least Squares Problems

Both generalized absolute value equations (GAVEs) and linear complementarity problems (LCPs) can be formulated as least-squares problems over the complementarity set. Because this feasible set is nonconvex, projected stationarity does not in general imply zero residual. We develop a safeguarded projected-gradient framework with a linear-system refinement on a selected polyhedral face. We establish matrix conditions under which every projected stationary point is a global solution and derive corresponding global convergence results. Specifically, when refinement on a correct active face returns a solution, we give explicit iteration bounds for active-face identification and prove finite termination. Numerical experiments on GAVE and LCP benchmarks demonstrate the high accuracy of the proposed framework across the tested settings.

math.OC

A Relaxation Method for Nonsmooth Nonlinear Optimization with Binary Constraints

We study binary optimization problems of the form \( \min_{x\in\{-1,1\}^n} f(Ax-b) \) with possibly nonsmooth loss \(f\). Following the lifted rank-one semidefinite programming (SDP) approach\cite{qian2023matrix}, we develop a majorization-minimization algorithm by using the difference-of-convexity (DC) reformuation for the rank-one constraint and the Moreau envelop for the nonsmooth loss. We provide global complexity guarantees for the proposed \textbf{D}ifference of \textbf{C}onvex \textbf{R}elaxation \textbf{A}lgorithm (DCRA) and show that it produces an approximately feasible binary solution with an explicit bound on the optimality gap. Numerical experiments on synthetic and real datasets confirm that our method achieves superior accuracy and scalability compared with existing approaches.

math.OC

Error bound and exact penalty method for optimization problems with nonnegative orthogonal constraint

This paper is concerned with a class of optimization problems with the nonnegative orthogonal constraint, in which the objective function is $L$-smooth on an open set containing the Stiefel manifold ${\rm St}(n,r)$. We derive a locally Lipschitzian error bound for the feasible points without zero rows when $n>r>1$, and when $n>r=1$ or $n=r$ achieve a global Lipschitzian error bound. Then, we show that the penalty problem induced by the elementwise $\ell_1$-norm distance to the nonnegative cone is a global exact penalty, and so is the one induced by its Moreau envelope under a lower second-order calmness of the objective function. A practical penalty algorithm is developed by solving approximately a series of smooth penalty problems with a retraction-based nonmonotone line-search proximal gradient method, and any cluster point of the generated sequence is shown to be a stationary point of the original problem. Numerical comparisons with the ALM \citep{Wen13} and the exact penalty method \citep{JiangM22} indicate that our penalty method has an advantage in terms of the quality of solutions despite taking a little more time.

math.OC

A relaxation method for binary optimizations on constrained Stiefel manifold

This paper focuses on a class of binary orthogonal optimization problems frequently arising in semantic hashing. Consider that this class of problems may have an empty feasible set, rendering them not well-defined. We introduce an equivalent model involving a restricted Stiefel manifold and a matrix box set, and then investigate its penalty problems induced by the $\ell_1$-distance from the box set and its Moreau envelope. The two penalty problems are always well-defined. Moreover, they serve as the global exact penalties provided that the original feasible set is non-empty. Notably, the penalty problem induced by the Moreau envelope is a smooth optimization over an embedded submanifold with a favorable structure. We develop a retraction-based line-search Riemannian gradient method to address the penalty problem. Finally, the proposed method is applied to supervised and unsupervised hashing tasks and is compared with several popular methods on the MNIST and CIFAR-10 datasets. The numerical comparisons reveal that our algorithm is significantly superior to other solvers in terms of feasibility violation, and it is comparable even superior to others in terms of evaluation metrics related to the Hamming distance.

math.OC

A Profit-Maximizing Strategy for Advertising on the e-Commerce Platforms

The online advertising management platform has become increasingly popular among e-commerce vendors/advertisers, offering a streamlined approach to reach target customers. Despite its advantages, configuring advertising strategies correctly remains a challenge for online vendors, particularly those with limited resources. Ineffective strategies often result in a surge of unproductive ``just looking'' clicks, leading to disproportionately high advertising expenses comparing to the growth of sales. In this paper, we present a novel profit-maximing strategy for targeting options of online advertising. The proposed model aims to find the optimal set of features to maximize the probability of converting targeted audiences into actual buyers. We address the optimization challenge by reformulating it as a multiple-choice knapsack problem (MCKP). We conduct an empirical study featuring real-world data from Tmall to show that our proposed method can effectively optimize the advertising strategy with budgetary constraints.

cs.IR

Complementarity and Related Problems

In this thesis, we present results related to complementarity problems. We study the linear complementarity problems on extended second order cones. We convert a linear complementarity problem on an extended second order cone into a mixed complementarity problem on the non-negative orthant. We present algorithms for this problem, and exemplify it by a numerical example. Following this result, we explore the stochastic version of this linear complementarity problem. Finally, we apply complementarity problems on extended second order cones in a portfolio optimisation problem. In this application, we exploit our theoretical results to find an analytical solution to a new portfolio optimisation model. We also study the spherical quasi-convexity of quadratic functions on spherically self-dual convex sets. We start this study by exploring the characterisations and conditions for the spherical positive orthant. We present several conditions characterising the spherical quasi-convexity of quadratic functions. Then we generalise the conditions to the spherical quasi-convexity on spherically self-dual convex sets. In particular, we highlight the case of spherical second order cones.

math.OC

Stochastic Linear Complementarity Problems on Extended Second Order Cones

In this paper, we study the stochastic linear complementarity problems on extended second order cones (stochastic ESOCLCP). We first convert the problem to a stochastic mixed complementarity problem on the nonegative orthant (SMixCP). Enlightened by the idea of Chen and Lin(2011), we introduce the Conditional Value-at-risk (CVaR) method to measure the loss of complementarity in the stochastic case. A CVaR - based minimisation problem is introduced to achieve a solution which is "good enough" for the complementarity requirement of the original SMixCP. Smoothing function and sample average approximation methods are introduced and the the problem is converted to a form which can be solved by Levenberg-Marquardt smoothing SAA algorithm. At the end of the paper a numerical example illustrates our results.

math.OC