Searcharxiv⌕ Search

arXiv subjects

Jieling Shi

Publications and source records attributed to Jieling Shi.

2 recordsLinked to original sources

Distributionally Robust Optimization over Incomparable Spaces

Distributionally robust optimization (DRO) provides a principled framework for making decisions under uncertainty when the underlying distribution may be incorrectly specified. A widely used approach builds on ideas from optimal transport (OT) as a means of measuring differences between distributions. However, this depends on these distributions residing in the same space. In certain settings, the reference data distribution we have and the space on which we make our decision may be different, which renders classical OT techniques impossible. In this paper, we provide a new DRO formulation in which ambiguity sets are defined through the Gromov-Wasserstein distance, which is an extension of OT to pairs of distributions residing in incomparable spaces. We show that several seemingly unrelated optimization formulations, including conditional value-at-risk minimization, group distributionally robust optimization, robust graph $k$-median, and $k$-median with outliers, can be recovered as special cases of our formulation. We describe the computational aspects of solving the proposed formulation based on the doubly-nonnegative relaxation. Last, we illustrate the framework through experiments on clustering over incomparable spaces and stochastic graph $k$-median.

math.OC↗

Gradient flow for finding E-optimal designs

The $E$-optimality criterion for a regression model maximizes the smallest eigenvalue of the information matrix and becomes non-differentiable when this eigenvalue has multiplicity greater than one. Working in the $2$-Wasserstein space, we show that the Wasserstein gradient at an empirical measure coincides, up to a constant factor, with the Euclidean particle gradient for smooth criteria such as $D$- and $L$-optimality, and that the approximation gap for equal-weight $N$-particle designs vanishes at an explicit rate. The main challenge is the nonsmooth $E$-criterion, for which the Wasserstein gradient does not exist. We replace it with a constrained Wasserstein steepest-ascent field obtained by maximizing feasible directional derivatives over the tangent cone of the design space, and prove that the resulting flow satisfies an exact energy identity and that every limit point is first-order stationary. The particle ascent computation reduces to a convex semidefinite programme whose dimension equals the multiplicity of the smallest eigenvalue. In numerical comparisons on second-order response surface models and a seven-dimensional logistic regression model, the constrained Wasserstein steepest-ascent method attains near-optimal $E$-criterion values and is markedly more reliable than particle swarm optimization in higher-dimensional settings. The framework applies more broadly to other nonsmooth minimax criteria in optimal design, and a numerical experiment on the minimax-single-parameter criterion confirms that the method attains the theoretical optimum.

math.OC↗