Searcharxiv⌕ Search

arXiv subjects

Anton J. Kleywegt

Publications and source records attributed to Anton J. Kleywegt.

10 recordsLinked to original sources

Optimal Spectral Design with Prior Information

We study a class of spectral design problems in which a prior positive semidefinite information matrix is updated by a sum of rank-one matrices constructed from chosen design vectors subject to a bound on their Euclidean norm. The objective of a spectral design problem is any symmetric convex function of the eigenvalues of the updated information matrix. This framework unifies classical optimal experimental design criteria, including A-, D-, and E-optimality. It also arises in model-based derivative-free optimization, where sampling directions determine the conditioning and accuracy of regression models. Although the objective is symmetric and convex in the eigenvalues, the optimization problem with design vectors/matrix as decision variables is nonconvex, and optimal solutions of their convex relaxations may not be feasible for the spectral design problem. We use tight eigenvalue relaxations to obtain a convex reformulation, and we apply the Schur--Horn theorem to construct a simple polynomial-time algorithm for solving the spectral design problem. We illustrate the optimal spectral designs computed by our algorithm. Moreover, a small set of numerical experiments shows the potential of spectral designs for derivative-free optimization.

math.OC↗

New Heuristics for the Operation of an Ambulance Fleet under Uncertainty

The operation of an ambulance fleet involves ambulance selection decisions about which ambulance to dispatch to each emergency, and ambulance reassignment decisions about what each ambulance should do after it has finished the service associated with an emergency. For ambulance selection decisions, we propose four new heuristics: the Best Myopic (BM) heuristic, a NonMyopic (NM) heuristic, and two greedy heuristics (GHP1 and GHP2). Two variants of the greedy heuristics are also considered. We also propose an optimization problem for an extension of the BM heuristic, useful when a call for several patients arrives. For ambulance reassignment decisions, we propose several strategies to choose which emergency in queue to send an ambulance to or which ambulance station to send an ambulance to when it finishes service. These heuristics are also used in a rollout approach: each time a new decision has to be made (when a call arrives or when an ambulance finishes service), a two-stage stochastic program is solved. The proposed heuristics are used to efficiently compute the second stage cost of these problems. We apply the rollout approach with our heuristics to data of the Emergency Medical Service (EMS) of a large city, and show that these methods outperform other heuristics that have been proposed for ambulance dispatch decisions. We also show that better response times can be obtained using the rollout approach instead of using the heuristics without rollout. Moreover, each decision is computed in a few seconds, which allows these methods to be used for the real-time management of a fleet of ambulances.

math.OC↗

LASPATED: A Library for the Analysis of Spatio-Temporal Discrete Data (User Manual)

This is the User Manual of the LASPATED library. This library is available on GitHub (at https://github.com/vguigues/LASPATED)) and provides a set of tools to analyze spatiotemporal data. A video tutorial for this library is available on Youtube. It is made of a Python package for time and space discretizations and of two packages (one in Matlab and one in C++) implementing the calibration of the probabilistic models for stochastic spatio-temporal data proposed in the companion paper arXiv:2203.16371v2.

stat.CO↗

Distributionally Robust Stochastic Optimization with Wasserstein Distance

Distributionally robust stochastic optimization (DRSO) is an approach to optimization under uncertainty in which, instead of assuming that there is a known true underlying probability distribution, one hedges against a chosen set of distributions. In this paper we first point out that the set of distributions should be chosen to be appropriate for the application at hand, and that some of the choices that have been popular until recently are, for many applications, not good choices. We next consider sets of distributions that are within a chosen Wasserstein distance from a nominal distribution. Such a choice of sets has two advantages: (1) The resulting distributions hedged against are more reasonable than those resulting from other popular choices of sets. (2) The problem of determining the worst-case expectation over the resulting set of distributions has desirable tractability properties. We derive a strong duality reformulation of the corresponding DRSO problem and construct approximate worst-case distributions explicitly via the first-order optimality conditions of the dual problem. Our contributions are four-fold. (i) We identify necessary and sufficient conditions for the existence of a worst-case distribution, which are naturally related to the growth rate of the objective function. (ii) We show that the worst-case distributions resulting from an appropriate Wasserstein distance have a concise structure and a clear interpretation. (iii) Using this structure, we show that data-driven DRSO problems can be approximated to any accuracy by robust optimization problems, and thereby many DRSO problems become tractable by using tools from robust optimization. (iv) Our strong duality result holds in a very general setting. As examples, we show that it can be applied to infinite-dimensional process control and intensity estimation for point processes.

math.OC↗

Revenue Management Under the Markov Chain Choice Model with Joint Price and Assortment Decisions

Finding the optimal product prices and product assortment are two fundamental problems in revenue management. Usually, a seller needs to jointly determine the prices and assortment while managing a network of resources with limited capacity. However, there is not yet a tractable method to efficiently solve such a problem. Existing papers studying static joint optimization of price and assortment cannot incorporate resource constraints. Then we study the revenue management problem with resource constraints and price bounds, where the prices and the product assortments need to be jointly determined over time. We showed that under the Markov chain (MC) choice model (which subsumes the multinomial logit (MNL) model), we could reformulate the choice-based joint optimization problem as a tractable convex conic optimization problem. We also proved that an optimal solution with a constant price vector exists even with constraints on resources. In addition, a solution with both constant assortment and price vector can be optimal when there is no resource constraint.

math.OC↗

Tractable Profit Maximization over Multiple Attributes under Discrete Choice Models

A fundamental problem in revenue management is to optimally choose the attributes of products, such that the total profit or revenue or market share is maximized. Usually, these attributes can affect both a product's market share (probability to be chosen) and its profit margin. For example, if a smart phone has a better battery, then it is more costly to be produced, but is more likely to be purchased by a customer. The decision maker then needs to choose an optimal vector of attributes for each product that balances this trade-off. In spite of the importance of such problems, there is not yet a method to solve it efficiently in general. Past literature in revenue management and discrete choice models focus on pricing problems, where price is the only attribute to be chosen for each product. Existing approaches to solve pricing problems tractably cannot be generalized to the optimization problem with multiple product attributes as decision variables. On the other hand, papers studying product line design with multiple attributes all result in intractable optimization problems. Then we found a way to reformulate the static multi-attribute optimization problem, as well as the multi-stage fluid optimization problem with both resource constraints and upper and lower bounds of attributes, as a tractable convex conic optimization problem. Our result applies to optimization problems under the multinomial logit (MNL) model, the Markov chain (MC) choice model, and with certain conditions, the nested logit (NL) model.

math.OC↗

Optimizing Pricing, Repositioning, En-Route Time, and Idle Time in Ride-Hailing Systems

In ride-hailing systems, en-route time refers to the time that elapses from the moment a car is dispatched to pick up a rider until the rider is picked up. A fundamental phenomenon in ride-hailing systems is that there is a trade-off between en-route time and the time that a car waits for a dispatch. In short, if cars spend little time idle waiting for a dispatch, then few cars are available when a rider makes a request, and thus the mean distance between a rider and the closest available car is long, which means that en-route time is long. This phenomenon is of great importance in ride-hailing, because en-route time increases rapidly as the number of idle cars decreases, and every minute that a car spends en-route is one minute less that the car can transport riders. In spite of this, the existing literature on price optimization for ride-hailing, and on repositioning optimization for ride-hailing, ignores en-route time. Initial attempts to take this trade-off for the mean en-route time into account when considering price optimization or repositioning optimization all resulted in intractable optimization problems. Then we found a way to reformulate a simultaneous price and repositioning optimization problem, that takes this trade-off for the distribution of en-route time into account, as a tractable convex optimization problem. We show how the optimal solution can be used to construct policies that perform much better in simulations than the policies proposed in previous papers.

math.OC↗

Wasserstein Distributionally Robust Optimization and Variation Regularization

Wasserstein distributionally robust optimization (DRO) has recently achieved empirical success for various applications in operations research and machine learning, owing partly to its regularization effect. Although connection between Wasserstein DRO and regularization has been established in several settings, existing results often require restrictive assumptions, such as smoothness or convexity, that are not satisfied for many problems. In this paper, we develop a general theory on the variation regularization effect of the Wasserstein DRO - a new form of regularization that generalizes total-variation regularization, Lipschitz regularization and gradient regularization. Our results cover possibly non-convex and non-smooth losses and losses on non-Euclidean spaces. Examples include multi-item newsvendor, portfolio selection, linear prediction, neural networks, manifold learning, and intensity estimation for Poisson processes, etc. As an application of our theory of variation regularization, we derive new generalization guarantees for adversarial robust learning.

cs.LG↗

Joint Estimation of Discrete Choice Model and Arrival Rate with Unobserved Stock-out Events

This paper studies the joint estimation problem of a discrete choice model and the arrival rate of potential customers when unobserved stock-out events occur. In this paper, we generalize [Anupindi et al., 1998] and [Conlon and Mortimer, 2013] in the sense that (1) we work with generic choice models, (2) we allow arbitrary numbers of products and stock-out events, and (3) we consider the existence of the null alternative, and estimates the overall arrival rate of potential customers. In addition, we point out that the modeling in [Conlon and Mortimer, 2013] is problematic, and present the correct formulation.

math.OC↗

Distributionally Robust Stochastic Optimization with Dependence Structure

Distributionally robust stochastic optimization (DRSO) is a framework for decision-making problems under certainty, which finds solutions that perform well for a chosen set of probability distributions. Many different approaches for specifying a set of distributions have been proposed. The choice matters, because it affects the results, and the relative performance of different choices depend on the characteristics of the problems. In this paper, we consider problems in which different random variables exhibit some form of dependence, but the exact values of the parameters that represent the dependence are not known. We consider various sets of distributions that incorporate the dependence structure, and we study the corresponding DRSO problems. In the first part of the paper, we consider problems with linear dependence between random variables. We consider sets of distributions that are within a specified Wasserstein distance of a nominal distribution, and that satisfy a second-order moment constraint. We obtain a tractable dual reformulation of the corresponding DRSO problem. This approach is compared with the traditional moment-based DRSO and Wasserstein-based DRSO with no moment constraints. Numerical experiments suggest that our new formulation has superior out-of-sample performance. In the second part of the paper, we consider problems with various types of rank dependence between random variables, including rank dependence measured by Spearman's footrule distance between empirical rankings, comonotonic distributions, box uncertainty for individual observations, and Wasserstein distance between copulas associated with continuous distributions. We also obtain a dual reformulation of the DRSO problem. A desirable byproduct of the formulation is that it also avoids an issue associated with the one-sided moment constraints in moment-based DRSO problems.

math.OC↗