SearcharxivSearch

arXiv subjects

Edward J. Anderson

Publications and source records attributed to Edward J. Anderson.

3 recordsLinked to original sources

Don't Look Back in Anger: Wasserstein Distributionally Robust Optimization with Nonstationary Data

We study data-driven decision problems where historical observations are generated by a time-evolving distribution whose consecutive shifts are bounded in Wasserstein distance. We address this nonstationarity using a distributionally robust optimization model with an ambiguity set that is a Wasserstein ball centered at a weighted empirical distribution, thereby allowing for the time decay of past data in a way which accounts for the drift of the data-generating distribution. Our main technical contribution is a concentration bound for weighted empirical distributions that explicitly captures both the effective sample size (i.e., the equivalent number of equally weighted observations) and the distributional drift. Using our concentration bound, we select observation weights that optimally balance variance, determined by the effective sample size, and drift, induced by the temporal changes in the data-generating process. The family of optimal weightings reveals a polynomial relationship between the order of the Wasserstein ambiguity ball and the time-decay profile of the optimal weights. We further characterize how the ambiguity radius must grow with the distributional drift to guarantee a prescribed confidence level. Classical weighting schemes, such as time windowing and simple exponential smoothing, emerge as special cases of our framework, for which we derive principled choices of parameters. Numerical experiments demonstrate the effectiveness of our proposed approach.

math.OC

Nonstationary Distribution Estimation via Wasserstein Probability Flows

We study the problem of estimating a sequence of evolving probability distributions from historical data, where the underlying distribution changes over time in a nonstationary and nonparametric manner. To capture gradual changes, we introduce a model that penalises large deviations between consecutive distributions using the Wasserstein distance. This leads to a method in which we estimate the underlying series of distributions by maximizing the log-likelihood of the observations with a penalty applied to the sum of the Wasserstein distances between consecutive distributions. We show how this can be reduced to a simple network-flow problem enabling efficient computation. We call this the Wasserstein Probability Flow method. We derive some properties of the optimal solutions and carry out numerical tests in different settings. Our results suggest that the Wasserstein Probability Flow method is a promising tool for applications such as nonstationary stochastic optimization.

math.OC

On the Out-of-Sample Performance of Stochastic Dynamic Programming and Model Predictive Control

Sample average approximation--based stochastic dynamic programming (SDP) and model predictive control (MPC) are two different methods for approaching multistage stochastic optimization. In this paper we investigate the conditions under which SDP may be outperformed by MPC. We show that, depending on the presence of concavity or convexity, MPC can be interpreted as solving a mean-constrained distributionally ambiguous version of the problem that is solved by SDP. This furnishes performance guarantees when the true mean is known and provides intuition for why MPC performs better in some applications and worse in others. We then study a multistage stochastic optimization problem that is representative of the type for which MPC may be the better choice. We find that this can indeed be the case when the probability distribution of the underlying random variable is skewed or has enough weight in the right-hand tail.

math.OC