arXiv subjects

Apostolos N. Burnetas

Publications and source records attributed to Apostolos N. Burnetas.

3 recordsLinked to original sources

arXiv2025

Optimal Data Driven Resource Allocation under Multi-Armed Bandit Observations

This paper introduces the first asymptotically optimal strategy for a multi armed bandit (MAB) model under side constraints. The side constraints model situations in which bandit activations are limited by the availability of certain resources that are replenished at a constant rate. The main result involves the derivation of an asymptotic lower bound for the regret of feasible uniformly fast policies and the construction of policies that achieve this lower bound, under pertinent conditions. Further, we provide the explicit form of such policies for the case in which the unknown distributions are Normal with unknown means and known variances, for the case of Normal distributions with unknown means and unknown variances and for the case of arbitrary discrete distributions with finite support.

stat.ML↗

arXiv2015

Asymptotically Optimal Multi-Armed Bandit Policies under a Cost Constraint

We develop asymptotically optimal policies for the multi armed bandit (MAB), problem, under a cost constraint. This model is applicable in situations where each sample (or activation) from a population (bandit) incurs a known bandit dependent cost. Successive samples from each population are iid random variables with unknown distribution. The objective is to design a feasible policy for deciding from which population to sample from, so as to maximize the expected sum of outcomes of $n$ total samples or equivalently to minimize the regret due to lack on information on sample distributions, For this problem we consider the class of feasible uniformly fast (f-UF) convergent policies, that satisfy the cost constraint sample-path wise. We first establish a necessary asymptotic lower bound for the rate of increase of the regret function of f-UF policies. Then we construct a class of f-UF policies and provide conditions under which they are asymptotically optimal within the class of f-UF policies, achieving this asymptotic lower bound. At the end we provide the explicit form of such policies for the case in which the unknown distributions are Normal with unknown means and known variances.

stat.ML↗

arXiv2015

Inventory Policies for Two Products under Poisson Demand: Interaction between Demand Substitution, Limited Storage Capacity and Replenishment Time Uncertainty

We consider a two-product inventory system with independent Poisson demands, limited joint storage capacity and partial demand substitution. Replenishment is performed simultaneously for both products and the replenishment time may be fixed or exponentially distributed. For both cases we develop a Continuous Time Markov Chain model for the inventory levels and derive expressions for the expected profit per unit time. We prove that the profit function is submodular in the order quantities, which allows for a more efficient algorithm to determine the optimal ordering policy. Using computational experiments we assess the effect of substitution and replenishment time uncertainty on the order quantities and the profit as a function of the storage capacity.

math.OC↗