Bounds on the bias terms for the Markov reward approach

Abstract

An important step in the Markov reward approach to error bounds on stationary performance measures of Markov chains is to bound the bias terms. Affine functions have been successfully used for these bounds for various models, but there are also models for which it has not been possible to establish such bounds. So far, no theoretical results have been available that guarantee bounds on the bias terms. We consider random walks in the positive orthant and provide sufficient conditions under which quadratic and/or geometric functions can be used to bound the bias terms. In addition, we provide a linear programming framework that establishes the quadratic bounds as well as the resulting bound on the stationary performance.