Solving Poisson's equation for Wasserstein contractive Markov chains

Abstract

We study Poisson's equation in the context of general state space Markov chains. For chains satisfying a contraction assumption w.r.t. a Wasserstein distance, we show that a solution exists for Lipschitz functions and investigate its regularity properties. If the kernel is additionally reversible we are also able to show that solutions for $L^p$ functions exist. Combining our findings with Doob's inequalities for martingales we derive maximal inequalities for contractive Markov chains. A number of examples is provided to demonstrate the applicability of our results, in particular in the context of Markov chain Monte Carlo methods.