arXiv · 2204.14107
Strategy Synthesis for Global Window PCTL
Abstract
Given a Markov decision process (MDP) $M$ and a formula $\Phi$, the strategy synthesis problem asks if there exists a strategy $\sigma$ s.t. the resulting Markov chain $M[\sigma]$ satisfies $\Phi$. This problem is known to be undecidable for the probabilistic temporal logic PCTL. We study a class of formulae that can be seen as a fragment of PCTL where a local, bounded horizon property is enforced all along an execution. Moreover, we allow for linear expressions in the probabilistic inequalities. This logic is at the frontier of decidability, depending on the type of strategies considered. In particular, strategy synthesis is decidable when strategies are deterministic while the general problem is undecidable.
Explore related subjects
Keep this discovery
Benjamin Bordais, Damien Busatto-Gaston, Shibashis Guha, Jean-François Raskin. 2022-04-25. Strategy Synthesis for Global Window PCTL. https://arxiv.org/abs/2204.14107
Cite the original work for its findings. Save a collection to share your selection of sources.