A forward algorithm for a class of Markov zero-sum stopping games
Abstract
Abstract In this paper we propose a new efficient algorithm to compute the value function for zero-sum stopping games featuring two players with opposing interests. This can be seen as a game version of the ‘forward algorithm’ for (one-player) optimal stopping problems, first introduced by Irle (2006) for discrete-time Markov chains and later revisited by Miclo and Villeneuve (2021) for continuous-time Markov processes on general state spaces. This paper focuses on a game driven by a homogeneous continuous-time Markov chain taking values in a finite state space and also discusses the number of iterations needed. Illustrated computational implementations for a few particular examples are also provided.
Fields of Study & Subjects
Optimization and Search Problems
Auction Theory and Applications
Transportation and Mobility Innovations
Publication details
- Journal / source
- Journal of Applied Probability
- Volume
- 63
- Issue
- 3
- Pages
- 1302–1329
- Publication date
- 31 March 2026
- Language
- EN