loading...
Strategy Improvement for Concurrent Reachability Games
Riverside, California September 11-September 14
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/QEST.2006.48Third International Conference on the ...
 This Article 
 
PDF
HTML
IEEE Xplore Subscribers
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Krishnendu Chatterjee, UC Berkeley
Luca de Alfaro, UC Santa Cruz
Thomas A. Henzinger, EPFL and UC Berkeley

A concurrent reachability game is a two-player game played on a graph: at each state, the players simultaneously and independently select moves; the two moves determine jointly a probability distribution over the successor states. The objective for player 1 consists in reaching a set of target states; the objective for player 2 is to prevent this, so that the game is zero-sum.

Our contributions are two-fold. First, we present a simple proof of the fact that in concurrent reachability games, for all? > 0, memoryless ?-optimal strategies exist. A memoryless strategy is independent of the history of plays, and an ?-optimal strategy achieves the objective with probability within a of the value of the game. In contrast to previous proofs of this fact, which rely on the limit behavior of discounted games using advanced Puisieux series analysis, our proof is elementary and combinatorial. Second, we present a strategy-improvement (a.k.a. policy-iteration) algorithm for concurrent games with reachability objectives.

Citation:
Krishnendu Chatterjee, Luca de Alfaro, Thomas A. Henzinger, "Strategy Improvement for Concurrent Reachability Games," qest, pp.291-300, Third International Conference on the Quantitative Evaluation of Systems - (QEST'06), 2006
Usage of this product signifies your acceptance of the Terms of Use.