loading...
Planning with POMDPs Using a Compact, Logic-Based Representation
Hong Kong, China November 14-November 16
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ICTAI.2005.9617th IEEE International Conference on ...
 This Article 
 
PDF
HTML
 
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Chenggang Wang, Tufts University
Jim Schmolze, Tufts University
Partially Observable Markov Decision Processes (POMDPs) provide a general framework for AI planning, but they lack the structure for representing real world planning problems in a convenient and efficient way. Representations built on logic allow for problems to be specified in a compact and transparent manner. Moreover, decision making algorithms can assume and exploit structure found in the state space, actions, observations, and success criteria, and can solve with relative efficiency problems with large state spaces. In recent years researchers have sought to combine the benefits of logic with the expressiveness of POMDPs. In this paper, we show how to build upon and extend the results in this fusing of logic and decision theory. In particular, we present a compact representation of POMDPs and a method to update beliefs after actions and observations. The key contribution is our compact representation of belief states and of the operations used to update them. We then use heuristic search to find optimal plans that maximize expected total reward given an initial belief state.
Citation:
Chenggang Wang, Jim Schmolze, "Planning with POMDPs Using a Compact, Logic-Based Representation," ictai, pp.523-530, 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05), 2005
Usage of this product signifies your acceptance of the Terms of Use.


Suggestions