AAAI Publications, Twenty-Third International Conference on Automated Planning and Scheduling

Font Size: 
Optimal Control as a Graphical Model Inference Problem
Hilbert J. Kappen, Vicenç Gomez, Manfred Opper

Last modified: 2013-06-02


In this paper we show the identification between stochastic optimal control computation and probabilistic inference on a graphical model for certain class of control problems. We refer to these problems as Kullback-Leibler (KL) control problems. We illustrate how KL control can be used to model a multi-agent cooperative game for which optimal control can be approximated using belief propagation when exact inference is unfeasible.


Optimal Control; Kullback-Leibler; Graphical Model; Approximate Inference; Belief Propagation

Full Text: PDF