Decision Making in Complex Multiagent Contexts: A Tale of Two Frameworks

Authors

  • Prashant J. Doshi University of Georgia

DOI:

https://doi.org/10.1609/aimag.v33i4.2402

Keywords:

multi-agent systems, decision making, uncertainty

Abstract

Decision making is a key feature of autonomous systems. It involves choosing optimally between different lines of action in various information contexts that range from perfectly knowing all aspects of the decision problem to having just partial knowledge about it. The physical context often includes other interacting autonomous systems, typically called agents. In this article, I focus on decision making in a multiagent context with partial information about the problem. Relevant research in this complex but realistic setting has converged around two complementary, general frameworks and also introduced myriad specializations on its way. I put the two frameworks, decentralized partially observable Markov decision process (Dec-POMDP) and the interactive partially observable Markov decision process (I-POMDP), in context and review the foundational algorithms for these frameworks, while briefly discussing the advances in their specializations. I conclude by examining the avenues that research pertaining to these frameworks is pursuing.

Author Biography

Prashant J. Doshi, University of Georgia

Associate Professor of Computer Science

Downloads

Published

2012-12-21

How to Cite

Doshi, P. J. (2012). Decision Making in Complex Multiagent Contexts: A Tale of Two Frameworks. AI Magazine, 33(4), 82. https://doi.org/10.1609/aimag.v33i4.2402

Issue

Section

Articles