Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/2343896.2343936acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaamasConference Proceedingsconference-collections
research-article

Tree-based pruning for multiagent POMDPs with delayed communication

Published: 04 June 2012 Publication History

Abstract

Multiagent POMDPs provide a powerful framework for optimal decision making under the assumption of instantaneous communication. We focus on a delayed communication setting (MPOMDP-DC), in which broadcast information is delayed by at most one time step. Such an assumption is in fact more appropriate for applications in which response time is critical. However, naive application of incremental pruning, the core of many state-of-the-art POMDP techniques, is intractable for MPOMDP-DCs. We overcome this problem by introducing a tree-based pruning technique. Experiments show that the method outperforms naive incremental pruning by orders of magnitude, allowing for the solution of larger problems.

References

[1]
A. Cassandra, M. L. Littman, and N. L. Zhang. Incremental pruning: A simple, fast, exact method for partially observable Markov decision processes. In UAI, pages 54--61. Morgan Kaufmann, 1997.
[2]
K. Hsu and S. Marcus. Decentralized control of finite state Markov processes. IEEE Transactions on Automatic Control, 27(2):426--431, Apr. 1982.
[3]
L. P. Kaelbling, M. L. Littman, and A. R. Cassandra. Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101(1--2):99--134, 1998.
[4]
F. A. Oliehoek, M. T. J. Spaan, and N. Vlassis. Dec-POMDPs with delayed communication. In MSDM (AAMAS Workshop), May 2007.
[5]
M. T. J. Spaan, F. A. Oliehoek, and N. Vlassis. Multiagent planning under uncertainty with stochastic communication delays. In ICAPS, pages 338--345, 2008.

Cited By

View all
  • (2012)Learning Communication in Interactive Dynamic Influence DiagramsProceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 0210.1109/WI-IAT.2012.180(243-250)Online publication date: 4-Dec-2012

Index Terms

  1. Tree-based pruning for multiagent POMDPs with delayed communication

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AAMAS '12: Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 3
    June 2012
    376 pages
    ISBN:0981738133

    Sponsors

    • The International Foundation for Autonomous Agents and Multiagent Systems: The International Foundation for Autonomous Agents and Multiagent Systems

    In-Cooperation

    Publisher

    International Foundation for Autonomous Agents and Multiagent Systems

    Richland, SC

    Publication History

    Published: 04 June 2012

    Check for updates

    Author Tags

    1. delayed communication
    2. multiagent POMDP
    3. multiagent planning under uncertainty

    Qualifiers

    • Research-article

    Conference

    AAMAS 12
    Sponsor:
    • The International Foundation for Autonomous Agents and Multiagent Systems

    Acceptance Rates

    Overall Acceptance Rate 1,155 of 5,036 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 18 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2012)Learning Communication in Interactive Dynamic Influence DiagramsProceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 0210.1109/WI-IAT.2012.180(243-250)Online publication date: 4-Dec-2012

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media