article

Bayesian Update of Recursive Agent Models

Authors:

Piotr J. Gmytrasiewicz,

Tad KelloggAuthors Info & Claims

User Modeling and User-Adapted Interaction, Volume 8, Issue 1-2

Pages 49 - 69

https://doi.org/10.1023/A:1008269427670

Published: 01 January 1998 Publication History

Abstract

We present a framework for Bayesian updating of beliefs about models of agent(s) based on their observed behavior. We work within the formalism of the Recursive Modeling Method (RMM) that maintains and processes models an agent may use to interact with other agent(s), the models the agent may think the other agent has of the original agent, the models the other agent may think the agent has, and so on. The beliefs about which model is the correct one are incrementally updated based on the observed behavior of the modeled agent and, as the result, the probability of the model that best predicted the observed behavior is increased. Analogously, the models on deeper levels of modeling can be updated; the models that the agent thinks another agent uses to model the original agent are revised based on how the other agent is expected to observe the original agent‘s behavior, and so on. We have implemented and tested our method in two domains, and the results show a marked improvement in the quality of interactions with the belief update in both domains.

References

[1]

Albrecht, D., Zukerman, I., Nicholson, A. and Bud, A.: 1997, Towards a Bayesian model for keyhole plan recognition in large domains. In Proceedings of the Sixth International Conference on User Modeling, Chia Laguna, Italy, 363-365.

[2]

Albrecht, D., Zukerman, I. and Nicholson, A.: 1998, Bayesian models for keyhole plan recognition in an adventure game. In this issue.

[3]

Allen, J. F.: 1990, Two views of intention. In: P. R. Cohen, J. Morgan and M. E. Pollack (eds), Intentions in Communication. MIT Press.

[4]

Binmore, K.: 1982, Essays on Foundations of Game Theory. Pitman.

[5]

Chiu, B. C. and Webb, G. I.: 1998, Using decision trees for agent modelling: A study on improving prediction performance. In this issue.

[6]

Clark, H. H. and Marshall, C. R.: 1981, Definite reference and mutual knowledge. In: A. K. Joshi, B. L. Webber and I. A. Sag (eds), Elements of Discourse Understanding. Cambridge, U.K.: Cambridge University Press, 10-63.

[7]

Cooper, G. and Herskovits, E.: 1992, A Bayesian method for the induction of probabilistic networks form data. Machine Learning (9), 309-347.

Digital Library

[8]

Dennett, D.: 1986, Intentional systems. In: D. Dennett (ed), Brainstorms. MIT Press.

[9]

Friedman, N. and Halpern, J. Y.: 1994, A knowledge-based framework for belief change Part i: Foundations. In: Proceedings of Sixth Conference on Theoretical Aspects of Reasoning about Knowledge, 44-64.

Digital Library

[10]

Gmytrasiewicz, P. J. and Durfee, E. H.: 1995, A rigorous, operational formalization of recursive modeling. In: Proceedings of the First International Conference on Multiagent Systems, ICMAS'95, 125-132.

[11]

Gmytrasiewicz, P. J.: 1996, An approach to user modeling in decision support systems. In: Proceedings of the Fifth International Conference on User Modeling, Chia Laguna, Italy, 121-127.

[12]

Halpern, J. Y. and Moses, Y.: 1990, Knowledge and common knowledge in a distributed environment. Journal of the ACM 37(3), 549-587.

Digital Library

[13]

Howard, R. A. and Matheson, J. E.: 1984, Influence diagrams. In: R. A. Howard and J. E. Matheson (eds), Readings on Principles and Applications of Decision Analysis. Strategic Decisions Group, Menlo Park, CA., 721-762.

[14]

Huber, M. J., Durfee, E. H. and Wellman, M. P.: 1994, The automated mapping of plans for plan recognition. In: Proceedings of 1994 Conference on Uncertainty in Artificial Intelligence, 344-351.

[15]

Jameson, A., Schäfer, R., Simons, J. and Weis, T.: 1995, Adaptive provision of evaluation-oriented information: Tasks and techniques. In: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, Chia Laguna, Italy, 1886-1893.

Digital Library

[16]

Jameson, A.: 1989, But what will the listener think? belief ascription and image maintenance in dialog. In: A. Kobsa and W. Wahlster (eds), User Models in Dialog Systems. Springer-Verlag.

[17]

Levy, R. and Rosenschein, J. S.: 1992, A game theoretic approach to the pursuit problem. In: Working Papers of the Eleventh International Workshop on Distributed Artificial Intelligence, 195-213.

[18]

Myerson, R. B.: 1991, Game Theory: Analysis of Conflict. Harvard University Press.

[19]

Noh, S. and Gmytrasiewicz P. J.: 1997, Agent modeling in antiair defense. In: Proceedings of the Sixth International Conference on User Modeling, Chia Laguna, Italy, 389-400.

[20]

Pearl, J.: 1988, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufman.

Digital Library

[21]

Poh, K. L. and Horvitz, E. J.: 1996, A graph-theoretic analysis of information value. In: Proceedings of the Twelfth Conference on Uncertainty in Artificial Intelligence (UAI-96), 427-435.

Digital Library

[22]

Russell, S. and Norvig, P.: 1994, Artificial Intelligence: A Modern Approach. Prentice Hall.

Digital Library

[23]

Sen, S. and Knight, L.: 1995, A genetic prototype learner. In: Proceedings of the International Joint Conference on Artificial Intelligence, 84-89.

Digital Library

[24]

Sprites, P., Glymour, C. and Scheines, R.: 1993, Causation, Prediction and Search. Springer-Verlag.

Cited By

Rudrauf DSergeant-Perhtuis GTisserand YMonnor TDe Gevigney VBelli O(2023)Combining the Projective Consciousness Model and Virtual Humans for Immersive Psychological Research: A Proof-of-concept Simulating a ToM AssessmentACM Transactions on Interactive Intelligent Systems10.1145/358388613:2(1-31)Online publication date: 5-May-2023
https://dl.acm.org/doi/10.1145/3583886
de Weerd HVerbrugge RVerheij B(2022)Higher-order theory of mind is especially useful in unpredictable negotiationsAutonomous Agents and Multi-Agent Systems10.1007/s10458-022-09558-636:2Online publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1007/s10458-022-09558-6
Søndberg-Jeppesen NJensen FZeng YGini MShehory OIto TJonker C(2013)Opponent modeling in a PGM frameworkProceedings of the 2013 international conference on Autonomous agents and multi-agent systems10.5555/2484920.2485115(1149-1150)Online publication date: 6-May-2013
https://dl.acm.org/doi/10.5555/2484920.2485115
Show More Cited By

Index Terms

Bayesian Update of Recursive Agent Models
1. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence
      1. Multi-agent systems

Index terms have been assigned to the content through auto-classification.

Recommendations

Rational Coordination in Multi-Agent Environments

We adopt the decision-theoretic principle of expected utility maximization as a paradigm for designing autonomous rational agents, and present a framework that uses this paradigm to determine the choice of coordinated action. We endow an agent with a ...
Artifacts in the A&A meta-model for multi-agent systems

In this article we focus on the notion of artifact for agents in multi-agent systems (MAS) as a basis for a new meta-model promoting the modelling and engineering of agent societies and MAS environment as first-class entities. Its conceptual foundations ...
Oh, Now I See What You Want: Learning Agent Models with Internal States from Observations
AAMAS '24: Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems

Learning behavior models of other agents from observations is challenging because agents typically do not act based on observable states alone, but usually take their internal, for external agents unobservable, states such as desires, motivations, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image User Modeling and User-Adapted Interaction

User Modeling and User-Adapted Interaction Volume 8, Issue 1-2

1998

157 pages

ISSN:0924-1868

Issue’s Table of Contents

Copyright © Copyright © 1998 Kluwer Academic Publishers.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 January 1998

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rudrauf DSergeant-Perhtuis GTisserand YMonnor TDe Gevigney VBelli O(2023)Combining the Projective Consciousness Model and Virtual Humans for Immersive Psychological Research: A Proof-of-concept Simulating a ToM AssessmentACM Transactions on Interactive Intelligent Systems10.1145/358388613:2(1-31)Online publication date: 5-May-2023
https://dl.acm.org/doi/10.1145/3583886
de Weerd HVerbrugge RVerheij B(2022)Higher-order theory of mind is especially useful in unpredictable negotiationsAutonomous Agents and Multi-Agent Systems10.1007/s10458-022-09558-636:2Online publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1007/s10458-022-09558-6
Søndberg-Jeppesen NJensen FZeng YGini MShehory OIto TJonker C(2013)Opponent modeling in a PGM frameworkProceedings of the 2013 international conference on Autonomous agents and multi-agent systems10.5555/2484920.2485115(1149-1150)Online publication date: 6-May-2013
https://dl.acm.org/doi/10.5555/2484920.2485115
Xiang YSmith JKroes J(2011)Multiagent bayesian forecasting of structural time-invariant dynamic systems with graphical modelsInternational Journal of Approximate Reasoning10.1016/j.ijar.2010.07.00452:7(960-977)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1016/j.ijar.2010.07.004
Zeng YDoshi P(2010)Model identification in interactive influence diagrams using mutual informationWeb Intelligence and Agent Systems10.5555/1839537.18395438:3(313-327)Online publication date: 1-Aug-2010
https://dl.acm.org/doi/10.5555/1839537.1839543
Markovitch SReger R(2005)Learning and Exploiting Relative Weaknesses of Opponent AgentsAutonomous Agents and Multi-Agent Systems10.1007/s10458-004-6977-710:2(103-130)Online publication date: 1-Mar-2005
https://dl.acm.org/doi/10.1007/s10458-004-6977-7
Palopoli LTerracina GUrsino D(2003)A Plausibility Description Logic for Handling Information Sources with Heterogeneous Data Representation FormatsAnnals of Mathematics and Artificial Intelligence10.1023/A:102609432771339:4(385-430)Online publication date: 1-Dec-2003
https://dl.acm.org/doi/10.1023/A%3A1026094327713
Vassileva JMccalla GGreer J(2003)Multi-Agent Multi-User Modeling in I-HelpUser Modeling and User-Adapted Interaction10.1023/A:102407270652613:1-2(179-210)Online publication date: 1-Feb-2003
https://dl.acm.org/doi/10.1023/A%3A1024072706526
Gmytrasiewicz PGini MIshida TCastelfranchi CJohnson W(2002)Negotiation as a mechanism for language evolutionProceedings of the first international joint conference on Autonomous agents and multiagent systems: part 210.1145/544862.544874(559-560)Online publication date: 15-Jul-2002
https://dl.acm.org/doi/10.1145/544862.544874
Zukerman IAlbrecht D(2001)Predictive Statistical Models for User ModelingUser Modeling and User-Adapted Interaction10.1023/A:101117552545111:1-2(5-18)Online publication date: 27-Mar-2001
https://dl.acm.org/doi/10.1023/A%3A1011175525451
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents