article

Learning about other agents in a dynamic multiagent system

Authors:

Michael P. WelimanAuthors Info & Claims

Cognitive Systems Research, Volume 2, Issue 1

Pages 67 - 79

https://doi.org/10.1016/S1389-0417(01)00016-X

Published: 01 April 2001 Publication History

Abstract

We analyze the problem of learning about other agents in a class of dynamic multiagent systems, where performance of the primary agent depends on behavior of the others. We consider an online version of the problem, where agents must learn models of the others in the course of continual interactions. Various levels of recursive models are implemented in a simulated double auction market. Our experiments show learning agents on average outperform non-learning agents who do not use information about others. Among learning agents, those with minimum recursion assumption generally perform better than the agents with more complicated, though often wrong assumptions.

References

[1]

Evolving parameter sets for adaptive trading agents in continuous double-auction markets. In: pp. 38-47.

[2]

. Springer-Verlag.

[3]

The double auction market institution: a survey, in. In: Friedman, D., Rust, J. (Eds.), The Double Auction Market, pp. 3-26.

[4]

. In: Friedman, D., Rust, J. (Eds.), The double auction market, Addison-Wesley.

[5]

A decision-theoretic approach to coordinating multiagent interactions. In: pp. 62-68.

[6]

Lower bounds for efficiency of surplus extraction in double auctions. In: Friedman, D., Rust, J. (Eds.), The Double Auction Market, pp. 199-220.

[7]

. MIT Press.

[8]

Experimental results on Q-learning for general-sum stochastic games. In: pp. 407-414.

[9]

Multiagent reinforcement learning: theoretical framework and an algorithm. In: AAAI Press, Madison, WI. pp. 242-250.

[10]

An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In: pp. 535-542.

[11]

Markov games as a framework for multi-agent reinforcement learning. In: pp. 157-163.

[12]

Auctions and bidding. Journal of Economic Literature. v25. 699-738.

[13]

Correlating internal parameters and external performance: Learning soccer agents. In: Weiíï¿½, G. (Ed.), Vol. 1221 of lecture notes in artificial intelligence, Springer-Verlag. pp. 137-150.

[14]

. 3rd ed. Academic Press, San Diego.

[15]

Behavior of trading automata in a computerized double auction market. In: Friedman, D., Rust, J. (Eds.), The Double Auction Market, pp. 155-198.

[16]

On the gains and losses of speculation in equilibrium markets. In: pp. 632-638.

[17]

The bayesian theory of the k-double auction. In: Friedman, D., Rust, J. (Eds.), The Double Auction Market, pp. 99-124.

[18]

. In: Optimality and Equilibria in Stochastic Games, Centrum voor Wiskunde en Informatica, Amsterdam.

[19]

On the stability of Edgeworth barter process. International Economic Review. v3 i2. 218-232.

[20]

. 3rd ed. W. W. Norton, New York.

[21]

The moving target function problem in multi-agent learning. In: IEEE Press, Paris, France.

[22]

Learning nested agent models in an informational economy. Journal of Experimental and Theoretical Artificial Intelligence. v10 i3. 291-308.

[23]

Conjectural equilibrium in multiagent learning. Machine Learning. v33. 179-200.

Cited By

Methenitis GKaisers MLa Poutré H(2020)Degrees of Rationality in Agent-Based Retail MarketsComputational Economics10.1007/s10614-019-09955-256:4(953-973)Online publication date: 1-Dec-2020
https://dl.acm.org/doi/10.1007/s10614-019-09955-2
Lai KLin MYu T(2010)Learning opponent's beliefs via fuzzy constraint-directed approach to make effective agent negotiationApplied Intelligence10.1007/s10489-009-0162-233:2(232-246)Online publication date: 1-Oct-2010
https://dl.acm.org/doi/10.1007/s10489-009-0162-2
Łatek MAxtell RKaminski BSierra CCastelfranchi CDecker KSichman J(2009)Bounded rationality via recursionProceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 110.5555/1558013.1558076(457-464)Online publication date: 10-May-2009
https://dl.acm.org/doi/10.5555/1558013.1558076
Show More Cited By

Learning about other agents in a dynamic multiagent system
1. Applied computing
  1. Law, social and behavioral sciences
2. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence

Recommendations

Opportunities for multiagent systems and multiagent reinforcement learning in traffic control

The increasing demand for mobility in our society poses various challenges to traffic engineering, computer science in general, and artificial intelligence and multiagent systems in particular. As it is often the case, it is not possible to provide ...
Learning in groups of traffic signals

Computer science in general, and artificial intelligence and multiagent systems in particular, are part of an effort to build intelligent transportation systems. An efficient use of the existing infrastructure relates closely to multiagent systems as ...
Conjectural Equilibrium in Multiagent Learning

Learning in a multiagent environment is complicated by the fact that as other agents learn, the environment effectively changes. Moreover, other agents‘ actions are often not directly observable, and the actions taken by the learning agent can strongly ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Cognitive Systems Research

Cognitive Systems Research Volume 2, Issue 1

April, 2001

93 pages

ISSN:1389-0417

Issue’s Table of Contents

Copyright © Elsevier Science B.V. © 2001.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 April 2001

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Methenitis GKaisers MLa Poutré H(2020)Degrees of Rationality in Agent-Based Retail MarketsComputational Economics10.1007/s10614-019-09955-256:4(953-973)Online publication date: 1-Dec-2020
https://dl.acm.org/doi/10.1007/s10614-019-09955-2
Lai KLin MYu T(2010)Learning opponent's beliefs via fuzzy constraint-directed approach to make effective agent negotiationApplied Intelligence10.1007/s10489-009-0162-233:2(232-246)Online publication date: 1-Oct-2010
https://dl.acm.org/doi/10.1007/s10489-009-0162-2
Łatek MAxtell RKaminski BSierra CCastelfranchi CDecker KSichman J(2009)Bounded rationality via recursionProceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 110.5555/1558013.1558076(457-464)Online publication date: 10-May-2009
https://dl.acm.org/doi/10.5555/1558013.1558076
Yu TLai KLin MKao B(2007)Modeling opponent's beliefs via fuzzy constraint-directed approach in agent negotiationProceedings of the intelligent computing 3rd international conference on Advanced intelligent computing theories and applications10.5555/1777454.1777474(167-178)Online publication date: 21-Aug-2007
https://dl.acm.org/doi/10.5555/1777454.1777474
Yu TLai KLin MKao B(2007)A fuzzy constraint-based agent negotiation with opponent learningProceedings of the 6th Conference on WSEAS International Conference on Applied Computer Science - Volume 610.5555/1348359.1348365(31-36)Online publication date: 15-Apr-2007
https://dl.acm.org/doi/10.5555/1348359.1348365
Erus GPolat F(2007)A layered approach to learning coordination knowledge in multiagent environmentsApplied Intelligence10.1007/s10489-006-0034-y27:3(249-267)Online publication date: 1-Dec-2007
https://dl.acm.org/doi/10.1007/s10489-006-0034-y
Kwon O(2006)Multi-agent system approach to context-aware coordinated web services under general market mechanismDecision Support Systems10.5555/1138885.170093441:2(380-399)Online publication date: 1-Jan-2006
https://dl.acm.org/doi/10.5555/1138885.1700934
Kong D(2004)One Dynamic Pricing Strategy in Agent Economy Using Neural Network Based on Online LearningProceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence10.5555/1025132.1026305(98-102)Online publication date: 20-Sep-2004
https://dl.acm.org/doi/10.5555/1025132.1026305
Kwon OSadeh N(2004)Applying case-based reasoning and multi-agent intelligent system to context-aware comparative shoppingDecision Support Systems10.1016/S0167-9236(03)00007-137:2(199-213)Online publication date: 1-May-2004
https://dl.acm.org/doi/10.1016/S0167-9236%2803%2900007-1
Khoussainov RKushmerick NKraft DFrieder OHammer JQureshi SSeligman L(2003)Automated index management for distributed web searchProceedings of the twelfth international conference on Information and knowledge management10.1145/956863.956937(386-393)Online publication date: 3-Nov-2003
https://dl.acm.org/doi/10.1145/956863.956937

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents