research-article

Simultaneously modeling humans' preferences and their beliefs about others' preferences

Authors:

Sevan G. Ficici,

Avi PfefferAuthors Info & Claims

AAMAS '08: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1

Pages 323 - 330

Published: 12 May 2008 Publication History

Abstract

In strategic multiagent decision making, it is often the case that a strategic reasoner must hold beliefs about other agents and use these beliefs to inform its decision making. The behavior thus produced by the reasoner involves an interaction between the reasoner's beliefs about other agents and the reasoner's own preferences. A significant challenge faced by model designers, therefore, is how to model such a reasoner's behavior so that the reasoner's preferences and beliefs can each be identified and distinguished from each other. In this paper, we introduce a model of strategic reasoning that allows us to distinguish between the reasoner's utility function and the reasoner's beliefs about another agent's utility function as well as the reasoner's beliefs about how that agent might interact with yet other agents. We show that our model is uniquely identifiable. That is, no two different parameter settings will cause the model to give the same behavior over all possible inputs. We then illustrate the performance of our model in a multiagent negotiation game played by human subjects. We find that our subjects have slightly incorrect beliefs about other agents in the game.

References

[1]

T. Bosse, Z. Memon, and J. Treur. A two-level BDI-agent model for theory of mind and its use in social manipulation. In AISB 2007 Workshop on Mindful Environments, 2007.

[2]

J. T. Cacioppo, P. S. Visser, and C. L. Pickett, editors. Social neuroscience: People thinking about people. MIT Press, 2005.

[3]

C. F. Camerer. Behavioral Game Theory: Experiments in Strategic Interaction. Princeton University Press, 2003.

[4]

M. Davies and T. Stone, editors. Folk Psychology: The Theory of Mind Debate. Blackwell Publishers, 1995.

[5]

S. G. Ficici and A. Pfeffer. Simultaneously modeling humans' preferences and their beliefs about others' preferences. Technical Report TR-02-07, Harvard University School of Eng. and Applied Sciences, 2007.

[6]

Y. Gal, B. J. Grosz, A. Pfeffer, S. M. Shieber, and A. Allain. The influence of task contexts on the decision-making of humans and computers. In Proc. Sixth International and Interdisciplinary Conference on Modeling and Using Context, 2007.

Digital Library

[7]

Y. Gal and A. Pfeffer. Predicting people's bidding behavior in negotiation. In AAMAS, 2006.

Digital Library

[8]

Y. Gal, A. Pfeffer, F. Marzo, and B. J. Grosz. Learning social preferences in games. In National Conference on Artificial Intelligence (AAAI), 2004.

Digital Library

[9]

P. Gmytrasiewicz and E. H. Durfee. Rational coordination in multi-agent environments. Autonomous Agents and Multi-Agent Systems, 3(4):319--350, 2000.

Digital Library

[10]

R. Gordon. Folk psychology as simulation. Mind and Language, 1:158--171, 1986.

[11]

J. Gratch and S. Marsella. Evaluating a computational model of emotion. Autonomous Agents and Multi-Agent Systems, 11(1):23--43, 2005.

Digital Library

[12]

B. J. Grosz, S. Kraus, S. Talman, B. Stossel, and M. Havlin. The influence of social dependencies on decision-making: Initial investigations with a new game. In AAMAS, 2004.

Digital Library

[13]

S. Hurley. The shared circuits hypothesis: A unified functional architecture for control, imitation, and simulation. In S. Hurley and N. Chater, editors, Perspectives on Imitation: From Neuroscience to Social Science, volume 1. MIT Press, 2004.

[14]

S. Kraus. Strategic Negotiation in Multiagent Environments. MIT Press, 2001.

Digital Library

[15]

C. Lueg and R. Pfeifer. Cognition, situatedness, and situated design. In Conf. on Cognitive Tech., 1997.

Digital Library

[16]

S. Marsell, D. Pynadath, and S. Read. Psychsim: Agent-based modeling of social interactions and influence. In ICCM 2004, 2004.

[17]

M. Rabin. Psychology and economics. Journal of Economic Literature, 36:11--46, 1998.

[18]

J. M. Vidal and E. H. Durfee. Recursive agent modeling using limited rationality. In International Conference on Multi-Agent Systems, 1995.

[19]

G. Weiss, editor. Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence. MIT Press, 2000.

Digital Library

Cited By

Atkinson KBench-Capon T(2018)Taking account of the actions of others in value-based reasoningArtificial Intelligence10.1016/j.artint.2017.09.002254:C(1-20)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1016/j.artint.2017.09.002
Haim GGal YAn BKraus S(2017)Humancomputer negotiation in a three player market settingArtificial Intelligence10.1016/j.artint.2017.01.003246:C(34-52)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1016/j.artint.2017.01.003
Atkinson KBench-Capon T(2016)Value based reasoning and the actions of othersProceedings of the Twenty-second European Conference on Artificial Intelligence10.3233/978-1-61499-672-9-680(680-688)Online publication date: 29-Aug-2016
https://dl.acm.org/doi/10.3233/978-1-61499-672-9-680
Show More Cited By

Index Terms

Simultaneously modeling humans' preferences and their beliefs about others' preferences
1. Applied computing
  1. Law, social and behavioral sciences
2. Computing methodologies
  1. Machine learning
  2. Modeling and simulation
    1. Model development and analysis

Recommendations

Modeling how humans reason about others with partial information
AAMAS '08: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1

Computer agents participate in many collaborative and competitive multiagent domains in which humans make decisions. For computer agents to interact successfully with people in such environments, an understanding of human reasoning is beneficial. In ...
Colored trails: a multiagent system testbed for decision-making research
AAMAS '08: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems: demo papers

With increasing frequency, computer agents participate in collaborative and competitive multiagent domains in which humans reason strategically to make decisions. The deployment of computer agents in such domains requires that the agents understand ...
An Ontological Modelling of Reason-Based Preferences
AIxIA 2023 – Advances in Artificial Intelligence
Abstract
We present an ontological framework for the reason-based model of individual preferences introduced by F. Dietrich and C. List. According to this perspective, an agent prefers x to y if and only if the importance of the reasons motivating x ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

AAMAS '08: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1

May 2008

565 pages

ISBN:9780981738109

Program Chairs:
Lin Padgham
RMIT University, Australia
,
David Parkes
Harvard University

Sponsors

ACM: Association for Computing Machinery
AAAI: Association for the Advancement of Artifical Intelligence

Publisher

International Foundation for Autonomous Agents and Multiagent Systems

Richland, SC

Publication History

Published: 12 May 2008

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AAMAS08

Sponsor:

ACM
AAAI

AAMAS08: 7th International Conference on Autonomous Agents and Multi Agent Systems

May 12 - 16, 2008

Estoril, Portugal

Acceptance Rates

Overall Acceptance Rate 1,155 of 5,036 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
156
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Atkinson KBench-Capon T(2018)Taking account of the actions of others in value-based reasoningArtificial Intelligence10.1016/j.artint.2017.09.002254:C(1-20)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1016/j.artint.2017.09.002
Haim GGal YAn BKraus S(2017)Humancomputer negotiation in a three player market settingArtificial Intelligence10.1016/j.artint.2017.01.003246:C(34-52)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1016/j.artint.2017.01.003
Atkinson KBench-Capon T(2016)Value based reasoning and the actions of othersProceedings of the Twenty-second European Conference on Artificial Intelligence10.3233/978-1-61499-672-9-680(680-688)Online publication date: 29-Aug-2016
https://dl.acm.org/doi/10.3233/978-1-61499-672-9-680
Peled NGal YKraus SGini MShehory OIto TJonker C(2013)An agent design for repeated negotiation and information revelation with peopleProceedings of the 2013 international conference on Autonomous agents and multi-agent systems10.5555/2484920.2485195(1303-1304)Online publication date: 6-May-2013
https://dl.acm.org/doi/10.5555/2484920.2485195
Yang RKiekintveld COrdóñEz FTambe MJohn R(2013)Improving resource allocation strategies against human adversaries in security gamesArtificial Intelligence10.1016/j.artint.2012.11.004195(440-469)Online publication date: 1-Feb-2013
https://dl.acm.org/doi/10.1016/j.artint.2012.11.004
Gal YKraus SGelfand MKhashan HSalmon E(2011)An Adaptive Agent for Negotiating with People in Different CulturesACM Transactions on Intelligent Systems and Technology10.1145/2036264.20362723:1(1-24)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1145/2036264.2036272
Gal YGrosz BKraus SPfeffer AShieber S(2010)Agent decision-making in open mixed networksArtificial Intelligence10.1016/j.artint.2010.09.002174:18(1460-1480)Online publication date: 1-Dec-2010
https://dl.acm.org/doi/10.1016/j.artint.2010.09.002
Bench-Capon TAtkinson KMcBurney PSierra CCastelfranchi CDecker KSichman J(2009)Altruism and agentsProceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 210.5555/1558109.1558163(1073-1080)Online publication date: 10-May-2009
https://dl.acm.org/doi/10.5555/1558109.1558163
Ficici SPfeffer AGal YGrosz BShieber S(2008)Colored trailsProceedings of the 7th international joint conference on Autonomous agents and multiagent systems: demo papers10.5555/1402744.1402753(1661-1662)Online publication date: 12-May-2008
https://dl.acm.org/doi/10.5555/1402744.1402753

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents