Nothing Special   »   [go: up one dir, main page]

skip to main content
article

Weighted synergy graphs for effective team formation with heterogeneous ad hoc agents

Published: 01 March 2014 Publication History

Abstract

Previous approaches to select agents to form a team rely on single-agent capabilities, and team performance is treated as a sum of such known capabilities. Motivated by complex team formation situations, we address the problem where both single-agent capabilities may not be known upfront, e.g., as in ad hoc teams, and where team performance goes beyond single-agent capabilities and depends on the specific synergy among agents. We formally introduce a novel weighted synergy graph model to capture new interactions among agents. Agents are represented as vertices in the graph, and their capabilities are represented as Normally-distributed variables. The edges of the weighted graph represent how well the agents work together, i.e., their synergy in a team. We contribute a learning algorithm that learns the weighted synergy graph using observations of performance of teams of only two and three agents. Further, we contribute two team formation algorithms, one that finds the optimal team in exponential time, and one that approximates the optimal team in polynomial time. We extensively evaluate our learning algorithm, and demonstrate the expressiveness of the weighted synergy graph in a variety of problems. We show our approach in a rich ad hoc team formation problem capturing a rescue domain, namely the RoboCup Rescue domain, where simulated robots rescue civilians and put out fires in a simulated urban disaster. We show that the weighted synergy graph outperforms a competing algorithm, thus illustrating the efficacy of our model and algorithms.

References

[1]
Agmon, N. and Stone, P., Leading multiple ad hoc teammates in joint action settings. In: AAAI Workshop: Interactive Decision Theory and Game Theory,
[2]
Banerjee, B. and Kraemer, L., Coalition structure generation in multi-agent systems with mixed externalities. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 175-182.
[3]
Barrett, S. and Stone, P., Ad hoc teamwork modeled with multi-armed bandits: An extension to discounted infinite rewards. In: Proc. Int. Conf. Autonomous Agents and Multiagent Systems - Adaptive Learning Agents Workshop,
[4]
Barrett, S., Stone, P. and Kraus, S., Empirical evaluation of ad hoc teamwork in the pursuit domain. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 567-574.
[5]
Bulka, B., Gaston, M. and desJardins, M., Local strategy learning in networked multi-agent team formation. J. Autonom. Agents Multi-Agent Syst. v15. 29-45.
[6]
Chen, J. and Sun, D., Resource constrained multirobot task allocation based on leader-follower coalition methodology. J. Robot. Res. v30 i12. 1423-1434.
[7]
de Weerdt, M., Zhang, Y. and Klos, T., Distributed task allocation in social networks. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 500-507.
[8]
Dias, M.B., TraderBots: A new paradigm for robust and efficient multirobot coordination in dynamic environments. 2004. The Robotics Institute, Carnegie Mellon University.
[9]
Dias, M.B. and Stentz, A., A free market architecture for distributed control of a multirobot system. In: Proceedings of the International Conference on Intelligent Autonomous Systems, pp. 115-122.
[10]
Dias, M.B. and Stentz, A., Multi-robot exploration controlled by a market economy. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2714-2720.
[11]
Dorn, C. and Dustdar, S., Composing near-optimal expert teams: A trade-off between skills and connectivity. In: Proceedings of the International Conference on Cooperative Information Systems, pp. 472-489.
[12]
dos Santos, Fernando and Bazzan, Ana L.C., Towards efficient multiagent task allocation in the robocup rescue: A biologically-inspired approach. J. Autonom. Agents Multi-Agent Syst. v22. 465-486.
[13]
Ferreira, P., Dos Santos, F., Bazzan, A.L., Epstein, D. and Waskow, S.J., RoboCup Rescue as multiagent task allocation among teams: experiments with task interdependencies. J. Autonom. Agents Multi-Agent Syst. v20. 421-443.
[14]
Gaston, M. and desJardins, M., Agent-organized networks for dynamic team formation. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 230-237.
[15]
Genter, K., Agmon, N. and Stone, P., Role-based ad hoc teamwork. In: Proceedings of the Plan, Activity, and Intent Recognition Workshop at the Twenty-Fifth Conference on Artificial Intelligence (PAIR-11),
[16]
George, J.M., Pinto, J., Sujit, P.B. and Sousa, J.B., Multiple UAV coalition formation strategies (extended abstract). In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 1503-1504.
[17]
Gerkey, B.P. and Mataric, M.J., A formal analysis and taxonomy of task allocation in multi-robot systems. J. Robot. Res. v23 i9. 939-954.
[18]
Isik, M., Stulp, F., Mayer, G. and Utz, H., Coordination without negotiation in teams of heterogeneous robots. In: Proceedings of the RoboCup International Symposium, pp. 355-362.
[19]
Karp, R.M., Reducibility among combinatorial problems. In: Complexity of Computer Computations, pp. 85-103.
[20]
Kitano, H., Tadokoro, S., Noda, I., Matsubara, H., Takahashi, T., Shinjou, A. and Shimada, S., RoboCup Rescue: Search and rescue in large-scale disasters as a domain for autonomous agents research. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pp. 739-743.
[21]
Kleiner, A., Brenner, M., Bräuer, T., Dornhege, C., Göbelbecker, M., Luber, M., Prediger, J., Stückler, J. and Nebel, B., Successful search and rescue in simulated disaster areas. In: RoboCup 2005: Robot Soccer World Cup IX, vol. 4020. pp. 323-334.
[22]
Lappas, T., Liu, K. and Terzi, E., Finding a team of experts in social networks. In: Proceedings of the International Conference on Knowledge Discovery and Data Mining, pp. 467-476.
[23]
Li, C. and Shan, M., Team formation for generalized tasks in expertise social networks. In: Proceedings of the International Conference on Social Computing, pp. 9-16.
[24]
Liemhetcharat, S. and Veloso, M., Mutual state capability-based role assignment model (extended abstract). In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 1509-1510.
[25]
Liemhetcharat, S. and Veloso, M., Modeling mutual capabilities in heterogeneous teams for role assignment. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3638-3644.
[26]
Liemhetcharat, S. and Veloso, M., Modeling and learning synergy for team formation with heterogeneous agents. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 365-375.
[27]
Liemhetcharat, S. and Veloso, M., Weighted synergy graphs for role assignment in ad hoc heterogeneous robot teams. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5247-5254.
[28]
Liemhetcharat, S. and Veloso, M., Forming an effective multi-robot team robust to failures. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5240-5245.
[29]
Liemhetcharat, S. and Veloso, M., Learning the synergy of a new teammate. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5246-5251.
[30]
Liemhetcharat, S. and Veloso, M., Synergy graphs for configuring robot team members. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 111-118.
[31]
Lim, C., Mamat, R. and Braunl, T., Market-based approach for multi-team robot cooperation. In: Proceedings of the International Conference on Autonomous Robots and Agents, pp. 62-67.
[32]
Michalak, T., Marciniak, D., Szamotulski, M., Rahwan, T., Wooldridge, M., McBurney, P. and Jennings, N., A logic-based representation for coalitional games with externalities. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 125-132.
[33]
Parker, L. and Tang, F., Building multirobot coalitions through automated task solution synthesis. Proc. IEEE. v94 i7. 1289-1305.
[34]
Rahwan, T., Michalak, T., Jennings, N., Wooldridge, M. and McBurney, P., Coalition formation with spatial and temporal constraints. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 257-263.
[35]
Ramchurn, S., Polukarov, M., Farinelli, A. and Truong, C., Coalition formation with spatial and temporal constraints. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 1181-1188.
[36]
http://roborescue.sourceforge.net/
[37]
Sandholm, T., Larson, K., Andersson, M., Shehory, O. and Tohme, F., Coalition structure generation with worst case guarantees. J. Artif. Intell. v111. 209-238.
[38]
Service, T. and Adams, J., Coalition formation for task allocation: theory and algorithms. J. Autonom. Agents Multi-Agent Syst. v22. 225-248.
[39]
Shehory, O. and Kraus, S., Task allocation via agent coalition formation. J. Artif. Intell. v101 i1-2. 165-200.
[40]
Stone, P., Kaminka, G., Kraus, S. and Rosenschein, J., Ad hoc autonomous agent teams: Collaboration without pre-coordination. In: Proceedings of the International Conference on Artificial Intelligence,
[41]
Leading a best-response teammate in an ad hoc team. In: Agent-Mediated Electronic Commerce: Designing Trading Strategies and Mechanisms for Electronic Markets, pp. 132-146.
[42]
Stone, P. and Kraus, S., To teach or not to teach? Decision making under uncertainty in ad hoc teams. In: Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 117-124.
[43]
Tang, F. and Parker, L., A complete methodology for generating multi-robot task solutions using ASyMTRe-D and market-based task allocation. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3351-3358.
[44]
Tosic, P. and Agha, G., Maximal clique based distributed coalition formation for task allocation in large-scale multi-agent systems. In: Proceedings of the International Workshop on Massively Multi-Agent Systems, pp. 104-120.
[45]
Vig, L. and Adams, J., Market-based multi-robot coalition formation. In: Proceedings of the International Symposium on Distributed Autonomous Robotics Systems, pp. 227-236.
[46]
Vig, L. and Adams, J., Coalition formation: From software agents to robots. J. Intell. Robot. Syst. v50. 85-118.
[47]
Wu, F., Zilberstein, S. and Chen, X., Online planning for ad hoc autonomous agent teams. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 439-445.
[48]
Zhang, Y. and Parker, L., Task allocation with executable coalitions in multirobot tasks. In: Proceedings of the IEEE International Conference on Robotics and Automation,
[49]
Zlot, R., Stentz, A., Dias, M.B. and Thayer, S., Multi-robot exploration controlled by a market economy. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3016-3023.

Cited By

View all
  • (2024)ULTRA: Exploring Team Recommendations in Two Geographies Using Open Data in Response to Call for ProposalsProceedings of the 7th Joint International Conference on Data Science & Management of Data (11th ACM IKDD CODS and 29th COMAD)10.1145/3632410.3632503(547-552)Online publication date: 4-Jan-2024
  • (2022)Concise Representations and Complexity of Combinatorial Assignment ProblemsProceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems10.5555/3535850.3536086(1714-1716)Online publication date: 9-May-2022
  • (2021)Exploration and Coordination of Complementary Multirobot Teams in a Hunter-and-Gatherer ScenarioComplexity10.1155/2021/90872502021Online publication date: 1-Jan-2021
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Artificial Intelligence
Artificial Intelligence  Volume 208, Issue
March, 2014
66 pages

Publisher

Elsevier Science Publishers Ltd.

United Kingdom

Publication History

Published: 01 March 2014

Author Tags

  1. Ad hoc
  2. Capability
  3. Heterogeneous
  4. Multi-agent
  5. Multi-robot
  6. Synergy
  7. Team formation

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 25 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)ULTRA: Exploring Team Recommendations in Two Geographies Using Open Data in Response to Call for ProposalsProceedings of the 7th Joint International Conference on Data Science & Management of Data (11th ACM IKDD CODS and 29th COMAD)10.1145/3632410.3632503(547-552)Online publication date: 4-Jan-2024
  • (2022)Concise Representations and Complexity of Combinatorial Assignment ProblemsProceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems10.5555/3535850.3536086(1714-1716)Online publication date: 9-May-2022
  • (2021)Exploration and Coordination of Complementary Multirobot Teams in a Hunter-and-Gatherer ScenarioComplexity10.1155/2021/90872502021Online publication date: 1-Jan-2021
  • (2021)A Comprehensive Review and a Taxonomy Proposal of Team Formation ProblemsACM Computing Surveys10.1145/346539954:7(1-33)Online publication date: 18-Jul-2021
  • (2021)Achieving Multitasking Robots in Multi-Robot Tasks2021 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48506.2021.9561474(8948-8954)Online publication date: 30-May-2021
  • (2020)A Dynamic Territorializing Approach for Multiagent Task AllocationComplexity10.1155/2020/81417262020Online publication date: 13-May-2020
  • (2020)Multiagent Task Allocation in Complementary TeamsComplexity10.1155/2020/17525712020Online publication date: 1-Jan-2020
  • (2019)Attacking Power Indices by Manipulating Player ReliabilityProceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3306127.3331738(538-546)Online publication date: 8-May-2019
  • (2019)Coalition Formation for Multi-agent Pursuit Based on Neural NetworkJournal of Intelligent and Robotic Systems10.1007/s10846-018-0893-695:3-4(887-899)Online publication date: 1-Sep-2019
  • (2018)Allocating Multiple Types of Tasks to Heterogeneous Agents Based on the Theory of Comparative AdvantageJournal of Robotics10.1155/2018/14087962018Online publication date: 1-Jan-2018
  • Show More Cited By

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media