Abstract
Autonomous systems, often realized as multi-agent systems, are envisioned to deal with uncertain and dynamic environments. They are applied in dangerous situations, e.g. as rescue robots or to relieve humans from complex and tedious tasks like driving a car or infrastructure maintenance. But in order to further improve the technology a generic measurement and benchmarking of autonomy is required. Within this paper we present an improved understanding of autonomous systems. Based on this foundation we introduce our concept of a multi-dimensional autonomy metric framework that especially takes into account multi-system environments. Finally, our approach is illustrated by means of an example.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alonso, E., Mondragón, E.: Agency, learning and animal-based reinforcement learning. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 1–6. Springer, Heidelberg (2004)
Alonso, F., Fuertes, J.L., Martínez, L., Soza, H.: Towards a set of measures for evaluating software agent autonomy. In:Eighth Mexican International Conference on Artificial Intelligence, MICAI 2009, pp. 73–78. IEEE (2009)
Barber, K.S., Martin, C.E.: Agent autonomy: specification, measurement, and dynamic adjustment. In: Proceedings of the Autonomy Control Software Workshop at Autonomous Agents, vol. 1999, pp. 8–15. Citeseer (1999)
Barber, K.S., Park, J.: Agent belief autonomy in open multi-agent systems. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 7–16. Springer, Heidelberg (2004)
Bradshaw, J.M., Feltovich, P.J., Jung, H., Kulkarni, S., Taysom, W., Uszok, A.: Dimensions of adjustable autonomy and mixed-initiative interaction. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 17–39. Springer, Heidelberg (2004)
Carabelea, C., Boissier, O., Florea, A.: Autonomy in multi-agent systems: a classification attempt. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 103–113. Springer, Heidelberg (2004)
Carraway, G.F., Squibb, J.B.: Autonomy metrics. In: Proceedings of 4th International Symposium on Space Mission Operations and Ground Data Systems, vol. 2, Munich (1996)
Castelfranchi, C.: Guarantees for autonomy in cognitive agent architecture. In: Wooldridge, M.J., Jennings, N.R. (eds.) Intelligent Agents. Lecture Notes in Computer Science, vol. 890, pp. 56–70. Springer, Heidelberg (1995)
Castelfranchi, C., Falcone, R.: From automaticity to autonomy: the frontier of artificial agents. In: Hexmoor, H., Castelfranchi, C., Falcone, R. (eds.) Agent Autonomy. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol. 7, pp. 103–136. Springer, US (2003)
Delaroche, L., Fogel, D.F.L., Freeman, W., Grossbcrg, S., Lee, S., Lima, P., Pouchard, L., Schultz, A.: Measuring performance of systems with autonomy: metrics for intelligence of constructed systems. In: Measuring the Performance and Intelligence of Systems: Proceedings of the 2000 PerMIS Workshop, 14–16 August 2000, vol. 970, p. 4. The Institute (2001)
Dorais, G., Bonasso, R.P., Kortenkamp, D., Pell, B., Schreckenghost, D.: Adjustable autonomy for human-centered autonomous systems. In: Working notes ofthe Sixteenth International Joint Conference on Artificial Intelligence Workshopon Adjustable Autonomy Systems, pp. 16–35 (1999)
Gouaich, A.: Requirements for achieving software agents autonomy and definingtheir responsibility. In: Proceedings of Autonomy Workshop at AAMAS 2003, vol. 236 (2003)
Hinchey, M.G., Sterritt, R.: Self-managing software. Computer 39(2), 107–109 (2006)
Johnson, M., Bradshaw, J., Feltovich, P., Jonker, C., van Riemsdijk, B., Sierhuis, M.: Autonomy and interdependence in human-agent-robot teams. IEEE Intell. Syst. 27(2), 43–51 (2012)
Kephart, J.O., Chess, D.M.: The vision of autonomic computing. Computer 36(1), 41–50 (2003)
Luck, M., D’Inverno, M., Munroe, S.: Autonomy: variable and generative. In: Hexmoor, H., Castelfranchi, C., Falcone, R. (eds.) AUTONOMY 2003. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol. 7, pp. 11–28. Springer, Heidelberg (2003)
Maheswaran, R.T., Tambe, M., Varakantham, P., Myers, K.: Adjustable autonomy challenges in personal assistant agents: a position paper. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 187–194. Springer, Heidelberg (2004)
Myers, K., Berry, P., Blythe, J., Conley, K., Gervasio, M., McGuinness, D., Morley, D., Pfeffer, A., Pollack, M., Tambe, M.: An intelligent personal assistant for task and time management. AI Mag. 28(2), 47–61 (2007)
Myers, K.L., Morley, D.N.: Policy-based agent directability. In: Hexmoor, H., Castelfranchi, C., Falcone, R. (eds.) Agent Autonomy. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol. 7, pp. 185–209. Springer, Heidelberg (2003)
Olsen, D.R., Goodrich, M.A.: Metrics for evaluating human-robot interactions. In: Proceedings of PERMIS, vol. 2003, p. 4 (2003)
Rudas, I.J., Fodor, J.: Intelligent systems. Int. J. Comput. Commun. Control 3(3), 132–138 (2008)
Salehie, M., Tahvildari, L.: Self-adaptive software: landscape and research challenges. ACM Trans. Auton. Adapt. Syst. 4(2), 1–42 (2009)
Scerri, P., Pynadath, D., Tambe, M.: Adjustable autonomy in real-world multi-agent environments. In: Proceedings of the Fifth International Conference on Autonomous Agents, AGENTS 2001, pp. 300–307. ACM, New York (2001)
Schillo, M., Fischer, K.: A taxonomy of autonomy in multiagent organisation. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 68–82. Springer, Heidelberg (2004)
Schmeck, H.: Organic computing - a new vision for distributed embedded systems. In: 8th IEEE International Symposium on Object-Oriented Real-Time Distributed Computing (ISORC), pp. 201–203, May 2005
Shannon, C.: A mathematical theory of communication. Bell Syst. Tech. J., 27, 379–423, 623–656, July, October 1948
Sierhuis, M., Bradshaw, J.M., Acquisti, A., Van Hoof, R., Jeffers, R., Uszok, A.: Human-agent teamwork and adjustable autonomy in practice. In: Proceedings of the Seventh International Symposium on Artificial Intelligence, Robotics and Automation in Space (I-SAIRAS) (2003)
Tambe, M., Scerri, P., Pynadath, D.V.: Adjustable autonomy for the real world. J. Artif. Intell. Res. 17(1), 171–228 (2002)
Ulrich, I.R., Mondada, F., Nicoud, J.D.: Autonomous vacuum cleaner. Robot. Auton. Syst. 19, 4–233 (1997)
Verhagen, H.: Autonomy and reasoning for natural and artificial agents. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 83–94. Springer, Heidelberg (2004)
Weiß, G., Rovatsos, M., Nickles, M.: Capturing agent autonomy in roles and xml. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2003, pp. 105–112. ACM, New York (2003)
Yavnai, A.: Entropy-based criteria for intelligent autonomous systems. In: Proceedings of the 1991 IEEE International Symposium on Intelligent Control, pp. 55–60, August 1991
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Hrabia, CE., Masuch, N., Albayrak, S. (2015). A Metrics Framework for Quantifying Autonomy in Complex Systems. In: Müller, J., Ketter, W., Kaminka, G., Wagner, G., Bulling, N. (eds) Multiagent System Technologies . MATES 2015. Lecture Notes in Computer Science(), vol 9433. Springer, Cham. https://doi.org/10.1007/978-3-319-27343-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-27343-3_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27342-6
Online ISBN: 978-3-319-27343-3
eBook Packages: Computer ScienceComputer Science (R0)