Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1865909.1865938acmotherconferencesArticle/Chapter ViewAbstractPublication PagespermisConference Proceedingsconference-collections
research-article

Resilient behavior through controller self-diagnosis, adaptation and recovery

Published: 21 September 2009 Publication History

Abstract

We explore robot behavior recovery through a process akin to self-reflection. A robot contains two controllers: A primary "innate" reactive controller, and a secondary "reflective" controller that can observe, model and control the primary controller. The reflective controller adapts the innate controller without access to the innate controller's internal state or architecture. Instead, the reflective controller models the innate controller and then synthesizes input/output filters that adapt the innate controller's existing capabilities to new situations. The innate controller is subjected to a variety of sensory, motor, and internal control damage scenarios. The reflective controller diagnoses the level of failure using a self-model and the observed sensorimotor time-series data and is able to recover performance.

References

[1]
Bjorklund, A., Lindvall, O. 2000. Self-repair in the brain. Nature, 405, 892.
[2]
Bongard, J., Lipson, H. 2004. Automated damage diagnosis and recovery for remote robotics. In IEEE International Conference on Robotics and Automation. Proceedings. ICRA '04. 3545--3550.
[3]
Bongard, J., Lipson, H. 2004. Once more unto the breach: Co-evolving a robot and its simulator. In Artificial Life IX: Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems, 57--62.
[4]
Bongard, J., Zykov, V., Lipson, H. 2006. Resilient Machines Through Continuous Self-Modeling. Science, 314(5802):1118--1121.
[5]
Foote, A., Crystal, J. 2007. Metacognition in the Rat. Current Biology, 17(6):551--555.
[6]
Font, E., Desfilis, E., Pérez-Cañellas, M. M., García-Verdugo, J. M. 2001. Neurogenesis and neuronal regeneration in the adult reptilian brain. Brain Behav Evol, 58, 276--295.
[7]
Draganski, B., Gaser, C., Busch, V., Schuierer, G., Bogdahn, U., May, A., et al. 2004. Neuroplasticity: changes in grey matter induced by training. Nature, 427(6972), 311--2.
[8]
Hampton, R. 2001. Rhesus monkeys know when they remember. Proceedings of the National Academy of Sciences, 98(9):5359.
[9]
Horner, P. J., Gage, F. H. 2000. Regenerating the damaged central nervous system. Nature, 407(6807), 963--70.
[10]
Kempermann, G., van Praag, H., Gage, F. H. 2000. Activity-dependent regulation of neuronal plasticity and self repair. Progress in brain research, 127, 35--48.
[11]
Minsky, M. 1986. The society of mind. Simon & Schuster, Inc. New York, NY, USA.
[12]
Minsky, M. 2005. Interior grounding, reflection, and self-consciousness. In: Proceedings of International Conference on Brain, Mind and Society. Tohoku University, Japan.
[13]
Minsky, M. 2007. The Emotion Machine, Simon & Schuster Inc. New York, NY.
[14]
Nelson, T., Narens, L. 1990. Metamemory: A theoretical framework and new findings. The psychology of learning and motivation, 26:125--141.
[15]
Smith, J., Shields, W., Washburn, D. 2004. The comparative psychology of uncertainty monitoring and metacognition. Behavioral and Brain Sciences, 26(03):317--339.
[16]
Varela, F. G., Maturana, H. R., Uribe, R. 1974. Autopoiesis: the organization of living systems, its characterization and a model. Currents in Modern Biology, 5, 187.
[17]
Zagal, J. C., Ruiz-del-Solar, J., Palacios, A. G. 2008. Fitness based identification of a robot structure. In Artificial Life XI: Proceedings of the Eleventh International Conference on the Simulation and Synthesis of Living Systems. 733--740.
[18]
Zagal, J. C., Delpiano, J., Ruiz-del-Solar, J. 2009. Self-Modeling in humanoid soccer robots. Robotics and Autonomous Systems, 57(8), 819--827.
[19]
Zagal, J. C., Lipson, H. 2009. Self-Reflection in Evolutionary Robotics: Resilient Adaptation with a Minimum of Physical Exploration. In Proceedings of the 11th Genetic and Evolutionary Computation Conference, GECCO'09, Montreal, Canada. 2179--2188.
[20]
Zagal, J. C., Lipson, H. 2009. Towards Self-Reflecting Machines: Two-Minds in One Robot. In Proceedings of the 10th European Conference on Artificial Life. ECAL'09, Budapest.
[21]
Zupanc, G. K. 2006. Neurogenesis and neuronal regeneration in the adult fish brain. Journal of Comparative Physiology A: Neuroethology, Sensory, Neural, and Behavioral Physiology, 192, 649--670. Spring

Cited By

View all
  • (2021)Fault-Aware Robust Control via Adversarial Reinforcement Learning2021 IEEE 11th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER)10.1109/CYBER53097.2021.9588329(109-115)Online publication date: 27-Jul-2021
  • (2018)Experiments in Artificial Theory of Mind: From Safety to Story-TellingFrontiers in Robotics and AI10.3389/frobt.2018.000755Online publication date: 26-Jun-2018

Index Terms

  1. Resilient behavior through controller self-diagnosis, adaptation and recovery

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      PerMIS '09: Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
      September 2009
      322 pages
      ISBN:9781605587479
      DOI:10.1145/1865909
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      • NIST: National Institute of Standards and Technology

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 21 September 2009

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. damage recovery
      2. evolutionary robotics
      3. machine learning
      4. self-modeling
      5. self-reflection

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      PerMIS '09
      Sponsor:
      • NIST
      PerMIS '09: Performance Metrics for Intelligent Systems
      September 21 - 23, 2009
      Maryland, Gaithersburg

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)1
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 06 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)Fault-Aware Robust Control via Adversarial Reinforcement Learning2021 IEEE 11th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER)10.1109/CYBER53097.2021.9588329(109-115)Online publication date: 27-Jul-2021
      • (2018)Experiments in Artificial Theory of Mind: From Safety to Story-TellingFrontiers in Robotics and AI10.3389/frobt.2018.000755Online publication date: 26-Jun-2018

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media