Abstract
This paper presents a cognitive model for an action execution process—the sensory motor system (SMS)—as a new module of the system-level cognitive model for “Learning Intelligent Distribution Agent” (LIDA). Action execution refers to a situation in which a software agent or robot transforms a selected goal-directed action into low-level executable actions and executes them in the real world. A sensorimotor system derived from the subsumption architecture has been implemented into the SMS; several cognitive neuroscience hypotheses have been incorporated as well, including the two visual systems. A computational SMS has been created inside a LIDA-based software agent in Webots to model the execution of a grip action; its simulated results have been verified against human performance. This computational verification by the comparison of model and human behaviors supports the SMS as a qualitatively reasonable cognitive model for action execution. Finally, the SMS has been compared with other alternative models of action execution; this supports the assertion that our new action execution module is applicable across a range of cognitive architectures.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
For historical reasons, LIDA stands for Learning Intelligent Distribution Agent.
In this paper, we will only be concerned with the external environment, and not with LIDA’s internal environment.
In the LIDA Model, the concept of ventral and dorsal streams for the transmission of visual information has been extended to multimodal transmission.
Action learning is not yet implemented.
In LIDA, the dorsal stream channel directly passes sensory data from the sensory memory to the action execution process.
In this context, the term “action” refers to a component of a behavior. This differs from the general usage, such as in the phrase “action execution”. In this paper, we use “action” in the general sense, while “action of a behavior” refers to a particular component of that behavior.
‘An explicit desire to perform the action’ refers to a selected behavior; ‘a different mechanism’ is our SMS; and ‘the representation [that] loses its explicit character’ indicates executable motor commands.
In comparison with the original design 19.Connell JH. A colony architecture for an artificial creature. DTIC Document, 1989., the cradle level, the back module, and the edge module were removed in the simulation because either their function is substituted for by the Webots simulated environment, or they are irrelevant to the hand and arm actuators.
The Webots Supervisor "is a privileged type of Robot that can execute operations that can normally only be carried out by a human operator and not by a real robot” (www.cyberbotics.com). It is irrelevant to the machine learning concept of supervised learning.
There is only very limited direct connectivity between perceptual and motor modules. Spatial information in particular is communicated directly.
Although no central world state is one of the essences of the subsumption architecture, implicit understanding and expectation of the environment has been built into the architecture by its layered structure.
There is the learning of implicit knowledge (the back-propagation network) at the bottom level. “In this learning setting, there is no need for external teachers providing desired input/output mappings. This (implicit) learning method may be cognitively justified” [28].
References
Franklin S, Madl T, D’Mello S, Snaider J. LIDA: a systems-level architecture for cognition, emotion, and learning. IEEE Trans Auton Ment Dev. 2014;6(1):19–41.
Franklin S, Graesser A. Is it an agent, or just a program?: a taxonomy for autonomous agents. Intelligent agents III agent theories, architectures, and languages. Springer: London; 1997. p. 21–35.
Goodale MA, Milner AD. Separate visual pathways for perception and action. Trends Neurosci. 1992;15(1):20–5.
Milner D, Goodale MA. Two visual systems re-viewed. Neuropsychologia. 2008;46(3):774–85.
Goodale MA. Separate visual systems for perception and action: a framework for understanding cortical visual impairment. Dev Med Child Neurol. 2013;55(s4):9–12.
Goodale MA. How (and why) the visual control of action differs from visual perception. Proc R Soc B Biol Sci. 2014;281(1785):20140337.
Milner A. Is visual processing in the dorsal stream accessible to consciousness? Proc R Soc B Biol Sci. 2012;279(1737):2289–98.
Brooks RA. A robust layered control system for a mobile robot. IEEE J Robot Autom. 1986;2(1):14–23.
Brooks RA. How to build complete creatures rather than isolated cognitive simulators. Architectures for intelligence: the twenty-second carnegie mellon symposium on cognition. 1991. p. 225–39.
Maes P, Brooks RA. Learning to coordinate behaviors. In: Proceedings of the eighth national conference on artificial intelligence. Boston: Morgan Kaufmann; 1990. p. 796–802.
Mahadevan S, Connell J. Automatic programming of behavior-based robots using reinforcement learning. Artif Intell. 1992;55(2):311–65.
Wolpert DM, Diedrichsen J, Flanagan JR. Principles of sensorimotor learning. Nat Rev Neurosci. 2011;12(12):739–51.
Weng JJ. The developmental approach to intelligent robots. AAAI spring symposium series, integrating robotic research: taking next leap. Stanford; 1998.
Weng J. Developmental robotics: theory and experiments. Int J Humanoid Robot. 2004;1(02):199–236.
Franklin S, Strain S, Snaider J, McCall R, Faghihi U. Global workspace theory, its LIDA model and the underlying neuroscience. Biol Inspir Cognit Archit. 2012;1:32–43.
Baars BJ. A cognitive theory of consciousness. New York: Cambridge University Press; 1988.
Baars BJ. The conscious access hypothesis: origins and recent evidence. Trends Cognit Sci. 2002;6(1):47–52.
Baars BJ, Gage NM. Fundamentals of cognitive neuroscience: a beginner’s guide. London: Academic Press; 2013.
Connell JH. A colony architecture for an artificial creature. DTIC Document, 1989.
Brooks RA. Elephants don’t play chess. Robot Auton Syst. 1990;6(1):3–15.
Searle JR. Intentionality: an essay in the philosophy of mind. Cambridge: Cambridge University Press; 1983.
Jeannerod M. Motor cognition: what actions tell the self. Oxford: Oxford University Press; 2006.
De Vega M, Glenberg AM, Graesser AC. Symbols and embodiment: debates on meaning and cognition. Oxford: Oxford University Press; 2008.
Simon HA. The sciences of the artificial. Cambridge: The MIT Press; 1969.
Cutsuridis V, Taylor JG. A cognitive control architecture for the perception—action cycle in robots and agents. Cognit Comput. 2013;5(3):383–95.
Grafton ST. The cognitive neuroscience of prehension: recent developments. Exp Brain Res. 2010;204(4):475–91.
Snaider J, McCall R, Franklin S. The LIDA framework as a general tool for AGI. Artificial general intelligence. Berlin: Springer; 2011. p. 133–42.
Connell JH. A behavior-based arm controller. Robot Autom IEEE Trans. 1989;5(6):784–91.
Jeannerod M. Intersegmental coordination during reaching at natural visual objects. Atten Perform IX. 1981;9:153–68.
James TW, Culham J, Humphrey GK, Milner AD, Goodale MA. Ventral occipital lesions impair object recognition but not object-directed grasping: an fMRI study. Brain. 2003;126(11):2463–75.
Milner D, Perrett D, Johnston R, Benson P, Jordan T, Heeley D, et al. Perception and action in ‘visual form agnosia’. Brain. 1991;114(1):405–28.
Farnè A, Pavani F, Meneghello F, Làdavas E. Left tactile extinction following visual stimulation of a rubber hand. Brain. 2000;123(11):2350–60.
Jakobson L, Archibald Y, Carey D, Goodale MA. A kinematic analysis of reaching and grasping movements in a patient recovering from optic ataxia. Neuropsychologia. 1991;29(8):803–9.
Jeannerod M, Decety J, Michel F. Impairment of grasping movements following a bilateral posterior parietal lesion. Neuropsychologia. 1994;32(4):369–80.
Byrne MD, Anderson JR. Serial modules in parallel: the psychological refractory period and perfect time-sharing. Psychol Rev. 2001;108(4):847–69.
Laird JE. Extending the Soar cognitive architecture. Artificial general intelligence. Memphis: IOS Press; 2008. p. 224–35.
Laird JE, Congdon CB, Coulter KJ, Derbinsky N, Xu J. The soar user’s manual 9.4.0. 2014. http://web.eecs.umich.edu/~soar/downloads/Documentation/SoarManual.pdf. Accessed Dec 31.
Sun R. The CLARION cognitive architecture: extending cognitive modeling to social simulation. In: Sun R, editor. Cognition and multi-agent interaction. New York: Cambridge University Press; 2006. p. 79–99.
Sun R. A tutorial on CLARION 5.0. 2014. http://www.cogsci.rpi.edu/~rsun/sun.tutorial.pdf. Accessed Dec 31.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Dong, D., Franklin, S. A New Action Execution Module for the Learning Intelligent Distribution Agent (LIDA): The Sensory Motor System. Cogn Comput 7, 552–568 (2015). https://doi.org/10.1007/s12559-015-9322-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12559-015-9322-3