Abstract
We seek to develop a new generation of brain-machine interfaces (BMI) that enable both the user and the computer to engage in a symbiotic relationship where they must co-adapt to each other to solve goal-directed tasks. Such a framework would allow the possibility real-time understanding and modeling of brain behavior and adaptation to a changing environment, a major departure from either offline learning and static models or one-way adaptive models in conventional BMIs. To achieve a symbiotic architecture requires a computing infrastructure that can accommodate multiple neural systems, respond within the processing deadlines of sensorimotor information, and can provide powerful computational resources to design new modeling approaches. To address these issues we present or ongoing work in the development of a neurophysiology Cyberworkstation for BMI design.
Chapter PDF
Similar content being viewed by others
References
Buzsáki, G.: Rhythms of the Brain. Oxford University Press, New York (2006)
Kim, S.P., Sanchez, J.C., Rao, Y.N., Erdogmus, D., Principe, J.C., Carmena, J.M., Lebedev, M.A., Nicolelis, M.A.L.: A Comparison of Optimal MIMO Linear and Nonlinear Models for Brain-Machine Interfaces. J. Neural Engineering 3, 145–161 (2006)
Brown, E.N., Kass, R.E., Mitra, P.P.: Multiple Neural Spike Train Data Analysis: State-of-the-art and Future Challenges. Nature Neuroscience 7, 456–461 (2004)
Serruya, M.D., Hatsopoulos, N.G., Paninski, L., Fellows, M.R., Donoghue, J.P.: Brain-machine interface: Instant neural control of a movement signal. Nature 416, 141–142 (2002)
Wessberg, J., Stambaugh, C.R., Kralik, J.D., Beck, P.D., Laubach, M., Chapin, J.K., Kim, J., Biggs, S.J., Srinivasan, M.A., Nicolelis, M.A.L.: Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408, 361–365 (2000)
Helms Tillery, S.I., Taylor, D.M., Schwartz, A.B.: Training in cortical control of neuroprosthetic devices improves signal extraction from small neuronal ensembles. Reviews in the Neurosciences 14, 107–119 (2003)
Moran, D.W., Schwartz, A.B.: Motor cortical representation of speed and direction during reaching. Journal of Neurophysiology 82, 2676–2692 (1999)
Taylor, D.M., Tillery, S.I.H., Schwartz, A.B.: Direct cortical control of 3D neuroprosthetic devices. Science 296, 1829–1832 (2002)
Wu, W., Black, M.J., Gao, Y., Bienenstock, E., Serruya, M., Donoghue, J.P.: Inferring hand motion from multi-cell recordings in motor cortex using a Kalman filter. In: SAB Workshop on Motor Control in Humans and Robots: on the Interplay of Real Brains and Artificial Devices, University of Edinburgh, Scotland, pp. 66–73 (2002)
Chapin, J.K., Moxon, K.A., Markowitz, R.S., Nicolelis, M.A.: Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nature Neuroscience 2, 664–670 (1999)
Gao, Y., Black, M.J., Bienenstock, E., Wu, W., Donoghue, J.P.: A quantitative comparison of linear and non-linear models of motor cortical activity for the encoding and decoding of arm motions. In: The 1st International IEEE EMBS Conference on Neural Engineering, Capri, Italy (2003)
Sanchez, J.C., Kim, S.P., Erdogmus, D., Rao, Y.N., Principe, J.C., Wessberg, J., Nicolelis, M.A.L.: Input-output mapping performance of linear and nonlinear models for estimating hand trajectories from cortical neuronal firing patterns. In: International Work on Neural Networks for Signal Processing, Martigny, Switzerland, pp. 139–148 (2002)
Calvin, W.H.: The emergence of intelligence. Scientific American 9, 44–51 (1990)
Fuster, J.M.: Upper processing stages of the perception-action cycle. Trends in Cognitive Sciences 8, 143–145 (2004)
Rangel, A., Cramerer, C., Montague, P.R.: A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience 9, 545–556 (2008)
Edelman, G.M., Mountcastle, V.B.: Neurosciences Research Program. In: The mindful brain: cortical organization and the group-selective theory of higher brain function. MIT Press, Cambridge (1978)
Dayan, P., Niv, Y., Seymour, B., Daw, N.D.: The misbehavior of value and the discipline of the will. Neural Networks 19, 1153–1160 (2006)
Jackson, A., Mavoori, J., Fetz, E.E.: Long-term motor cortex plasticity induced by an electronic neural implant. Nature 444, 56–60 (2006)
Kleim, J.A., Barbay, S., Nudo, R.J.: Functional reorganization of the rat motor cortex following motor skill learning. Journal of Neurophysiology 80, 3321–3325 (1998)
Rioult-Pedotti, M.S., Friedman, D., Hess, G., Donoghue, J.P.: Strengthening of horizontal cortical connections following skill learning. Nature Neuroscience 1, 230–234 (1998)
Schultz, W.: Multiple reward signals in the brain. Nature Reviews Neuroscience 1, 199–207 (2000)
Sutton, R.S., Barto, A.G.: Reinforcement learning: an introduction. The MIT Press, Cambridge (1998)
Doya, K., Samejima, K., Katagiri, K., Kawato, M.: Multiple model-based reinforcement learning. Neural Computation 14, 1347–1369 (2002)
Rivest, F., Bengio, Y., Kalask, J.: Brain Inspired reinforcement learning, in NIPS, Vancouver, CA (2004)
Jong, N., Stone, P.: Kernel Based models for reinforcement learning. In: Proc. ICML Workshop on Kernel machines for Reinforcement Learning, Pittsburgh, PA (2006)
Sutton, R.S., Barto, A.G.: Reinforcement learning: an introduction. MIT Press, Cambridge (1998)
Worgotter, F., Porr, B.: Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms. Neural Computation 17, 245–319 (2005)
DiGiovanna, J., Mahmoudi, B., Fortes, J., Principe, J.C., Sanchez, J.C.: Co-adaptive Brain Machine Interface via Reinforcement Learning. In: IEEE Transactions on Biomedical Engineering (Special issue on Hybrid Bionics) (2008) (in press)
Zhao, M., Rattanatamrong, P., DiGiovanna, J., Mahmoudi, B., Figueiredo, R.J., Sanchez, J.C., Principe, J.C., Fortes, J.C.: BMI Cyberworkstation: Enabling Dynamic Data-Driven Brain-Machine Interface Research through Cyberinfrastructure. In: IEEE International Conference of the Engineering in Medicine and Biology Society, Vancouver, Canada, pp. 646–649 (2008)
Wolpert, D., Kawato, M.: Multiple paired forward inverse models for motor control. Neural Networks 11, 1317–1329 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sanchez, J.C., Figueiredo, R., Fortes, J., Principe, J.C. (2009). Development of Symbiotic Brain-Machine Interfaces Using a Neurophysiology Cyberworkstation. In: Jacko, J.A. (eds) Human-Computer Interaction. Novel Interaction Methods and Techniques. HCI 2009. Lecture Notes in Computer Science, vol 5611. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02577-8_66
Download citation
DOI: https://doi.org/10.1007/978-3-642-02577-8_66
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02576-1
Online ISBN: 978-3-642-02577-8
eBook Packages: Computer ScienceComputer Science (R0)