HOLISTIC SELF-REPROGRAMMING OF NEURAL NETWORKS: BETWEEN SELF-ORGANIZATION AND SELF-OBSERVATION
DOI:
https://doi.org/10.47839/ijc.5.3.409Keywords:
Learning, memory, plasticity and adaptation, self-organizing maps, stem cells, meiosis growth, entelechy, darwinian evolutionAbstract
Neural networks (NNs) are inspired – at least metaphorically –from biological solutions nature selected by evolution. On one hand, learning algorithms' efficacy has been widely demonstrated experimentally, even if the mathematical proof of their convergence is not always very easy to establish (SOM). On the other hand, biological mechanisms like brain wiring or embryology remain partly understood and how life or the bases of consciousness are related to the underlying biological substrate remains a total mystery. The same goes for memory. We don’t really know how information is stored in and recovered from biological neural structures. We therein paradoxically use complex systems, the hard core of which we still don't always fully understand, both regarding the models we build, as well as their former roots in the leaving world. In this theoretical paper, we resort to a few biological encoding schemata that bring insights into neural structures' growth, plasticity and reorganization, and we suggest reconsidering the metaphor in an adaptive developmental view.References
I. Ahmad. “Stem Cells: New Opportunities to Treat Eye Diseases”. Investigative Ophthalmology & Visual Science, 42(12), 2743-2748, November 2001.
E.A. Bates, J.L. Elman. Connectionnism and the study of change. In Mark Johnson (Ed.), Brain development and cognition: A reader (2nd ed.). Oxford: Blackwell Publishers, 2002.
U. Belllugi, E.S. Klima, P.P. Wang. Cognitive and neural development: Clues from genetically based syndromes. In D. Magnussen Ed., The life-span development of individuals: Behavioral, neurobiological, and psychological perspectives, a synthesis, Nobel Symposium, New-York, Cambridge University Press, 223-243, 1996.
H. Bergson. l'Evolution creatrice. 1907. Reedition PUF, 2003.
G. Bernard. Detection automatique de structures syntaxiques. In Procs. of the 8th Int. Symposium on Social Communication, Santiago de Cuba, 2003.
G. Bernard and J-J. Mariage. “Post processing of Grammatical patterns produced by Self Organizing Maps”. Procs. of PRIP'05 Conf., the 8th Int. Conf. on Pattern Recognition and Image Processing, Minsk, Belarus, may. 18-25, 412-415, 2005.
G.A. Carpenter, S. Grossberg, N. Markuzon, J.H. Reynolds, D.B. Rosen. “Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multi-dimensional maps”. IEEE Trans. on Neural Networks, 3, (5), 698-713, 1992.
D.A. Clark, P.P. Mitra and S.S-H. Wang. “Scalable architecture in mammalian brains”. Nature, 411, 189-193, 2001.
G.W. Cottrell, and M. Fleming. “Face recognition using unsupervised feature extraction”. In Proc. of the Int. Neural Network Conf., 322-325, Paris, France. Kluwer, 1990.
R. Dawkins, The selfish gene. Oxford University Press, 1989.
K. Emmorey, J.S. Allen, J. Bruss , N. Schenker, and H. Damasio. “A morphometric analysis of auditory brain regions in congenitally deaf adults”. Neuroscience, 100 (17), 10049–10054, 2003.
P.S. Erickson, E. Perfileva, T. Bjork-Erickson, A. Alborn, C. Nordborg, D. Peterson, F. Gage. “Neurogenesis in the adult human hippocampus”. Nature Medical, 11, 1313-1317, 1998.
P. Giraux, A. Sirigu, F. Schneider J-M. Dubernard. “Cortical reorganization in motor cortex after graft of both hands”. Nature Neuroscience, 4, 691-692, 2001.
M.P. Harris, S.M. Hasso, M.W.J. Fergusson, J.F. Fallon. “The development of archosaurian first generation teeth in a chicken mutant”. Current Biology, 16, 371-377, 2006.
J. Imitola, K. Raddassi, K.I. Park, F-J. Mueller, M. Nieto, Y.D. Teng, D. Frenkel, J. Li, R.L. Sidman, C.A. Walsh, E.Y. Snyder, S.J. Khoury. “Directed migration of neural stem cells to sites of CNS injury by the stromal cell-derived factor 1 ? /CXC chemokine receptor 4 pathway” Online Proc Natl Acad Sci USA, 101 (52), 18117–18122, 2004.
D. Irvin, X. Yuan, Z Zhaohui, P. Tunici, J.S. Yu. “Neural Stem Cells - A Promising Potential Therapy for Brain Tumors”. Current Stem Cell Research & Therapy, 1 (1), 79-84, 2006.
D.A. Kerr, 1 J. Llado, M.J. Shamblott, N.J. Maragakis, D.N. Irani, T.O. Crawford, C.Krishnan, S. Dike, J.D. Gearhart, J.D. Rothstein “Human Embryonic Germ Cell Derivatives Facilitate Motor Recovery of Rats with Diffuse Motor Neuron Injury” The Journal of Neuroscience, 23 (12), 5131–5140, 2003.
T. Kohonen “Self-Organized formation of topologically correct feature maps”. Biological Cybernetics, 43, 59-69, 1982.
T. Kohonen Self Organizing Maps, Springer, Heidelberg, 1995.
J-J. Kupiec. “La liberte molleculaire”. in Le monde selon Darwin, Sciences et avenir, Hors-serie, N° 134, 58-63, 2003.
G. Lendaris, and C. Paintz. “Training Strategies for Critic and Action Neural Networks in Dual Heuristic Programming Method”. In Procs. of ICNN'97, IEEE Int. Conf. on Neural Networks, Houston, TX, 712-717, 1997.
Laroche “Neuro-molage des souvenirs”. La memoire et l'oubli, comment naissent et s'effacent les souvenirs. La recherche N° 344, 20-24, 2001.
H. Lenhoff, P.P. Wang, F. Greenberg and U. Belllugi. “Le syndrome de Williams”. Pour la science, N° 244, 1998.
B.F. Madore, and W.L. Freedman. “Computer simulations of the Belousov-Zhabotinsky reaction”. Science, 222, 437-438, 1983.
B.F. Madore and W.L. Freedman “Self-organazing structures”. American Scientist, 75 (3), 252-259, 1987.
J-J. Mariage. From self organization to self observation. Ph.D. Dissertation, Department of Computing Science, AI Laboratory, Paris 8 University, 2001 (in French).
J-J. Mariage “Learning to teach to neural networks how to learn well with SOH, a Self Observing Heuristic”. Special Issue of the International Scientific Journal of Computing with the best papers of the ICNNAI’03 conference, vol. 3, n° 1, 58-65, 2003.
J-J. Mariage and G. Bernard “Automatic Categorization of Grammatical Strings”. Proceedings of the WSOM'03, Workshop on Self-Organizing Maps, Kitakyushu, Japan, sept. 11-14, 352-357, 2003.
J-J. Mariage et G. Bernard “Categorisation de patrons syntaxiques par Self Organizing Maps”. Actes de la 11eme conference sur le Traitement Automatique des Langues Naturelles, TALN 2004, Fes, Morocco, April 19-21, 279-288, 2004.
Morgan. Emergent Evolution, The Gifford Lec-tures, Williams and Norgate, London, 1923.
D.A. Prentice. “Current Science of regenerative Medicine with Stem Cells”, Journal of Investigative Medicine, 54(1), 2006.
I. Prigogine. From being to becoming: time and complexity in the physical sciences. Freeman, 1980.
I. Prigogine, I. Stengers. Order out of chaos: Man's new dialogue with nature. Bantam, 1984.
N. Raz, A. Amedi, and E. Zohary. “V1 Activation in Congenitally Blind Humans is Associated with Episodic Retrieval”. Cerebral Cortex, 15 (9), 1459-1468, 2005.
J. R. Searle. “Deux biologistes et un physicien en quete de l'ame”. La recherche, 287, 62-77, 1996.
R.B. Tootell, E. Switkes, M.S. Silverman, S.L. Hamilton. “Functional anatomy of macaque striate cortex. II. Retinotopic organization”. Journal of Neuroscience, 8, 1531-1568, 1988.
F.J. Varela. Cognitive Science. A cartography of current ideas, 1988.
F.J. Varela. The Embodied Mind: Cognitive science and human experience, MIT Press, Cambridge, 1991
D. Wicker, M.M. Rizki, and L.A. Tamburino. “E-Net: Evolutionary neural network synthesis” Neurocomputing, Special issue on Evolutionary Neural Systems, Vol. 42, I. 1-4, 171-196, 2002.
F. Worms. Bergson ou les deux sens de la vie. PUF, 2004.
Fly brains provide new insights into the growth and development of human nerve cells, Stanford Report, April 1, 2002. From http://news-service.stanford.edu/ accessed 03/02/2006.
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.