research-article

Online learning in SNNs with e-prop and Neuromorphic Hardware

Authors:

Sara Summerton,

Oliver RhodesAuthors Info & Claims

NICE '22: Proceedings of the 2022 Annual Neuro-Inspired Computational Elements Conference

Pages 32 - 39

https://doi.org/10.1145/3517343.3517352

Published: 03 May 2022 Publication History

Abstract

Online learning in neural networks has the potential to transform AI research. By enabling new information to be assimilated into existing systems, platforms can be adaptive to unseen data and can personalise performance to an individual. A common approach in providing AI to a user is to send queries to a remote cloud service which processes the information and sends back a response. Neuromorphic hardware offers an alternate solution by providing a dedicated computing platform from which neural networks can be run locally and efficiently. This work explores the potential of the SpiNNaker neuromorphic hardware to run the eligibility propagation (e-prop) algorithm on chip whilst learning online in real time.

References

[1]

Guillaume Bellec, Darjan Salaj, Anand Subramoney, Robert Legenstein, and Wolfgang Maass. 2018. Long short-term memory and learning-to-learn in networks of spiking neurons. (2018). arxiv:1803.09574http://arxiv.org/abs/1803.09574

[2]

Guillaume Bellec, Franz Scherr, Elias Hajek, Darjan Salaj, Robert Legenstein, and Wolfgang Maass. 2019. Biologically inspired alternatives to backpropagation through time for learning in recurrent neural nets. arXiv preprint (2019), 1–34. arxiv:2553450 [arXiv:submit]

[3]

Guillaume Bellec, Franz Scherr, Anand Subramoney, Elias Hajek, Darjan Salaj, Robert Legenstein, and Wolfgang Maass. 2020. A solution to the learning dilemma for recurrent networks of spiking neurons. Nature communications 11, 1 (2020), 1–15.

[4]

Petruţ A. Bogdan, Beatrice Marcinnò, Claudia Casellato, Stefano Casali, Andrew G.D. Rowley, Michael Hopkins, Francesco Leporati, Egidio D’Angelo, and Oliver Rhodes. 2021. Towards a Bio-Inspired Real-Time Neuromorphic Cerebellum. Frontiers in Cellular Neuroscience 15 (2021), 130. https://doi.org/10.3389/fncel.2021.622870

[5]

I. M. Comsa, T. Fischbacher, K. Potempa, A. Gesmundo, L. Versari, and J. Alakuijala. 2020. Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function. In ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 8529–8533.

[6]

Andrew P Davison, Daniel Brüderle, Jochen Eppler, Jens Kremkow, Eilif Muller, Dejan Pecevski, Laurent Perrinet, and Pierre Yger. 2008. PyNN: a common interface for neuronal network simulators. Frontiers in Neuroinformatics 2, January (2008), 11. https://doi.org/10.3389/neuro.11.011.2008

[7]

Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the thirteenth international conference on artificial intelligence and statistics. JMLR Workshop and Conference Proceedings, 249–256.

[8]

Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-term Memory. Neural computation 9 (12 1997), 1735–80. https://doi.org/10.1162/neco.1997.9.8.1735

Digital Library

[9]

Dongsung Huh and Terrence J Sejnowski. 2018. Gradient descent for spiking neural networks. (2018), 1433–1443.

[10]

Jacques Kaiser, Hesham Mostafa, and Emre Neftci. 2018. Synaptic plasticity dynamics for deep continuous local learning. arXiv preprint arXiv:1811.10766(2018).

[11]

Chankyu Lee, Syed Shakib Sarwar, and Kaushik Roy. 2019. Enabling Spike-based Backpropagation in State-of-the-art Deep Neural Network Architectures. CoRR abs/1903.06379(2019). arxiv:1903.06379http://arxiv.org/abs/1903.06379

[12]

Jun Haeng Lee, Tobi Delbruck, and Michael Pfeiffer. 2016. Training Deep Spiking Neural Networks Using Backpropagation. Frontiers in Neuroscience 10 (2016), 508. https://doi.org/10.3389/fnins.2016.00508

[13]

Timothy P. Lillicrap, Daniel Cownden, Douglas B. Tweed, and Colin J. Akerman. 2016. Random synaptic feedback weights support error backpropagation for deep learning. Nature Communications 7(2016), 1–10. https://doi.org/10.1038/ncomms13276 arxiv:arXiv:1411.0247v1

[14]

Wolfgang Maass. 1997. Networks of spiking neurons: The third generation of neural network models. Neural Networks 10, 9 (1997), 1659–1671. https://doi.org/10.1016/S0893-6080(97)00011-7

[15]

Carver Mead. 1989. Analog VLSI and Neural Systems. Addison-Wesley Longman Publishing Co., Inc.

[16]

Ari S Morcos and Christopher D Harvey. 2016. History-dependent variability in population dynamics during evidence accumulation in cortex. Nature neuroscience 19, 12 (2016), 1672–1681.

[17]

H. Mostafa. 2018. Supervised Learning Based on Temporal Coding in Spiking Neural Networks. IEEE Transactions on Neural Networks and Learning Systems 29, 7 (July 2018), 3227–3235. https://doi.org/10.1109/TNNLS.2017.2726060

[18]

Javier Navaridas, Mikel Luján, Luis A Plana, Steve Temple, and Steve Byram Furber. 2015. SpiNNaker: Enhanced multicast routing. Parallel Comput. 45(2015), 49–66. https://doi.org/10.1016/j.parco.2015.01.002

Digital Library

[19]

Emre O Neftci, Hesham Mostafa, and Friedemann Zenke. 2019. Surrogate gradient learning in spiking neural networks. arXiv preprint arXiv:1901.09948(2019).

[20]

Eustace Painkras, Luis A Plana, Jim Garside, Steve Temple, Francesco Galluppi, Cameron Patterson, David Roland Lester, Andrew D Brown, and Steve Byram Furber. 2013. SpiNNaker: A 1-W 18-core system-on-chip for massively-parallel neural network simulation. IEEE Journal of Solid-State Circuits 48, 8 (2013), 1943–1953. https://doi.org/10.1109/JSSC.2013.2259038

[21]

Oliver Rhodes, Petruţ A. Bogdan, Christian Brenninkmeijer, Simon Davidson, Donal Fellows, Andrew Gait, David R. Lester, Mantas Mikaitis, Luis A. Plana, Andrew G. D. Rowley, Alan B. Stokes, and Steve B. Furber. 2018. sPyNNaker: A Software Package for Running PyNN Simulations on SpiNNaker. Frontiers in Neuroscience 12, November (2018). https://doi.org/10.3389/fnins.2018.00816

[22]

Oliver Rhodes, Luca Peres, Andrew G.D. D. Rowley, Andrew Gait, Luis A. Plana, Christian Brenninkmeijer, and Steve B. Furber. 2020. Real-time cortical simulation on neuromorphic hardware. Phil. Trans. R. Soc. A 378 (2020), 20190160. https://doi.org/10.1098/rsta.2019.0160

[23]

Andrew G. D. Rowley, Christian Brenninkmeijer, Simon Davidson, Donal Fellows, Andrew Gait, David R. Lester, Luis A. Plana, Oliver Rhodes, Alan B. Stokes, and Steve B. Furber. 2019. SpiNNTools: The Execution Engine for the SpiNNaker Platform. Frontiers in Neuroscience 13 (2019), 231. https://doi.org/10.3389/fnins.2019.00231

[24]

Sumit Bam Shrestha and Garrick Orchard. 2018. SLAYER: Spike Layer Error Reassignment in Time. (2018), 1412–1421. http://papers.nips.cc/paper/7415-slayer-spike-layer-error-reassignment-in-time.pdf

[25]

Timo C. Wunderlich and Christian Pehle. 2020. EventProp: Backpropagation for Exact Gradients in Spiking Neural Networks. (2020). arxiv:2009.08378 [q-bio.NC]

[26]

Friedemann Zenke and Surya Ganguli. 2018. SuperSpike: Supervised Learning in Multilayer Spiking Neural Networks. Neural Computation 30, 6 (2018), 1514–1541. https://doi.org/10.1162/neco_a_01086 arXiv:https://doi.org/10.1162/neco_a_01086PMID: 29652587.

Digital Library

Cited By

Hamburg SJimenez Rodriguez AHtet ADi Nuovo A(2024)Active Inference for Learning and Development in Embodied Neuromorphic AgentsEntropy10.3390/e2607058226:7(582)Online publication date: 9-Jul-2024
https://doi.org/10.3390/e26070582
Tang GVadivel KXu YBilgic RShidqi KDetterer PTraferro SKonijnenburg MSifalakis Mvan Schaik GYousefzadeh A(2023)SENECA: building a fully digital neuromorphic processor, design trade-offs and challengesFrontiers in Neuroscience10.3389/fnins.2023.118725217Online publication date: 23-Jun-2023
https://doi.org/10.3389/fnins.2023.1187252
Li EMa HAhmed MTao TGu ZChen MChen QLi DChen W(2023)An Electromagnetic Perspective of Artificial Intelligence Neuromorphic ChipsElectromagnetic Science10.23919/emsci.2023.00151:3(1-18)Online publication date: Sep-2023
https://doi.org/10.23919/emsci.2023.0015
Show More Cited By

Recommendations

An unsupervised neuromorphic clustering algorithm

Brains perform complex tasks using a fraction of the power that would be required to do the same on a conventional computer. New neuromorphic hardware systems are now becoming widely available that are intended to emulate the more power efficient, ...
Algorithm and Application Impacts of Programmable Plasticity in Spiking Neuromorphic Hardware
ICONS '23: Proceedings of the 2023 International Conference on Neuromorphic Systems

Synaptic plasticity has long been thought to be key to learning in both biological neural networks and artificial neural networks. There are a wide array of plasticity rules in biological neural systems, but neuromorphic computing has mainly focused ...
Sparse Vector Binding on Spiking Neuromorphic Hardware Using Synaptic Delays
ICONS '22: Proceedings of the International Conference on Neuromorphic Systems 2022

Vector Symbolic Architectures (VSA) were first proposed as connectionist models for symbolic reasoning, leveraging parallel and in-memory computing in brains and neuromorphic hardware that enable low-power, low-latency applications. Symbols are defined ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

NICE '22: Proceedings of the 2022 Annual Neuro-Inspired Computational Elements Conference

March 2022

122 pages

ISBN:9781450395595

DOI:10.1145/3517343

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 May 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

European Commission

Conference

NICE 2022

NICE 2022: Neuro-Inspired Computational Elements Conference

March 28 - April 1, 2022

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 25 of 40 submissions, 63%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
336
Total Downloads

Downloads (Last 12 months)102
Downloads (Last 6 weeks)5

Reflects downloads up to 02 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hamburg SJimenez Rodriguez AHtet ADi Nuovo A(2024)Active Inference for Learning and Development in Embodied Neuromorphic AgentsEntropy10.3390/e2607058226:7(582)Online publication date: 9-Jul-2024
https://doi.org/10.3390/e26070582
Tang GVadivel KXu YBilgic RShidqi KDetterer PTraferro SKonijnenburg MSifalakis Mvan Schaik GYousefzadeh A(2023)SENECA: building a fully digital neuromorphic processor, design trade-offs and challengesFrontiers in Neuroscience10.3389/fnins.2023.118725217Online publication date: 23-Jun-2023
https://doi.org/10.3389/fnins.2023.1187252
Li EMa HAhmed MTao TGu ZChen MChen QLi DChen W(2023)An Electromagnetic Perspective of Artificial Intelligence Neuromorphic ChipsElectromagnetic Science10.23919/emsci.2023.00151:3(1-18)Online publication date: Sep-2023
https://doi.org/10.23919/emsci.2023.0015
Rostami AVogginger BYan YMayr C(2022)E-prop on SpiNNaker 2: Exploring online learning in spiking RNNs on neuromorphic hardwareFrontiers in Neuroscience10.3389/fnins.2022.101800616Online publication date: 28-Nov-2022
https://doi.org/10.3389/fnins.2022.1018006

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents