Nothing Special   »   [go: up one dir, main page]

Skip to main content

FPGA Implementation of Neuron Model Using Piecewise Nonlinear Function on Double-Precision Floating-Point Format

  • Conference paper
  • First Online:
Trends in Applied Knowledge-Based Systems and Data Science (IEA/AIE 2016)

Abstract

The artificial neurons model has been implemented in a field programmable gate array (FPGA). The neuron model can be applied to learning, training of neural networks; all data types are 64 bits, and first and second-order functions is employed to approximate the sigmoid function. The constant values of the model are tuned to provide a sigmoid-like approximate function which is both continuous and continuously differentiable. All data types of the neuron are corresponding to double precision in C language. The neuron implementation is expressed in 48-stage pipeline. Assessment with an Altera Cyclone IV predicts an operating speed of 85 MHz. Simulation of 4 neurons neural network on FPGA obtained chaotic behavior. An FPGA output chaos influenced by calculation precision and characteristics of the output function. The circuit is the estimation that above 1,000 neurons can implement in Altera Cyclone IV. It shows the effectiveness of this FPGA model to have obtained the chaotic behavior where nonlinearity infuences greatly. Therefore, this model shows wide applied possibility.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Russell, B., Tom, B.: Neural Computing: An Introduction. Adam Hilger, Bristol (1990)

    Google Scholar 

  2. Fredric, M.H., Ivica, K.: Principles of Neurocomputing for Science & Engineering. McGraw-Hill, Singapore (2000)

    Google Scholar 

  3. Sandhya, S.: Neural Networks for Applied Sciences and engineering. Auerbach Publications, New York (2006)

    MATH  Google Scholar 

  4. Rafael G., Joaquin C., Joaquin C., Francisco B., Francisco B., Antonio M.S., Antonio M.S.: Artificial neural network implementation on a single FPGA of a pipelined on-line backpropagation. In: Proceedings of the 13th International Symposium on System Synthesis, pp. 225–230 (2000)

    Google Scholar 

  5. Kwan, H.K., Tang, C.Z.: Multiplierless multilayer feedforward neural network design using quantised neurons. Electron. Lett. 38(13), 645–646 (2002)

    Article  Google Scholar 

  6. Basterretxea, K., Tarela, J.M., del Campo, I.: Digital design of sigmoid approximator for artificial neural networks. Electron. Lett. 38(1), 35–37 (2002)

    Article  Google Scholar 

  7. Sledevic, T., Navakauskas, D.: The lattice-ladder neuron and its training circuit implementation in FPGA. In: 2014 IEEE 2nd Workshop on Advances in Information, Electronic and Electrical Engineering (AIEEE), pp. 1–4 (2014)

    Google Scholar 

  8. Abrol, S., Mahajan, R.: Implementation of single artificial neuron using various activation functions and XOR Gate on FPGA chip. In: 2015 Second International Conference on, Advances in Computing and Communication Engineering (ICACCE), pp. 118–123 (2015)

    Google Scholar 

  9. Kawamura, S., Nakanishi, T., Yoshida, H., Ozeki, K., Fujimaki, K., Gotoh, R.: Studies on the accuracy of numerical operations with embedded CPUs. IEICE Electron. Express 3(8), 149–155 (2006)

    Article  Google Scholar 

  10. Kawamura, S., Yoshida, H., Miura, M.: Minimum constituents of chaos neural network composed of conventional neurons. Electron. Commun. Jpn. Part III 86(7), 62–71 (2003)

    Article  Google Scholar 

  11. Yoshida, H., Murakami, T., Zhongda, L.: High-speed and highly secure pseudo-random number generator based on chaos neural network. Front. Artif. Intell. Appl. 276, 224–237 (2015)

    Google Scholar 

  12. Rukhin, A., Soto, J., Nechvatal, J., Smid, M., Barker, E., Leigh, S., Levenson, M., Vangel, M., Banks, D., Heckert, A., Dray, J., Vo, S.: A Statistical Test Suite for Random and Pseudorandom Number Generators for Cryptographic Applications, NIST SP800-22 rev.1a, Revised: July 2015 (sts-2.1.1). Lawrence E. Bassham III (2015)

    Google Scholar 

  13. Mario, M.: Introduction to Discrete Dynamical Systems and Chaos. Wiley InterScience, New York (1999)

    MATH  Google Scholar 

  14. Henry, D.I.A.: Analysis of Observed Chaotic Data. Springer, New York (1997)

    Google Scholar 

Download references

Acknowledgments

This study was supported by a grant from the Yume-Kendo Dream-Land Iwate Foundation of the Iwate Prefecture. We thanks to Dr. Takeshi Murakami for his support who participated in the experiment. The calculations in this study have partly performed with the SGI UV-100 in Iwate University Super-Computing and Information Sciences Center (ISIC). Special thanks to the stuff members of ISIC.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Satoshi Kawamura .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Kawamura, S., Saito, M., Yoshida, H. (2016). FPGA Implementation of Neuron Model Using Piecewise Nonlinear Function on Double-Precision Floating-Point Format. In: Fujita, H., Ali, M., Selamat, A., Sasaki, J., Kurematsu, M. (eds) Trends in Applied Knowledge-Based Systems and Data Science. IEA/AIE 2016. Lecture Notes in Computer Science(), vol 9799. Springer, Cham. https://doi.org/10.1007/978-3-319-42007-3_54

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42007-3_54

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42006-6

  • Online ISBN: 978-3-319-42007-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics