Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Adaptive annealing learning algorithm-based robust wavelet neural networks for function approximation with outliers

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

In this study, a robust wavelet neural network (WNN) is proposed to approximate functions with outliers. In the proposed methodology, firstly, support vector machine with wavelet kernel function (WSVM) is adopted to determine the initial translation and dilation of a wavelet kernel and the weights of WNNs. Then, an adaptive annealing learning algorithm (AALA) is adopted to accommodate the translations, the dilations, and the weights of the WNNs. In the learning procedure, the AALA is proposed to overcome the problems of initialization and the cut-off points in the robust learning algorithm. Hence, when an initial structure of the WNNs is determined by a support vector regression (SVR) approach, the WNNs with AALA (AALA-WNNs) have fast convergence speed and can robust against outliers. Two examples are simulated to verify the feasibility and efficiency of the proposed algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Chuang CC, Jeng JT, Lin PT (2004) Annealing robust radial basis function networks for function approximation with outliers. Neurocomputing 56:123–139

    Article  Google Scholar 

  2. Tsai HH, Yu PT (2000) On the optimal design of fuzzy neural networks with robust learning for function approximation. IEEE transactions on systems, man, and cybernetics– part B. Cybernetics 30(1):217–223

    Google Scholar 

  3. Wang WY, Lee TT, Liu CL, Wang CH (1997) Function approximation using fuzzy neural networks with robust learning algorithm, IEEE transactions on systems, man, and cybernetics-part B. Cybernetics 27:740–747

    Google Scholar 

  4. Hawkins DM (1980) Identification of Outliers. Chapman & Hall, London

    Book  MATH  Google Scholar 

  5. Park J, Sandberg IW (1993) Approximation and radial basis function networks. Neural Comput 5:305–316

    Article  Google Scholar 

  6. SWanchez A VD (1998), Special Issue on the RBF Networks: Part I and Part II. Neurocomputing 19-20

  7. Kosko B (1992) A Dynamical Systems Approach to Machine Intelligence. Prentice-Hall, Englewood Cliffs, NJ

    MATH  Google Scholar 

  8. Lee CC, Chung PC, Tsai JR, Chang CI (1999) Robust radial basis function neural networks. IEEE transactions on systems, man, and cybernetics-part B: Cybernetics 29(6):674–685

    Google Scholar 

  9. SWanchez AVD (1995) Robustization of learning method for RBF networks. Neurocomputing 9:85–94

    Article  Google Scholar 

  10. Chuang CC, Su SF, Hsiao CC (2000) The annealing robust backpropagation (BP) learning algorithm. IEEE Trans Neural Networks 11(5):1067–1077

    Article  Google Scholar 

  11. Billings SA, Wei HL (2005) A new class of wavelet networks for nonlinear system identification. IEEE Trans Neural Networks 16(4):862–874

    Article  Google Scholar 

  12. Gholizadeh S, Salajegheh E, Torkzadeh P (2008) Structural optimization with frequency constraints by genetic algorithm using wavelet radial basis function neural network. J Sound Vib 312:316–331

    Article  Google Scholar 

  13. Xu J, Ho DWC (2002) A basis selection algorithm for wavelet neural networks. Neurocomputing 48:681–689

    Article  MATH  Google Scholar 

  14. Khan MA, Uddin MN, Rahman MA (2013) A novel wavelet-neural-network-based robust controller for IPM motor drives. IEEE Trans Ind Appl 49(5):2341–2351

    Article  Google Scholar 

  15. Guan C, Luh PB, Michel LD, Wang YT, Friedland PB (2013) Very short-term load forecasting: wavelet neural networks with data pre-filtering. IEEE Trans Power Syst 28(1):30–41

    Article  Google Scholar 

  16. Jain SK, Singh SN (2014) Low-order dominant harmonic estimation using adaptive wavelet neural network. IEEE Trans Industr Electron 61(1):428–435

    Article  Google Scholar 

  17. Zhao HQ, Gao SB, He ZY, Zeng XP, Jin WD, Li TR (2014) Identification of nonlinear dynamic system using a novel recurrent wavelet neural network based on the pipelined architecture. IEEE Trans Industr Electron 61(8):4171–4182

    Article  Google Scholar 

  18. Vapnik V (1995) The Nature of Statistical Learning Theory. Springer, Berlin

    Book  MATH  Google Scholar 

  19. Daunbechies (1992) Ten Lectures on Wavelets. SIAM, Philadelphia

    Book  Google Scholar 

  20. Mallat SG (1989) A theory for multiresolution signal representation: The wavelet representation. IEEE Trans PAMI 11(7):674–693

    Article  MATH  Google Scholar 

  21. Zhang QH, Benveniste A (1992) Wavelet networks. IEEE Trans Neural Netw 3:889–898

    Article  Google Scholar 

  22. Muzhou H, Xuli H (2011) The multidimensional function approximation based on constructive wavelet RBF neural network. Appl Soft Comp J 11(2):2173–2177

    Article  Google Scholar 

  23. Wu JD, Chan JJ (2009) Faulted gear identification of a rotating machinery based on wavelet transform and artificial neural network. Expert Syst Appl 36(5):8862–8875

    Article  Google Scholar 

  24. Wei HL, Billings SA, Zhao YF, Guo LZ (2010) An adaptive wavelet neural network for spatio-temporal system identification. Neural Netw 23(10):1286–1299

    Article  Google Scholar 

  25. Zhang XG, Gao D, Zhang XG, Ren SJ (2005) Robust wavelet support vector machine for regression estimation. Int J Inform Tec 11(9):35–45

    Google Scholar 

  26. Fu YY, Wu CJ, Jeng JT, Ko CN (2009) Identification of MIMO systems using radial basis function networks with hybrid learning algorithm. Appl Math Comput 213:184–196

    Article  MathSciNet  MATH  Google Scholar 

  27. Ingber L (1993) Adaptive Simulated Annealing (ASA). ftp://alumni.caltech.edu:/pub/ingber/ASAshar,ASA-shar.Z,ASA.tar.Z,ASA.tar.gz, Lester Ingber Research, McLean, VA

  28. Alrefaei MH, Diabat AH (2009) A simulated annealing technique for multi-objective simulation optimization. Appl Math Comput 215:3029–3035

    Article  MathSciNet  MATH  Google Scholar 

  29. Shieh HL, Kuo CC, Chiang CM (2011) Modified particle swarm optimization algorithm with simulated annealing behavior and its numerical verification. Appl Math Comput 218:4365–4383

    Article  MATH  Google Scholar 

  30. Zhang XG, Gao D, Zhang XG, Ren SJ (2005) Robust wavelet support vector machine for regression estimation. Int J Inform Technol 11(9):35–45

    Google Scholar 

  31. Zhang L, Zhou W, Jiao L (2004) Wavelet support vector machine. IEEE transaction on systems, man, and cybernetics– part B. Cybernetics 34(1):34–38

    Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Science Council, Taiwan, R.O.C., under grants NSC 102-2221-E-252-011.

Author information

Authors and Affiliations

  1. Department of Multimedia Animation and Application, Nan Kai University of Technology, Nantou, Taiwan

    Shyi-Shiun Kuo

  2. Department of Automation Engineering, Nan Kai University of Technology, Nantou, Taiwan

    Chia-Nan Ko

Authors
  1. Shyi-Shiun Kuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chia-Nan Ko
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chia-Nan Ko.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kuo, SS., Ko, CN. Adaptive annealing learning algorithm-based robust wavelet neural networks for function approximation with outliers. Artif Life Robotics 19, 186–192 (2014). https://doi.org/10.1007/s10015-014-0150-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-014-0150-4

Keywords

Search

Navigation