Abstract
Analysis and prediction of time series play a significant role in scientific fields of meteorology, epidemiology, and economy. Efficient and accurate prediction of signals can give an early detection of abnormal variations, provide guidance on preparing a timely response and avoid presumably adverse impacts. In this paper, a prediction system is designed based on the dynamical feed-forward neural network. The trajectory information in the reconstructed phase space, which is topologically equivalent to the dynamical evolution of the system, is applied to establish the prediction model. Moreover, an integer constrained particle swarm optimization algorithm is employed to select the optimal time delay, which is the parameter of our system. Simulation results for applications on the Lorenz system, stock market index, and influenza data indicate that our proposed method can produce efficient and reliable predictions.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Liu Y, Liu Q L, Wang W, et al. Data-driven based model for flow prediction of steam system in steel industry. Inf Sci, 2012, 193: 104–114
Li K J, Xie X M, Xue W P, et al. Hybrid teaching-learning artificial neural network for city-level electrical load prediction. Sci China Inf Sci, 2020, 63: 159204
Xiong T, Li C G, Bao Y K, et al. A combination method for interval forecasting of agricultural commodity futures prices. Knowl-Based Syst, 2015, 77: 92–102
Lee R S T. Chaotic type-2 transient-fuzzy deep neuro-oscillatory network (CT2TFDNN) for worldwide financial prediction. IEEE Trans Fuzzy Syst, 2020, 28: 731–745
Jiang F, He J Q, Zeng Z G. Pigeon-inspired optimization and extreme learning machine via wavelet packet analysis for predicting bulk commodity futures prices. Sci China Inf Sci, 2019, 62: 070204
Chang V. Towards data analysis for weather cloud computing. Knowl-Based Syst, 2017, 127: 29–45
Liu H, Mi X W, Li Y F. Wind speed forecasting method based on deep learning strategy using empirical wavelet transform, long short term memory neural network and Elman neural network. Energy Convers Manage, 2018, 156: 498–514
Hao Y, Tian C S. A novel two-stage forecasting model based on error factor and ensemble method for multi-step wind power forecasting. Appl Energy, 2019, 238: 368–383
Ginsberg J, Mohebbi M H, Patel R S, et al. Detecting influenza epidemics using search engine query data. Nature, 2009, 457: 1012–1014
Xue H X, Bai Y P, Hu H P, et al. Influenza activity surveillance based on multiple regression model and artificial neural network. IEEE Access, 2018, 6: 563–575
Clauset A, Larremore D B, Sinatra R. Data-driven predictions in the science of science. Science, 2017, 355: 477–480
Farmer J D, Sidorowich J J. Predicting chaotic time series. Phys Rev Lett, 1987, 59: 845–848
Sugihara G, May R M. Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series. Nature, 1990, 344: 734–741
Deyle E R, Sugihara G. Generalized theorems for nonlinear state space reconstruction. PLoS ONE, 2011, 6: 18295
Ye H, Sugihara G. Information leverage in interconnected ecosystems: overcoming the curse of dimensionality. Science, 2016, 353: 922–925
Ma H F, Leng S Y, Aihara K, et al. Randomly distributed embedding making short-term high-dimensional data predictable. Proc Natl Acad Sci USA, 2018, 115: 9994–10002
Guo X X, Sun Y T, Ren J L. Low dimensional mid-term chaotic time series prediction by delay parameterized method. Inf Sci, 2020, 516: 1–19
Wei X S, Wang P, Liu L Q, et al. Piecewise classifier mappings: learning fine-grained learners for novel categories with few examples. IEEE Trans Image Process, 2019, 28: 6116–6125
Subrahmanian V S, Kumar S. Predicting human behavior: the next frontiers. Science, 2017, 355: 489
Jaeger H, Haas H. Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science, 2004, 304: 78–80
Nassif A B, Shahin I, Attili I, et al. Speech recognition using deep neural networks: a systematic review. IEEE Access, 2019, 7: 19143–19165
Wang H Y, Yamamoto N. Using a partial differential equation with Google mobility data to predict COVID-19 in Arizona. Math Biosci Eng, 2020, 17: 4891–4904
Zhu X L, Fu B F, Yang Y D, et al. Attention-based recurrent neural network for influenza epidemic prediction. BMC BioInf, 2019, 20: 575
Zheng H F, Lin F, Feng X X, et al. A hybrid deep learning model with attention-based conv-LSTM networks for short-term traffic flow prediction. IEEE Trans Intell Transp Syst, 2021, 22: 6910–6920
Wang X, Yu F, Dou Z Y, et al. SkipNet: learning dynamic routing in convolutional networks. In: Proceedings of European Conference on Computer Vision, 2018. 409–424
Bolukbasi T, Wang J, Dekel O, et al. Adaptive neural networks for efficient inference. In: Proceedings of the 34th International Conference on Machine Learning, 2017. 527–536
Huang G, Chen D L, Li T H, et al. Multi-scale dense networks for resource efficient image classification. In: Proceedings of International Conference on Learning Representations, 2018
Packard N H, Crutchfield J P, Farmer J D, et al. Geometry from a time series. Phys Rev Lett, 1980, 45: 712–716
Takens F. Detecting strange attractors in turbulence. Dyn Syst Turbul, 1981, 344: 366–381
Roux J C, Simoyi R H, Swinney H L. Observation of a strange attractor. Phys D-Nonlinear Phenom, 1983, 8: 257–266
Rosenstein M T, Collins J J, de Luca C J. Reconstruction expansion as a geometry-based framework for choosing proper delay times. Phys D-Nonlinear Phenom, 1994, 73: 82–98
Fraser A M, Swinney H L. Independent coordinates for strange attractors from mutual information. Phys Rev A, 1986, 33: 1134–1140
Kennel M B, Brown R, Abarbanel H D. Determining embedding dimension for phase space reconstruction using a geometrical construction. Phys Rev A, 1992, 45: 3403–3411
Cao L Y. Practical method for determining the minimum embedding dimension of a scalar time series. Phys D-Nonlinear Phenom, 1997, 110: 43–50
Liu J P, Guo X X, Lin Q Y, et al. Excellent ductility and serration feature of metastable CoCrFeNi high-entropy alloy at extremely low temperatures. Sci China Mater, 2019, 62: 853–863
Guo X X, Xie X, Ren J L, et al. Plastic dynamics of the Al0.5CoCrCuFeNi high entropy alloy at cryogenic temperatures: jerky flow, stair-like fluctuation, scaling behavior, and non-chaotic state. Appl Phys Lett, 2017, 111: 251905
Chen C, Ren J L, Wang G, et al. Scaling behavior and complexity of plastic deformation for a bulk metallic glass at cryogenic temperatures. Phys Rev E, 2015, 92: 012113
Ren J L, Chen C, Liu Z Y, et al. Plastic dynamics transition between chaotic and self-organized critical states in a glassy metal via a multifractal intermediate. Phys Rev B, 2012, 86: 134303
Broomhead D S, Lowe D. Multivariable functional interpolation and adaptive networks. Complex Syst, 1988 2: 321–355
Rumelhart D E, Hinton G E, Williams R J. Learning representations by back-propagating errors. Nature, 1986, 323: 533–536
Kennedy J, Eberhart R. Particle swarm optimization. In: Proceedings of International Conference on Neural Networks, 1995. 1942–1948
Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput, 1997, 9: 1735–1780
Zhao Z, Chen W H, Wu X M, et al. LSTM network: a deep learning approach for short-term traffic forecast. IET Intell Transp Syst, 2017, 11: 68–75
Kong W, Dong Z Y, Jia Y, et al. Short-term residential load forecasting based on LSTM recurrent neural network. IEEE Trans Smart Grid, 2019, 10: 841–851
LeCun Y, Bengio Y, Hinton G. Deep learning. Nature, 2015, 521: 436–444
Acknowledgements
This work was supported by National Natural Science Foundation of China (Grant No. 52071298), Zhong-Yuan Science and Technology Innovation Leadership Program (Grant No. 214200510010), and China Scholarship Council (Grant No. 201907040017).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Guo, X., Han, W. & Ren, J. Design of a prediction system based on the dynamical feed-forward neural network. Sci. China Inf. Sci. 66, 112102 (2023). https://doi.org/10.1007/s11432-020-3402-9
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11432-020-3402-9