Abstract
A number of recent studies have adopted long short-term memory (LSTM) in extensive applications, such as handwriting recognition and time series prediction, with considerable success. However, the parameters of LSTM have greatly influenced its accuracy and performance. In this study, LSTM with fruit fly optimization algorithm (FOA), called FOA-LSTM, is designed to solve time series problems. As a novel intelligent algorithm, FOA is applied to decide on the optimal hyper-parameter of LSTM. Experiments under the NN3 time series, three comparative experiments and the monthly energy consumption of the USA are conducted to verify the effectiveness of the FOA-LSTM model. The results indicate that the symmetric mean absolute percentage error (SMAPE) is reduced by up to 11.44% in the last 11 monthly series in the NN3 dataset. Four comparative experiments and the real-life series verify further that the FOA-LSTM model obtains a better result compared with other forecasting models.
This is a preview of subscription content, log in via an institution to check access.
(Source: Peng et al. 2018)
(Source: Peng et al. 2018)
(Source: Lv et al. 2017)
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Babu CN, Reddy BE (2014) A moving-average filter based hybrid ARIMA-ANN model for forecasting time series data. Appl Soft Comput 23(10):27–38
Bai Y, Li Y, Wang X, Xie J, Li C (2016) Air pollutants concentrations forecasting using back propagation neural network based on wavelet decomposition with meteorological conditions. Atmos Pollut Res 7(3):557–566
Bennett C, Stewart RA, Beal CD (2013) ANN-based residential water end-use demand forecasting model. Expert Syst Appl 40(4):1014–1023
Cao G, Wu L (2016) Support vector regression with fruit fly optimization algorithm for seasonal electricity consumption forecasting. Energy 115:734–745
Chang Z, Zhang Y, Chen W (2019) Electricity price prediction based on hybrid model of adam optimized LSTM neural network and wavelet transform. Energy 187:115804
Elsheikh A, Yacout S, Ouali MS (2019) Bidirectional handshaking LSTM for remaining useful life prediction. Neurocomputing 323:148–156
Evermann J, Rehse JR, Fettke P (2017) Predicting process behaviour using deep learning. Decis Support Syst 100:129–140
Feng X, Li Q, Zhu Y, Hou J, Jin L, Wang J (2015) Artificial neural networks forecasting of pm 2.5, pollution using air mass trajectory based geographic model and wavelet transformation. Atmos Environ 107:118–128
Fischer T, Krauss C (2018) Deep learning with long short-term memory networks for financial market predictions. Eur J Oper Res 270:654–669
Gensler A, Henze J, Sick B, Raabe N (2016). Deep learning for solar power forecasting—an approach using AutoEncoder and LSTM neural networks. In: Proceedings of IEEE international conference on systems, man, and cybernetics, pp 2858–2865
Hu R, Wen S, Zeng Z, Huang T (2017) A short-term power load forecasting model based on the generalized regression neural network with decreasing step fruit fly optimization algorithm. Neurocomputing 221(C):24–31
Hu HL, Wang L, Peng L, Zeng YR (2020a) Effective energy consumption forecasting using enhanced bagged echo state network. Energy 193:116778. https://doi.org/10.1016/j.energy.2019.116778
Hu HL, Wang L, Lv SX (2020b) Forecasting energy consumption and wind power generation using deep echo state network. Renew Energy. https://doi.org/10.1016/j.renene.2020.03.042
Hutter F, Hoos HH, Leyton-Brown K, Stützle T (2009) Paramils: an automatic algorithm configuration framework. J Artif Intell Res 36:267–306
Hyndman RJ, Khandakar Y (2008) Automatic time series forecasting: the forecast package for R. J Stat Softw 27(3):1–22
Jiang S, Chin KS, Wang L, Qu G, Tsui KL (2017) Modified genetic algorithm-based feature selection combined with pre-trained deep neural network for demand forecasting in outpatient department. Expert Syst Appl 82(C):216–230
Jimnez F, Snchez G, Garca JM, Miralles L, Miralles L (2017) Multi-objective evolutionary feature selection for online sales forecasting. Neurocomputing 234(C):75–92
Kim TY, Cho SB (2018) Web traffic anomaly detection using C-LSTM neural networks. Expert Syst Appl 106:66–76
Kim TY, Cho SB (2019) Predicting residential energy consumption using CNN-LSTM neural networks. Energy 182:72–81
Kim HY, Won CH (2018) Forecasting the volatility of stock price index: a hybrid model integrating LSTM with multiple GARCH-type models. Expert Syst Appl 103:25–37
Lago J, Ridder FD, Schutter BD (2018) Forecasting spot electricity prices: deep learning approaches and empirical comparison of traditional algorithms. Appl Energy 221:386–405
Li HZ, Guo S, Li CJ, Sun JQ (2013) A hybrid annual power load forecasting model based on generalized regression neural network with fruit fly optimization algorithm. Knowl-Based Syst 37(2):378–387
Li MW, Geng J, Han DF, Zheng TJ (2016) Ship motion prediction using dynamic seasonal RvSVR with phase space reconstruction and the chaos adaptive efficient FOA. Neurocomputing 174(4):661–680
Li X, Pan B, Law R, Huang X (2017) Forecasting tourism demand with composite search index. Tour Manag 59:57–66
Liu R, Liu L (2019) Predicting housing price in China based on long short-term memory incorporating modified genetic algorithm. Soft Comput 23(22):11829–11838
Lv SX, Zeng YR, Wang L (2017) An effective fruit fly optimization algorithm with hybrid information exchange and its applications. Int J Mach Learn Cybern 3:1–26
Ma X, Tao Z, Wang Y, Yu H, Wang Y (2015) Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Trans Res Part C Emerg Technol 54:187–197
Montero E, Riff MC, Neveu B (2014) A beginner’s guide to tuning methods. Appl Soft Comput 17:39–51
Nguyen L, Novák V (2019) Forecasting seasonal time series based on fuzzy techniques. Fuzzy Sets Syst 361:114–129
Novák V (2018) Detection of structural breaks in time series using fuzzy techniques. Int J Fuzzy Log Intell Syst 18(1):1–12
Pan W-T (2012) A new fruit fly optimization algorithm: taking the financial distress model as an example. Knowl-Based Syst 26(2):69–74
Panigrahi S, Behera HS (2017) A hybrid ETS–ANN model for time series forecasting. Eng Appl Artif Intell 66:49–59
Peng L, Liu S, Liu R, Wang L (2018) Effective long short-term memory with differential evolution algorithm for electricity price prediction. Energy 162:1301–1314
Qiu X, Ren Y, Suganthan PN, Amaratunga GA (2017) Empirical mode decomposition based ensemble deep learning for load demand time series forecasting. Appl Soft Comput 54:246–255
Qu H, Ai XY, Wang L (2020) Optimizing an integrated inventory-routing system for multi-item joint replenishment and coordinated outbound delivery using differential evolution algorithm. Appl Soft Comput 86:105863. https://doi.org/10.1016/j.asoc.2019.105863
Santos RDOVD, Vellasco MMBR (2015) Neural expert weighting: a new framework for dynamic forecast combination. Expert Syst Appl 42(22):8625–8636
Sheng W, Bao Y (2013) Fruit fly optimization algorithm based fractional order fuzzy-pid controller for electronic throttle. Nonlinear Dyn 73(1–2):611–619
Srivastava S, Lessmann S (2018) A comparative study of LSTM neural networks in forecasting day-ahead global horizontal irradiance with satellite data. Sol Energy 162:232–247
Wang W, Liu X (2015) Melt index prediction by least squares support vector machines with an adaptive mutation fruit fly optimization algorithm. Chemom Intell Lab Syst 141:79–87
Wang J, Wang J (2016) Forecasting energy market indices with recurrent neural networks: case study of crude oil price fluctuations. Energy 102:365–374
Wang L, Zeng Y, Chen T (2015) Back propagation neural network with adaptive differential evolution algorithm for time series forecasting. Expert Syst Appl 42(2):855–863
Wang L, Liu R, Liu S (2016) An effective and efficient fruit fly optimization algorithm with level probability policy and its applications. Knowl-Based Syst 97(C):158–174
Wang L, Lv SX, Zeng YR (2018) Effective sparse Adaboost method with ESN and FOA for industrial electricity consumption forecasting in China. Energy 155:1013–1031
Wang ZG, Zeng YR, Wang SR et al (2019) Optimizing echo state network with backtracking search optimization algorithm for time series forecasting. Eng Appl Artif Intell 81:117–132
Yuan X, Dai X, Zhao J, He Q (2014) On a novel multi-swarm fruit fly optimization algorithm and its application ☆. Appl Math Comput 233(3):260–271
Zeng YR, Peng L, Zhang J, Wang L (2016) An effective hybrid differential evolution algorithm incorporating simulated annealing for joint replenishment and delivery problem with trade credit. Int J Comput Intell Syst 9(6):1001–1015
Zeng YR, Zeng Y, Choi B, Wang L (2017) Multifactor-influenced energy consumption forecasting using enhanced back-propagation neural network. Energy 127:381–396
Zhang GP (2003) Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50:159–175
Zhang X, Wang J, Zhang K (2017) Short-term electric load forecasting based on singular spectrum analysis and support vector machine optimized by cuckoo search algorithm. Electr Power Syst Res 146:270–285
Zhao Z, Chen W, Wu X, Chen PCY, Liu J (2017) LSTM network: a deep learning approach for short-term traffic forecast. IET Intell Trans Syst 11(2):68–75
Zhou T, Han G, Xu X, Lin Z, Han C, Huang Y et al (2017) δ-agree adaboost stacked autoencoder for short-term traffic flow forecasting. Neurocomputing 247:31–38
Zong WG, Roper WE (2009) Energy demand estimation of south korea using artificial neural network. Energy Policy 37(10):4049–4054
Acknowledgements
The authors are very grateful for the constructive comments of editors and referees. This research is partially supported by National Natural Science Foundation of China (No. 71771095) and Humanities and Social Sciences Foundation of Chinese Ministry of Education, China (No. 18YJA630005).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by V. Loia.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Peng, L., Zhu, Q., Lv, SX. et al. Effective long short-term memory with fruit fly optimization algorithm for time series forecasting. Soft Comput 24, 15059–15079 (2020). https://doi.org/10.1007/s00500-020-04855-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-020-04855-2