Abstract
In the context of human-robot and robot-robot interactions, the better cooperation can be achieved by predicting the other party’s subsequent actions based on the current action of the other party. The time duration for adjustment is not sufficient provided by short term forecasting models to robots. A longer duration can by achieved by mid-term forecasting. But the mid-term forecasting models introduce the previous errors into the follow-up forecasting and amplified gradually, eventually invalidating the forecasting. A new mid-term forecasting with error suppression based on restricted Boltzmann machine(RBM) is proposed in this paper. The proposed model can suppress the error amplification by replacing the previous inputs with their features, which are retrieved by a deep belief network(DBN). Furthermore, a new mechanism is proposed to decide whether the forecasting result is accepted or not. The model is evaluated with several datasets. The reported experiments demonstrate the superior performance of the proposed model compared to the state-of-the-art approaches.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Simonyan K, Zisserman A (2014) Two-stream convolutional networks for action recognition in videos. In: Advances in neural information processing systems, pp 568–576
Donahue J (2015) Long-term recurrent convolutional networks for visual recognition and description. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2625–2634
Keogh E, Folias T (2002) The ucr time series data mining archive. Computer Science & Engineering Department. University of California, Riverside, http://www.cs.ucr.edu/eamonn/TSDMA/index.html
Müller M, Röder T (2006) Motion templates for automatic classification and retrieval of motion capture data. In: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation. Eurographics Association, pp 137– 146
Li W, Zhang Z, Liu Z (2010) Action recognition based on a bag of 3d points. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, pp 9–14
Box GEP, Jenkins GM, Reinsel GC, Ljung GM (2015) Time series analysis: Forecasting and control, 5th edition. J Oper Res Soc 22(2):199–201
Chen D, Lv JC, Yi Z (2014) A local non-negative pursuit method for intrinsic manifold structure preservation. In: Twenty-Eighth AAAI Conference on Artificial Intelligence, pp 1745– 1751
Yang Y, Chen K (2011) Time series clustering via rpcl network ensemble with different representations. IEEE Trans Syst Man Cybern Part C (Appl Rev) 41(2):190–199
Gao XZ, Ovaska SJ, Vasilakos AV (2002) Temporal difference method-based multi-step ahead prediction of long term deep fading in mobile networks. Comput Commun 25(16):1477– 1486
Amal Datta C, Indranil G (2016) Artificial neural network and time series modeling based approach to forecasting the exchange rate in a multivariate framework. J Insur Financ Manag:92– 123
Wang Z, Yan W, Oates T (2017) Time series classification from scratch with deep neural networks: A strong baseline. In: International Joint Conference on Neural Networks, pp 1578–1585
Mittelman R (2015) Time-series modeling with undecimated fully convolutional neural networks. Computer Science
Binkowski M, Marti G, Donnat P (2018) Autoregressive convolutional neural networks for asynchronous time series
Singh T, Vishwakarma DK (2019) A hybrid framework for action recognition in low-quality video sequences. Vis Comput (6)
Liu C, Ying J, Yang H, Hu X, Liu J (2020) Improved human action recognition approach based on two-stream convolutional neural network model. Vis Comput (6)
Wang H, Wanga L (2018) Beyond joints: Learning representations from primitive geometries for skeleton-based action recognition and detection. IEEE Trans Image Process Publ IEEE Signal Process So:4382
Hsu D (2017) Time series forecasting based on augmented long short-term memory
Tsiouris o, Pezoulas VC, Zervakis M, Konitsiotis S, Koutsouris DD, Fotiadis DI (2018) A long short-term memory deep learning network for the prediction of epileptic seizures using eeg signals. Comput Biol Med:24–37
Rahmani H, Mian A, Shah M (2018) Learning a deep model for human action recognition from novel viewpoints. IEEE Trans Pattern Anal Mach Intell:1–1
Silva MVD, Marana AN (2020) Human action recognition in videos based on spatiotemporal features and bag-of-poses. Appl Soft Comput:106513
Taylor GW, Hinton (2011) Two distributed-state models for generating high-dimensional time series. J Mach Learn Res 12(2):1025–1068
Sutskever I, Hinton GE, Taylor GW (2009) The recurrent temporal restricted boltzmann machine. In: Advances in Neural Information Processing Systems, pp 1601–1608
Harrison PJ, Stevens CF (1971) A bayesian approach to short-term forecasting. Oper Res Q:341–362
Money D, Harris SL (2007) Digital design and computer architecture. Morgan Kaufmann Publishers
Srikant R, Agrawal R (1996) Mining sequential patterns: Generalizations and performance improvements. In: International Conference on Extending Database Technology: Advances in Database Technology, pp 3–17
Hinton GE, Osindero S, Teh YW (2014) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554
Sutskever I, Hinton GE (2006) Learning multilevel distributed representations for high-dimensional sequences. In: AISTATS, vol 2, pp 548–555
Zhu W, Lan C, Xing J, Zeng W, Li Y, Li S, Xie X (2016) Co-occurrence feature learning for skeleton based action recognition using regularized deep lstm networks. In: Computer Vision and Pattern Recognition
Du Y, Wang W, Wang L (2015) Hierarchical recurrent neural network for skeleton based action recognition. In: Computer Vision and Pattern Recognition
Sznaier M, Camps OI, Li B (2012) Cross-view activity recognition using hankelets
Wang H, Schmid C, Liu CL (2011) Action recognition by dense trajectories. Proceedings / CVPR, IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Li R, Zickler T (2012) Discriminative virtual views for cross-view action recognition. In: Computer Vision and Pattern Recognition
Zhang Z, Wang C, Xiao B, Zhou W, Shi C (2013) Cross-view action recognition via a continuous virtual path. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Donahue J, Hendricks LA, Guadarrama S, Rohrbach M, Venugopalan S, Saenko K, Darrell T (2015) Long-term recurrent convolutional networks for visual recognition and description. Elsevier,
Simonyan K, Zisserman A (2014) Two-stream convolutional networks for action recognition in videos. Advances in neural information processing systems
Shotton J, Fitzgibbon A, Cook M, Sharp (2011) Real-time human pose recognition in parts from single depth images. In: Computer Vision and Pattern Recognition, pp 1297–1304
Funding
This work is supported by the Key Program of National Science Foundation of China (Grant No. 61836006) and partially supported by National Natural Science Fund for Distinguished Young Scholar (Grant No. 61625204).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical approval
This article does not contain any studies with human participants performed by any of the authors.
Conflict of Interest
The authors declare that they has no conflict of interest.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Xia, L., Lv, J., Xie, C. et al. A conditional classification recurrent RBM for improved series mid-term forecasting. Appl Intell 51, 8334–8348 (2021). https://doi.org/10.1007/s10489-021-02315-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-021-02315-4