Abstract
In complex and changeable cloud environment, the monitoring and anomaly detection of cloud platform become very important. Good anomaly detection can help cloud platform managers to make quick adjustments to ensure a good user experience. Although many anomaly detection models have been put forward by researchers in recent years, the application of these anomaly detection models to a given service still faces the challenge of parameter adjustment, which is time-consuming and exhausting, and still fails. In order to solve the problem of parameter adjusting, in this paper, an adaptive anomaly detection framework is proposed, the process of parameter adjustment is transformed into a general Markov decision process by means of reinforcement learning, which realized the automation of parameter adjustment, reducing the workload of operator and the effective detection rate of the anomaly detection model is improved, we compared it on three typical KPI (Key Performance Indicator) curves with artificial adjustment mode and other optimization strategies, in the end, we verified the effectiveness of the strategy used in this paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Agrawal, B., Wiktorski, T., Rong, C.: Adaptive anomaly detection in cloud using robust and scalable principal component analysis. In: International Symposium on Parallel and Distributed Computing. IEEE (2017)
Yang, Y.M., Yu, H., Sun, Z.: Aircraft failure rate forecasting method based on Holt-Winters seasonal model. In: International Conference on Cloud Computing and Big Data Analysis. IEEE (2017)
Tian, H., Ding, M.: Diffusion wavelet-based anomaly detection in networks. In: International Conference on Parallel and Distributed Computing, Applications and Technologies, pp. 382–386. IEEE (2017)
Yan, H., Breslau, L., Ge, Z., Massey, D., Pei, D., Yates, J.: G-RCA: a generic root cause analysis platform for service quality management in large IP networks. In: Proceedings of the 6th International Conference, Co-NEXT 2010, pp. 5:1–5:12. ACM, New York (2010)
Aksaray, D., et al.: Q-Learning for robust satisfaction of signal temporal logic specifications. In: Decision and Control. IEEE (2016)
Data Set Homepage. https://github.com/baidu/Curve. Accessed 19 June 2018
Liu, D., et al.: Opprentice: towards practical and automatic anomaly detection through machine learning. In: Internet Measurement Conference, pp. 211–224. ACM (2015)
Tang, X.M., Yuan, R.X., Chen, J.: Outlier detection in energy disaggregation using subspace learning and Gaussian mixture model. Int. J. Control Autom. 8, 161–170 (2015)
Pena, E.H.M., Assis, M.V.O.D., Proenca, M.L.: Anomaly detection using forecasting methods ARIMA and HWDS. In: Chilean Computer Science Society, pp. 63–66. IEEE (2017)
Ghanbari, M., Kinsner, W., Ferens, K.: Anomaly detection in a smart grid using wavelet transform, variance fractal dimension and an artificial neural network. In: Electrical Power and Energy Conference, pp. 1–6. IEEE (2016)
Zeb, K., et al.: Anomaly detection using wavelet-based estimation of LRD in packet and byte count of control traffic. In: International Conference on Information and Communication Systems. IEEE (2016)
Wazid, M., Das, A.K.: An efficient hybrid anomaly detection scheme using k-means clustering for wireless sensor networks. Wirel. Pers. Commun. 90(4), 1971–2000 (2016)
Erfani, S.M., et al.: High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning. Pattern Recognit. 58(C), 121–134 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Xu, Y., Chen, N., Zhang, H., Liang, B. (2018). Adaptive Anomaly Detection Strategy Based on Reinforcement Learning. In: Zhou, Q., Miao, Q., Wang, H., Xie, W., Wang, Y., Lu, Z. (eds) Data Science. ICPCSEE 2018. Communications in Computer and Information Science, vol 902. Springer, Singapore. https://doi.org/10.1007/978-981-13-2206-8_40
Download citation
DOI: https://doi.org/10.1007/978-981-13-2206-8_40
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-2205-1
Online ISBN: 978-981-13-2206-8
eBook Packages: Computer ScienceComputer Science (R0)