Abstract
As telecommunication networks grow in size and complexity, monitoring systems need to scale up accordingly. Alarm data generated in a large network are often highly correlated. These correlations can be explored to simplify the process of network fault management, by reducing the number of alarms presented to the network-monitoring operator. This makes it easier to react to network failures. But in some scenarios, it is highly desired to prevent the occurrence of these failures by predicting the occurrence of alarms before hand. This work investigates the usage of data mining methods to generate knowledge from historical alarm data, and using such knowledge to train a machine learning system, in order to predict the occurrence of the most relevant alarms in the network. The learning system was designed to be retrained periodically in order to keep an updated knowledge base.
Similar content being viewed by others
References
Hätönen, K., Klemettinen, M., Mannila, H., Ronkainen, P., Toivonen, H.: Knowledge Discovery from Telecommunication Network Alarm Databases. In: ICDE, pp. 115–122 (1996)
Cavafy, C.P.: But the wise perceive things about to happen. Princeton University Press, Collected Poems (1992)
Salfner, F., Lenk, M., Malek, M.: A survey of online failure prediction methods. ACM Comput. Surv. 42, 1–42 (2010)
Dietterich, T.: Machine learning for sequential data: a review. In: Caelli, T., Amin, A., Duin, R.P.W., de Ridder, D., Kamel, M. (eds.) Structural, Syntactic, and Statistical Pattern Recognition. Springer, Heidelberg (2002)
Vehviläinen, P., Hätönen, K., Kumpulainen, P.: Data mining in quality analysis of digital mobile telecommunications network. In: XVII IMEKO World Congress Metrology in the 3rd Millennium. Dubrovnik, Croatia (2003)
Gangopadhyay, B., Arsénio, A., Antunes, C.: Comparative study of pattern mining techniques for network management system logs for convergent network. In: Data Engineering and Management. Springer Lecture Notes in Computer Science, vol. 6411, pp. 101–108 (2012)
Weiss, G., Davison, B.: Data mining (2010). In: Bidgoli, H. (ed.) Handbook of Technology Management, pp. 542–555. John Wiley and Sons (2010)
Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: From data mining to knowledge discovery in databases. AI Mag. 17(3), 37–54 (1996)
Vilalta, R. Ma, S. Predicting rare events in temporal domains. In: Data Mining, pp. 474–481 (2003)
Hätönen, K., Klemettinen, M., Mannila, H., Ronkainen, P., Toivonen, H.: Rule Discovery in Alarm Databases. Report C-1996-7, Department of Computer Science, University of Helsinki (1996). http://www.cs.helsinki.fi/TR/C-1996/7
Vilalta, R., Apte, C.V., Hellerstein, J.L., Ma, S., Weiss, S.M.: Predictive algorithms in the management of computer systems. IBM Syst. J. 41, 461–474 (2002)
Sahoo, R.K., Oliner, A.J., Rish, I., Gupta, M., Moreira, J.E., Ma, S., Vilalta, R., Sivasubramaniam, A.: Critical event prediction for proactive management in large-scale computer clusters. In: Knowledge Discovery in Databases (KDD), Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, NY, USA, pp. 426–435 (2003)
Weiss, G.: Timeweaver: a genetic algorithm for identifying predictive patterns in sequences of events. In: Proceedings of the Genetic and Evolutionary Computation Conference. Morgan Kaufmann (1999)
Mohamed, A., Ahmed, M., Chau, S.: A new adaptive evidential reasoning approach for network alarm correlation. In: 2012 IEEE 10th International Symposium on Applied Machine Intelligence and Informatics (SAMI), pp. 241–246 (2012)
Sridevi, S., Rajaram, S., Swadhikar, C.: An intelligent prediction system for time series data using periodic pattern mining in temporal databases. In: Proceedings of the First International Conference on Intelligent Interactive Technologies and Multimedia. IITM’10, ACM, New York, NY, USA, pp. 163–171 (2010)
Abdullah, Z., Deris, M.: Association rules mining with relative weighted support. In: Proceedings of the 11th International Conference on Information Integration and Web-based Applications and Services, iiWAS’09, ACM, New York, NY, USA, pp. 507–511 (2009)
Graf, S., Prinz, A.: Time in state machines. In: Proceedings of the 12th International Workshop on Abstract State Machines, Abstract State Machines (ASM), Paris, France, 8–11 March 2005, pp. 217–232 (2005). http://www.univ-paris12.fr/lacl/dima/asm05/GrafPrinzASM2005-pgnb.pdf
Hitike, K. Khalifa, O.: Comparison of supervised and unsupervised learning classifiers for human posture recognition. In: Computer and Communication Engineering (ICCCE), pp. 1–6 (2010)
Yao, X.: Evolving artificial neural networks. Proc. IEEE 87, 1423–1447 (1999)
Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 257–286 (1989)
Ariu, D., Giacinto, G., Perdisci, R.: Sensing attacks in computers networks with hidden markov models. In: Machine Learning and Data Mining in Pattern Recognition. Springer Lecture Notes in Computer Science, vol. 4571, pp. 449–463 (2007)
Teixeira, D., Arsénio, A.: Intelligent network client profiler. J. Adv. Comput. Netw. 1(2), 125–131 (2013)
Agrawal, R., Srikant, R.: Mining sequential patterns. In: Proceedings of the Eleventh International Conference on Data Engineering, pp. 3–14 (1995)
Sumithra, R. Paul, S. Using distributed apriori association rule and classical apriori mining algorithms for grid based knowledge discovery. In: 2010 International Conference on Computing Communication and Networking Technologies (ICCCNT), pp. 1–5 (2010)
Domingos, P.: Markov logic: a unifying language for knowledge and information management. In: Proceedings of the 17th ACM conference on Information and knowledge management, CIKM’08, ACM, New York, NY, USA, pp. 519–519 (2008)
Popescul, A., Ungar, L., Lawrence, S., Pennock, D.: Statistical relational learning for document mining. In: Third IEEE International Conference on Data Mining. ICDM 2003, pp. 275–282 (2003)
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was carried out while Ivan Caravela and Nuno Borges were at Nokia Siemens Networks.
Rights and permissions
About this article
Cite this article
Caravela, I., Arsenio, A. & Borges, N. A Closed-Loop Automatic Data-Mining Approach for Preventive Network Monitoring. J Netw Syst Manage 24, 974–1003 (2016). https://doi.org/10.1007/s10922-015-9356-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10922-015-9356-6