VaryMinions: leveraging RNNs to identify variants in variability-intensive systems’ logs
Authors: 
Sophie Fortz, Paul Temple, 
Xavier Devroey, Patrick Heymans, Gilles PerrouinAuthors Info & Claims
Abstract
From business processes to course management, variability-intensive software systems (VIS) are now ubiquitous. One can configure these systems’ behaviour by activating options, e.g., to derive variants handling building permits across municipalities or implementing different functionalities (quizzes, forums) for a given course. These customisation facilities allow VIS to support distinct relevant customer requirements while taking advantage of reuse for common parts. Customisation thus allows realising both scope and scale economies. Behavioural differences amongst variants manifest themselves in event logs. To re-engineer this kind of system, one must know which variant(s) have produced which behaviour. Since variant information is barely present in logs, this paper supports this task by employing machine learning techniques to classify behaviours (event sequences) among variants. Specifically, we train Long Short Term Memory (LSTMs) and Gated Recurrent Units (GRUs) recurrent neural networks to relate event sequences with the variants they belong to on six different datasets issued from the configurable process and VIS domains. After having evaluated 20 different architectures of LSTM/GRU, our results demonstrate that it is possible to effectively learn the trace-to-variant mapping with high accuracy (at least and up to ) and at scale, i.e., identifying 50 variants using 5000+ traces for each variant.
References
[1]
Abdelrazek M, Grundy J, Ibrahim A (2019) Towards self-securing software systems: Variability spectrum. In: Software engineering for variability intensive systems. Auerbach Publications, pp 119–130
[2]
Acher M, Baudry B, Heymans P, Cleve A, Hainaut JL (2013) Support for reverse engineering and maintaining feature models. In: Gnesi S, Collet P, Schmid K (eds.) VaMoS. ACM, pp 20
[3]
Alves Pereira J, Acher M, Martin H, Jézéquel JM (2020) Sampling effect on performance prediction of configurable systems: A case study. In: Proceedings of the ACM/SPEC international conference on performance engineering. ACM, pp 277–288.
[4]
Amand B, Cordy M, Heymans P, Acher M, Temple P, Jézéquel JM (2019) Towards learning-aided configuration in 3d printing: Feasibility study and application to defect prediction. In: Proceedings of the 13th international workshop on variability modelling of software-intensive systems. ACM, pp 1–9.
[5]
Angluin D Learning regular sets from queries and counterexamples Inf Comput 1987 75 2 87-106
[6]
Apel S, Batory DS, Kästner C, Saake G (2013) Feature-Oriented Software Product Lines - Concepts and Implementation. Springer.
[7]
Arganese E, Fantechi A, Gnesi S, Semini L (2020) Nuts and bolts of extracting variability models from natural language requirements documents. In: Integrating research and practice in software engineering. Springer, pp 125–143.
[8]
Assunção WK, Vergilio SR, and Lopez-Herrejon RE Automatic extraction of product line architecture and feature models from uml class diagram variants Inf Softw Technol 2020 117 106198
[9]
Assunção WKG, Lopez-Herrejon RE, Linsbauer L, Vergilio SR, and Egyed A Reengineering legacy applications into software product lines: a systematic mapping Empir Softw Eng 2017 22 2972-3016
[10]
Assy N, Chan NN, and Gaaloul W An automated approach for assisting the design of configurable process models IEEE Trans Serv Comput 2015 8 6 874-888
[11]
Bacciu D, Gnesi S, Semini L (2015) Using a machine learning approach to implement and evaluate product line features. In: ter Beek MH, Lluch-Lafuente A (eds.) Proceedings 11th international workshop on automated specification and verification of web systems, WWV 2015, Oslo, Norway, 23rd June 2015, EPTCS, vol 188. EPTCS, pp 75–83.
[12]
Bobek S, Baran M, Kluza K, Nalepa GJ (2013) Application of bayesian networks to recommendations in business process modeling. In: AIBP at AI* IA. Springer, pp 41–50
[13]
Borkowski M, Fdhila W, Nardelli M, Rinderle-Ma S, Schulte S (2019) Event-based failure prediction in distributed business processes. Inf Syst 81:220–235. https://www.sciencedirect.com/science/article/pii/S0306437917300030
[14]
Boussaa M, Barais O, Baudry B, and Sunyé G Automatic non-functional testing of code generators families ACM SIGPLAN Not 2016 52 3 202-212
[15]
Bozorgi ZD, Teinemaa I, Dumas M, La Rosa M, Polyvyanyy A (2020) Process mining meets causal machine learning: Discovering causal rules from event logs. In: 2020 2nd International conference on process mining (ICPM). IEEE, pp 129–136
[16]
Bui HN, Vu TS, Nguyen HH, Nguyen TT, Ha QT (2020) Exploiting cbow and lstm models to generate trace representation for process mining. In: Asian conference on intelligent information and database systems. Springer, pp 35–46
[17]
Bui HN, Vu TS, Nguyen TT, Nguyen TC, Ha QT (2019) A compact trace representation using deep neural networks for process mining. In: 2019 11th International conference on knowledge and systems engineering (KSE). IEEE, pp 1–5
[18]
Buijs JC, van Dongen BF, van der Aalst WM (2013) Mining configurable process models from collections of event logs. In: Business process management. Springer, pp 33–48.
[19]
Cândido J, Aniche M, and van Deursen A Log-based software monitoring: a systematic mapping study PeerJ Comput Sci 2021 7 e489
[20]
Chapelle O, Schölkopf B, Zien A (2006) Semi-Supervised Learning. MIT press Cambridge
[21]
Cho K, van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder–decoder for statistical machine translation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, pp 1724–1734.
[22]
Chollet F et al (2015) Keras. https://keras.io
[23]
Chung J, Gulcehre C, Cho K, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. In: NIPS 2014 workshop on deep learning, December 2014
[24]
Classen A, Cordy M, Schobbens P, Heymans P, Legay A, and Raskin J Featured transition systems: Foundations for verifying variability-intensive systems and their application to LTL model checking IEEE Trans Softw Eng 2013 39 8 1069-1089
[25]
Cruz D, Figueiredo E, Martinez J (2019) A literature review and comparison of three feature location techniques using argouml-spl. In: Proceedings of the 13th international workshop on variability modelling of software-intensive systems, pp 1–10
[26]
Damasceno CDN, Mousavi MR, da Silva Simao A (2019) Learning to reuse: Adaptive model learning for evolving systems. In: International conference on integrated formal methods. Springer, pp 138–156
[27]
Damasceno CDN, Mousavi MR, and da Silva Simao A Learning by sampling: learning behavioral family models from software product lines Empir Softw Eng 2021 26 1 1-46
[28]
De Weerdt J, vanden Broucke SK, Vanthienen J, Baesens B (2012) Leveraging process discovery with trace clustering and text mining for intelligent analysis of incident management processes. In: IEEE congress on evolutionary computation. IEEE, pp 1–8.
[29]
Developers T (2021) Tensorflow.
[30]
Devroey X (2020). VIBeS Case studies: featured transition systems and feature models.
[31]
Devroey X (2022) VIBeS: Variability Intensive system Behavioral testing framework. https://github.com/xdevroey/vibes
[32]
Devroey X, Perrouin G, Cordy M, Samih H, Legay A, Schobbens P, and Heymans P Statistical prioritization for software product line testing: an experience report Softw Syst Model 2017 16 1 153-171
[33]
Devroey X, Perrouin G, Cordy M, Schobbens P, Legay A, Heymans P (2014) Towards statistical prioritization for software product lines testing. In: Collet P, Wasowski A, Weyer T (eds.) The eighth international workshop on variability modelling of software-intensive systems, VaMoS ’14, Sophia Antipolis, France, January 22-24, 2014. ACM, pp 10:1–10:7.
[34]
Devroey X, Perrouin G, Legay A, Schobbens P, Heymans P (2015) Covering SPL behaviour with sampled configurations: An initial assessment. In: Schmid K, Haugen Ø, Müller J (eds.) Proceedings of the ninth international workshop on variability modelling of software-intensive systems, VaMoS ’15, Hildesheim, Germany, January 21-23, 2015. ACM, p 59.
[35]
Devroey X, Perrouin G, Legay A, Schobbens PY, Heymans P (2016) Search-based similarity-driven behavioural spl testing. In: Proceedings of the tenth international workshop on variability modelling of software-intensive systems. pp 89–96
[36]
Di Mauro N, Appice A, Basile TM (2019) Activity prediction of business process instances with inception cnn models. In: International conference of the Italian association for artificial intelligence. Springer, pp 348–361
[37]
van Dongen B (2020) Bpi challenge 2020. https://data.4tu.nl/collections/BPI_Challenge_2020/5065541/1
[38]
van Dongen, BB (2015) Bpi challenge 2015. https://data.4tu.nl/collections/BPI_Challenge_2015/5065424/1
[39]
Dorn J, Apel S, Siegmund N (2020) Generating attributed variability models for transfer learning. In: Proceedings of the 14th international working conference on variability modelling of software-intensive systems, VAMOS ’20. ACM.
[40]
Evermann J, Rehse JR, and Fettke P Predicting process behaviour using deep learning Decis Support Syst 2017 100 129-140
[41]
Fahland D, van der Aalst WM (2015) Model repair - aligning process models to reality. Inf Syst 47:220–243. https://www.sciencedirect.com/science/article/pii/S0306437913001725
[42]
Fernandes EC, Fitzgerald B, Brown L, Borsato M (2019) Machine learning and process mining applied to process optimization: Bibliometric and systemic analysis. Proc Manuf 38:84–91. https://www.sciencedirect.com/science/article/pii/S2351978920300123. 29th International Conference on Flexible Automation and Intelligent Manufacturing (FAIM 2019), June 24-28, 2019, Limerick, Ireland, Beyond Industry 4.0: Industrial Advances, Engineering Education and Intelligent Manufacturing
[43]
Ferreira F, Silva LL, Valente MT (2021) Software engineering meets deep learning: a mapping study. In: Proceedings of the 36th annual acm symposium on applied computing, pp 1542–1549
[44]
Fortz S (2021) Lifts: Learning featured transition systems. In: Proceedings of the 25th ACM international systems and software product line conference - volume B, SPLC ’21. Association for Computing Machinery, New York, NY, USA, pp 1-6.
[45]
Fortz S (2023) Variability-aware Behavioural Learning. In: Proceedings of the 27th ACM international systems and software product line conference - volume B, Tokyo, Japan, SPLC ’23. Association for Computing Machinery, New York, NY, USA.
[46]
Fortz S, Temple P, Devroey X, Heymans P, Perrouin G (2021) Varyminions: leveraging rnns to identify variants in event logs. In: Ampatzoglou A, Feitosa D, Catolino G, Lenarduzzi V (eds.) Proceedings of the 5th international workshop on machine learning techniques for software quality evolution, Athens, Greece, 23 August 2021. ACM, pp 13–18.
[47]
Fortz S, Temple P, Devroey X, Heymans P, Perrouin G (2022) Varyminions. https://www.zenodo.org/record/7492126. Sophie Fortz is supported by the FNRS via a FRIA grant. Gilles Perrouin is an FNRS Research Associate
[48]
García S, Molina D, Lozano M, and Herrera F A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the cec’2005 special session on real parameter optimization J Heuristics 2009 15 6 617-644
[49]
Geman S, Bienenstock E, and Doursat R Neural networks and the bias/variance dilemma Neural Comput 1992 4 1 1-58
[50]
Ghamizi S, Cordy M, Papadakis M, Traon YL (2019) Automated search for configurations of convolutional neural network architectures. In: Proceedings of the 23rd international systems and software product line conference-volume A. ACM, pp 119–130.
[51]
Ghamizi S, Cordy M, Papadakis M, Traon YL (2020) Featurenet: diversity-driven generation of deep learning models. In: Proceedings of the ACM/IEEE 42nd international conference on software engineering: companion proceedings. ACM, pp 41–44.
[52]
Ghofrani J, Kozegar E, Bozorgmehr A, Soorati MD (2019a) Reusability in artificial neural networks: an empirical study. In: Proceedings of the 23rd international systems and software product line conference-volume B ACM, pp. 122–129.
[53]
Ghofrani J, Kozegar E, Fehlhaber AL, Soorati MD (2019b) Applying product line engineering concepts to deep neural networks. In: Proceedings of the 23rd international systems and software product line conference-volume A. ACM, pp 72–77.
[54]
Golia P, Soos M, Chakraborty S, Meel KS (2021) Designing samplers is easy: The boon of testers. In: Formal methods in computer aided design, FMCAD 2021, New Haven, CT, USA, October 19-22, 2021. IEEE, pp 222–230.
[55]
Ha H, Zhang H (2019) Deepperf: performance prediction for configurable software with deep sparse neural network. In: 2019 IEEE/ACM 41st international conference on software engineering (ICSE) IEEE, pp 1095–1106
[56]
Hafemann Fragal V, Simao A, and Mousavi MR Kouchnarenko O and Khosravi R Validated test models for software product lines: Featured finite state machines Formal Aspects of Component Software 2017 Cham Springer International Publishing 210-227
[57]
Halin A, Nuttinck A, Acher M, Devroey X, Perrouin G, and Baudry B Test them all, is it worth it? assessing configuration sampling on the jhipster web development stack Empir Softw Eng 2019 24 2 674-717
[58]
Han X, Hu L, Mei L, Dang Y, Agarwal S, Zhou X, Hu P (2020) A-bps: Automatic business process discovery service using ordered neurons lstm. In: 2020 IEEE international conference on web services (ICWS). IEEE, pp 428–432
[59]
Hanga KM, Kovalchuk Y, and Gaber MM A graph-based approach to interpreting recurrent neural networks in process mining IEEE Access 2020 8 172923-172938
[60]
Harane N, Rathi S (2020) Comprehensive survey on deep learning approaches in predictive business process monitoring. Modern approaches in machine learning and cognitive science: a walkthrough, pp 115–128
[61]
Hariyanti E, Djunaidy A, Siahaan D (2021) Information security vulnerability prediction based on business process model using machine learning approach. Computers & Security 110:102422. https://www.sciencedirect.com/science/article/pii/S0167404821002467
[62]
Henard C, Papadakis M, Perrouin G, Klein J, Heymans P, and Traon YL Bypassing the combinatorial explosion: Using similarity to generate and prioritize t-wise test configurations for software product lines IEEE Trans Softw Eng 2014 40 7 650-670
[63]
Henard C, Papadakis M, Perrouin G, Klein J, Traon YL (2013) PLEDGE: a product line editor and test generation tool. In: 17th International software product line conference co-located workshops, SPLC 2013 workshops, Tokyo, Japan - August 26 - 30, 2013. ACM, pp 126–129.
[64]
Hinkka M, Lehto T, Heljanko K, Jung A (2018) Classifying process instances using recurrent neural networks. In: International conference on business process management. Springer, pp 313–324.
[65]
Hochreiter S The vanishing gradient problem during learning recurrent neural nets and problem solutions Int J Uncertain Fuzziness Knowl-Based Syst 1998 6 02 107-116
[66]
Hochreiter S and Schmidhuber J Long short-term memory Neural Comput 1997 9 8 1735-1780
[67]
Hui L, Belkin M (2021) Evaluation of neural architectures trained with square loss vs cross-entropy in classification tasks. In: The ninth international conference on learning representations (ICLR 2021)
[68]
Iscen A, Tolias G, Avrithis Y, Chum O (2019) Label propagation for deep semi-supervised learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 5070–5079
[69]
Jaccard P Étude comparative de la distribution florale dans une portion des alpes et des jura Bull Soc Vaudoise Sci Nat 1901 37 547-579
[70]
Japkowicz N, Shah M (2011) Evaluating learning algorithms: a classification perspective. Cambridge University Press
[71]
Kaltenecker C, Grebhahn A, Siegmund N, and Apel S The interplay of sampling and machine learning for software performance prediction IEEE Softw 2020 37 4 58-66
[72]
Kang K, Cohen S, Hess J, Novak W, Peterson AS (1990) Feature-Oriented Domain Analysis (FODA) Feasibility Study. Tech. rep., Carnegie-Mellon University, Software Engineering Institute
[73]
Kerdoudi ML, Ziadi T, Tibermacine C, Sadou S (2019) Recovering software architecture product lines. In: 2019 24th international conference on engineering of complex computer systems (ICECCS) IEEE, pp 226–235
[74]
Khoshmanesh S, Lutz R (2020) Does link prediction help find feature interactions in software product lines? In: 2020 IEEE seventh international workshop on artificial intelligence for requirements engineering (AIRE). IEEE, pp 87–90
[75]
Kowsari K, Brown DE, Heidarysafa M, Meimandi KJ, Gerber MS, Barnes LE (2017) Hdltex: Hierarchical deep learning for text classification. In: 16th IEEE international conference on machine learning and applications (ICMLA). IEEE, pp 364–371.
[76]
Kratsch W, Manderscheid J, Röglinger M, Seyfried J (2020) Machine learning in business process monitoring: a comparison of deep learning and classical approaches used for outcome prediction. Business & Information Systems Engineering, pp 1–16
[77]
La Rosa M, Dumas M (2008) Configurable process models: how to adopt standard practices in your how way? BPTrends Newsletter
[78]
Lee DH et al (2013) Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks. In: Workshop on challenges in representation learning, vol. 3. ICML, pp 896
[79]
Levenshtein VI et al (1966) Binary codes capable of correcting deletions, insertions, and reversals. In: Soviet physics doklady, vol 10. Soviet Union, pp 707–710
[80]
Li Y, Schulze S, Saake G (2017) Reverse engineering variability from natural language documents: A systematic literature review. In: Proceedings of the 21st International systems and software product line conference-volume A. ACM, pp 133–142.
[81]
Li Y, Schulze S, Saake G (2017) Reverse engineering variability from natural language documents: A systematic literature review. In: SPLC’17 - volume A, SPLC ’17. ACM, New York, NY, USA, pp 133–142. http://doi.acm.org/10.1145/3106195.3106207
[82]
Li Y, Schulze S, Xu J (2020) Feature terms prediction: A feasible way to indicate the notion of features in software product line. In: Proceedings of the evaluation and assessment in software engineering, EASE ’20. Association for Computing Machinery, New York, NY, USA, pp 90-99.
[83]
Lima C, Assunção WK, Martinez J, Mendonça W, Machado IC, and Chavez CF Product line architecture recovery with outlier filtering in software families: the apo-games case study J Braz Comput Soc 2019 25 1 1-17
[84]
Lin TY, Goyal P, Girshick R, He K, and Dollár P Focal loss for dense object detection IEEE Trans Pattern Anal Mach Intell 2020 42 2 318-327
[85]
Liu P, Qiu X, Huang X (2016) Recurrent neural network for text classification with multi-task learning. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, IJCAI’16. AAAI Press, pp 2873-2879.
[86]
Lopez-Herrejon RE, Linsbauer L, Egyed A (2015) A systematic mapping study of search-based software engineering for software product lines. Inf Softw Technol 61:33–51. https://www.sciencedirect.com/science/article/pii/S0950584915000166
[87]
Mans RS, Schonenberg M, Song M, van der Aalst WM, Bakker PJ (2008) Application of process mining in healthcare–a case study in a dutch hospital. In: International joint conference on biomedical engineering systems and technologies. Springer, pp 425–438.
[88]
Martin H, Acher M, Pereira JA, Jézéquel JM (2021) A comparison of performance specialization learning for configurable systems. In: Proceedings of the 25th ACM international systems and software product line conference-volume A, pp. 46–57
[89]
Martinez J, Parsai A (2018) D3.1: Identification of relevant state of the art. Tech. rep., ITEA 3 ReVAMP2 Project Consortium
[90]
Matzner M, Eskofier B (2021) Time matters: Time-aware lstms for predictive business process monitoring. In: Process mining workshops: ICPM 2020 international workshops, Padua, Italy, October 5–8, 2020, Revised Selected Papers, vol. 406. Springer Nature, pp 112
[91]
Michelon GK, Linsbauer L, Assunção WK, Fischer S, Egyed A (2021) A hybrid feature location technique for re-engineeringsingle systems into software product lines. In: 15th International working conference on variability modelling of software-intensive systems, pp 1–9
[92]
Michelon GK, Martinez J, Sotto-Mayor B, Arrieta A, Assunção WK, Abreu R, Egyed A (2023) Spectrum-based feature localization for families of systems. J Syst Softw 195:111532. https://www.sciencedirect.com/science/article/pii/S0164121222002084
[93]
Mortara J, Collet P (2021) Capturing the Diversity of Analyses on the Linux Kernel Variability. Association for Computing Machinery, New York, NY, USA, pp 160-171.
[94]
Nagarajah T, Poravi G (2019) A review on automated machine learning (automl) systems. In: 2019 IEEE 5th international conference for convergence in technology (I2CT). IEEE, pp 1–6
[95]
Nair V, Menzies T, Siegmund N, Apel S (2017) Using bad learners to find good configurations. In: E. Bodden, W. Schäfer, A. van Deursen, A. Zisman (eds.) Proceedings of the 2017 11th joint meeting on foundations of software engineering, ESEC/FSE 2017, Paderborn, Germany, September 4-8, 2017. ACM, pp 257–267.
[96]
Nemenyi PB (1963) Distribution-free multiple comparisons. Princeton University
[97]
Neu DA, Lahann J, Fettke P (2021) A systematic literature review on state-of-the-art deep learning methods for process prediction. Artif Intell Rev 1–27
[98]
Nguyen HTC, Lee S, Kim J, Ko J, and Comuzzi M Autoencoders for improving quality of process event logs Exp Syst Appl 2019 131 132-147
[99]
Nolle T, Seeliger A, Mühlhäuser M (2018) Binet: multivariate business process anomaly detection using deep learning. In: International conference on business process management. Springer, pp 271–287.
[100]
Nolle T, Seeliger A, Thoma N, Mühlhäuser M (2020) Deepalign: Alignment-based process anomaly correction using recurrent neural networks. In: International conference on advanced information systems engineering. Springer, pp 319–333.
[101]
Park G and Song M Predicting performances in business processes using deep neural networks Decis Support Syst 2020 129 113191
[102]
Pereira JA, Martin H, Temple P, Acher M (2020) Machine learning and configurable systems: A gentle introduction. In: Proceedings of the 24th ACM conference on systems and software product line: volume A, SPLC ’20. ACM.
[103]
Pohl K, Böckle G, and van der Linden FJ Software Product Line Engineering: Foundations 2005 Principles and Techniques Springer-Verlag
[104]
Pohl K, Böckle G, Van Der Linden F (2005) Software product line engineering: foundations, principles, and techniques. Springer
[105]
Ramos-Gutiérrez B, Varela-Vaca ÁJ, Galindo JA, Gómez-López MT, and Benavides D Discovering configuration workflows from existing logs using process mining Empir Softw Eng 2021 26 1 1-41
[106]
Rosa ML, Aalst WMVD, Dumas M, and Milani FP Business process variability modeling: A survey ACM Comput Surv 2017 50 1 1-45
[107]
Rumelhart DE, Hinton GE, and Williams RJ Learning representations by back-propagating errors Nature 1986 323 6088 533-536
[108]
Sánchez AB, Segura S, Parejo JA, and Cortés AR Variability testing in the wild: the drupal case study Softw Syst Model 2017 16 1 173-194
[109]
Schobbens P, Heymans P, Trigaux J, and Bontemps Y Generic semantics of feature diagrams Comput Netw 2007 51 2 456-479
[110]
Schuster M and Paliwal KK Bidirectional recurrent neural networks IEEE Trans Signal Process 1997 45 11 2673-2681
[111]
She S, Lotufo R, Berger T, Wasowski A, and Czarnecki K The variability model of the linux kernel VaMoS 2010 10 10 45-51
[112]
She S, Lotufo R, Berger T, Wasowski A, Czarnecki K (2011) Reverse engineering feature models. In: Proceedings of the 33rd international conference on software engineering. ACM, pp 461–470
[113]
Shu Y, Sui Y, Zhang H, Xu G (2020) Perf-al: Performance prediction for configurable software through adversarial learning. In: Proceedings of the 14th ACM/IEEE international symposium on empirical software engineering and measurement (ESEM), pp. 1–11
[114]
Sikal R, Sbai H, Kjiri L (2018) Configurable process mining: variability discovery approach. In: IEEE 5th International Congress on Information Science and Technology (CiSt). IEEE, pp 137–142.
[115]
Song M, Yang H, Siadat SH, Pechenizkiy M (2013) A comparative study of dimensionality reduction techniques to enhance trace clustering performances. Exp Syst Appl 40(9):3722–3737. https://www.sciencedirect.com/science/article/pii/S095741741201319X
[116]
Strüder S, Mukelabai M, Strüber D, Berger T (2020) Feature-oriented defect prediction. In: Proceedings of the 24th ACM conference on systems and software product line: volume A. ACM, pp 1–12.
[117]
Sun X, Hou W, Ying Y, Yu D (2020) Remaining time prediction of business processes based on multilayer machine learning. In: 2020 IEEE International conference on web services (ICWS). IEEE, pp 554–558
[118]
Tax N, Verenich I, La Rosa M, Dumas M (2017) Predictive business process monitoring with lstm neural networks. In: Advanced information systems engineering. Springer, pp 477–492.
[119]
Taymouri F, Rosa ML, Dumas M, Maggi FM (2021) Business process variant analysis: Survey and classification. Knowl-Based Syst 211:106557. https://www.sciencedirect.com/science/article/pii/S0950705120306869
[120]
Tello-Leal E, Roa J, Rubiolo M, Ramirez-Alcocer UM (2018) Predicting activities in business processes with lstm recurrent neural networks. In: 2018 ITU Kaleidoscope: machine learning for a 5G future (ITU K). IEEE, pp 1–7
[121]
Temple P, Acher M, and Jézéquel JM Empirical assessment of multimorphic testing IEEE Trans Softw Eng 2021 47 7 1511-1527
[122]
Temple P, Galindo JA, Acher M, Jézéquel J (2016) Using machine learning to infer constraints for product lines. In: H. Mei (ed.) Proceedings of the 20th international systems and software product line conference, SPLC 2016, Beijing, China, September 16-23, 2016. ACM, pp 209–218.
[123]
Temple P, Perrouin G, Acher M, Biggio B, Jézéquel JM, and Roli F Empirical assessment of generating adversarial configurations for software product lines Empir Softw Eng 2021 26 1 1-49
[124]
Valov P, Guo J, Czarnecki K (2015) Empirical comparison of regression methods for variability-aware performance prediction. In: Proceedings of the 19th international conference on software product line, pp. 186–190
[125]
Varela-Vaca ÁJ, Galindo JA, Ramos-Gutiérrez B, Gómez-López MT, Benavides D (2019) Process mining to unleash variability management: discovering configuration workflows using logs. In: Proceedings of the 23rd international systems and software product line conference-volume A. ACM, pp 265–276.
[126]
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998–6008
[127]
Velez M, Jamshidi P, Siegmund N, Apel S, Kästner C (2021) White-box analysis over machine learning: Modeling performance of configurable systems. In: 2021 IEEE/ACM 43rd international conference on software engineering (ICSE). IEEE, pp 1072–1084
[128]
Venugopal I, Töllich J, Fairbank M, Scherp A (2021) A comparison of deep-learning methods for analysing and predicting business processes. Preprint arXiv:2102.07838
[129]
Vyas G, Vyas S, Paul PK, Sharma A, Bhardwaj C (2019) Prediction algorithms and consecutive estimation of software product line feature model usability. In: 2019 Amity international conference on artificial intelligence (AICAI). IEEE, pp 774–777
[130]
Wang J, Yu D, Liu C, Sun X (2019) Outcome-oriented predictive process monitoring with attention-based bidirectional lstm neural networks. In: 2019 IEEE international conference on web services (ICWS). IEEE, pp 360–367
[131]
Weber M, Apel S, Siegmund N (2021) White-box performance-influence models: A profiling and learning approach. In: 2021 IEEE/ACM 43rd International conference on software engineering (ICSE). IEEE, pp 1059–1071
[132]
Weckesser M, Kluge R, Pfannemüller M, Matthé M, Schürr A, Becker C (2018) Optimal reconfiguration of dynamic software product lines based on performance-influence models. In: Proceedings of the 22nd international systems and software product line conference-vol 1, pp 98–109
[133]
Welsing M, Maetschke J, Thomas K, Gützlaff A, Schuh G, and Meusert S Behrens BA, Brosius A, Hintze W, Ihlenfeldt S, and Wulfsberg JP Combining process mining and machine learning for lead time prediction in high variance processes Production at the leading edge of technology 2021 Berlin Heidelberg, Berlin, Heidelberg Springer 528-537
[134]
Zhang Y, Guo J, Blais E, Czarnecki K (2015) Performance prediction of configurable software systems by fourier learning (t). In: 2015 30th IEEE/ACM international conference on automated software engineering (ASE). IEEE, pp 365–373
Recommendations
VaryMinions: leveraging RNNs to identify variants in event logs
MaLTESQuE 2021: Proceedings of the 5th International Workshop on Machine Learning Techniques for Software Quality EvolutionBusiness processes have to manage variability in their execution, e.g., to deliver the correct building permit in different municipalities. This variability is visible in event logs, where sequences of events are shared by the core process (building ...
A Lyapunov-stability-based context-layered recurrent pi-sigma neural network for the identification of nonlinear systems
AbstractA novel higher-order context-layered recurrent pi-sigma neural network (CLRPSNN) is presented for the identification of nonlinear dynamical systems. The proposed model is the modified form of the classical pi-sigma neural network (PSNN)...
Highlights- A new higher-order context-layered recurrent pi-sigma neural network (CLRPSNN) structure is proposed for solving the identification problem.
Neuron-Level Fuzzy Memoization in RNNs
MICRO '52: Proceedings of the 52nd Annual IEEE/ACM International Symposium on MicroarchitectureRecurrent Neural Networks (RNNs) are a key technology for applications such as automatic speech recognition or machine translation. Unlike conventional feed-forward DNNs, RNNs remember past information to improve the accuracy of future predictions and, ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© Crown 2024.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 15 June 2024
Accepted: 06 March 2024
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 13 Nov 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in