Abstract
The study and development of fault detection and diagnosis (FDD) systems are relevant tasks for industrial processes. Another prominent field is applying deep learning (DL) models to solve engineering problems, such as FDD systems’ design. Often, the preliminary tests are conducted using simulated datasets to verify the chosen methodology and avoid unnecessarily disturbing the real process. Even if the data used come from a computer simulation, it must remain as realistic as possible. In several studies, researchers have used the Tennessee Eastman Process (TEP) benchmark for addressing the application of DL models to build effective FDD frameworks. However, most of them use preexisting datasets, and this presents some drawbacks that can negatively impact the DL model’s training stage. In addition, none of them have evaluated how to adjust the existing FDD model when the process control strategy is changed. This paper presents various topologies of convolutional neural networks (CNNs) to model a FDD system for the TEP benchmark using new datasets. For the first time, we investigate the performance of fully convolutional networks (FCNs) in the TEP study case. Additionally, we apply transfer learning (TL) to surpass the model inadequacy when the data distribution changes due to an alteration in the process’ closed-loop system.
This is a preview of subscription content, log in via an institution to check access.
(Adapted from Aggarwal 2018)
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
The datasets generated during and/or analysed during the current study are available in the new_tep_datasets repository, https://github.com/anasouzac/new_tep_datasets.
References
Abdelkrim C, Meridjet MS, Boutasseta N, Boulanouar L (2019) Detection and classification of bearing faults in industrial geared motors using temporal features and adaptive neuro-fuzzy inference system. https://doi.org/10.1016/j.heliyon.2019.e02046. Heliyon
Aggarwal CC (2018) Neural networks and deep learning – a Textbook, vol 1. Springer Nature, ed. Switzerland
Akiba T, Sano S, Yanase T, Ohta T, Koyama M (2019) Optuna: a next-generation hyperparameter optimization framework. KDD Appl Data Sci Track 19:4–8. https://doi.org/10.1145/3292500.3330701
Andonovski G, Mušič G, Blažič S, Škrjanc I (2018) Evolving model identification for process monitoring and prediction of non-linear systems. Eng Appl Artif Intell 68:214–221. https://doi.org/10.1016/j.engappai.2017.10.020
Baniardalani S, Askari J, Lunze J (2010) Qualitative model based fault diagnosis using a threshold level. Int J Control Autom Syst 8(3):683–694. https://doi.org/10.1007/s12555-010-0323-4
Bathelt A, Ricker NL, Jelali M (2014) Revision of the Tennessee Eastman process model. IFAC-PapersOnLine 48:309–314. https://doi.org/10.1016/j.ifacol.2015.08.199
Behbahani RM, Jazayeri-Rad H, Hajmirzaee S (2009) Fault detection and diagnosis in a sour gas absorption column using neural networks. Chem Eng Technol 32:840–845. https://doi.org/10.1002/ceat.200800486
Botalb A, Moinuddin M, Al-Saggaf UM, Ali SSA (2018) Contrasting Convolutional Neural Network (CNN) with Multi-Layer Perceptron (MLP) for Big Data Analysis. International Conference on Intelligent and Advanced System (ICIAS) 1–5. https://doi.org/10.1109/ICIAS.2018.8540626
Braatz RD (2020) Tennessee Eastman problem simulation data. Massachusetts Institute of Technology. http://web.mit.edu/braatzgroup/links.html. Accessed 20 December 2021
Câmara MM (2019) GitHub. tep2py. https://github.com/camaramm/tep2py. Accessed 20 December 2021
Chen Z, Gryllias K, Li W (2019) Intelligent fault diagnosis for rotary machinery using transferable convolutional neural network. IEEE Trans Industr Inf 16:339–349. https://doi.org/10.1109/TII.2019.2917233
Cheng H, Liu Y, Huang D, Xu C, Wu J (2020) A novel ensemble adaptive sparse bayesian transfer learning machine for nonlinear large-scale process monitoring. Sensors 20:6139. https://doi.org/10.3390/s20216139
Chiang LH, Russell EL, Braatz RD (2000) Fault diagnosis in chemical processes using Fisher discriminant analysis, discriminant partial least squares, and principal component analysis. Chemometr Intell Lab Syst 50:243–252. https://doi.org/10.1016/S0169-7439(99)00061-1
Dalton T, Patton R (1998) Model-based fault diagnosis of a two-pump system. Trans Inst Meas Control 20(3):115–124. https://doi.org/10.1177/014233129802000302
Downs JJ, Vogel EF (1993) A plant-wide industrial process control problem. Comput Chem Eng 17:245–255. https://doi.org/10.1016/0098-1354(93)80018-I
Gao Y, Yang T, Xing N, Xu M Fault Detection and Diagnosis for Spacecraft using Principal Component Analysis and Support Vector Machines. 2012 7th IEEE Conference on Industrial, Electronics (2012) and Applications (ICIEA). https://doi.org/10.1109/ICIEA.2012.6361054
Goodfellow I, Bengio Y, Courville A (2016) Deep learning. 1 ed. MIT Press, Cambridge
Hartert L, Mouchaweh MS, Billaudel P (2010) A semi-supervised dynamic version of fuzzy K-Nearest neighbours to monitor evolving systems. Evol Syst 1:3–15. https://doi.org/10.1007/s12530-010-9001-2
Heo S, Lee JH (2018) Fault detection and classification using artificial neural networks. IFAC Papers Online 51:470–475. https://doi.org/10.1016/j.ifacol.2018.09.380
Hoi SCH, Sahoo D, Lu J, Zhao P (2021) Online learning: a comprehensive survey. Neurocomputing 459:249–289. https://doi.org/10.1016/j.neucom.2021.04.112
Hubel DH, Wiesel T (1959) Receptive fields of single neurones in the cat’s striate cortex. J Physiol 124(3):574–591. https://doi.org/10.1113/jphysiol.1959.sp006308
Hussin NE, Johari A, Kidam K, Hashim H (2015) Major hazards of process equipment failures in the chemical process industry. Appl Mech Mater 735:75–79. https://doi.org/10.4028/www.scientific.net/AMM.735.75
Isermann R (2006) Fault-Diagnosis Systems: an introduction from fault detection to fault tolerance, 1 edn. Springer, Germany
Karimi I, Salahshoor K (2012) A new fault detection and diagnosis approach for a distillation column based on a combined PCA and ANFIS scheme. 2012 24th Chinese Control and Decision Conference (CCDC). https://doi.org/10.1109/CCDC.2012.6244542
Khalifani S, Darvishzadeh R, Azad N, Rahmani RS (2022) Prediction of sunflower grain yield under normal and salinity stress by RBF, MLP and, CNN models. Ind Crops Prod 189(115762). https://doi.org/10.1016/j.indcrop.2022.115762
Kingma DP, Ba JL (2015) Adam: a method for stochastic optimization. 3rd International Conference for Learning Representations (ICLR 2015)
Knowledge transfer from simulation to physical processes. Comput Chem Eng. https://doi.org/10.1016/j.compchemeng.2020.106904
Larsson T et al (2001) Self-optimizing control of a large-scale plant: the Tennessee Eastman process. Ind Eng Chem Res 40:4889–4901. https://doi.org/10.1021/ie000586y
Lau CK, Heng YS, Hussain MA, Mohamad Nor MI (2010) Fault diagnosis of the polypropylene production process (UNIPOL PP) using ANFIS. ISA Trans 49:559–566. https://doi.org/10.1016/j.isatra.2010.06.007
Lecun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proceedings of the IEEE 86(11):2278–2324. https://doi.org/10.1109/5.726791
Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444. https://doi.org/10.1038/nature14539
Li W, Gu S, Zhang X, Chen T (2020) Transfer learning for process fault diagnosis
Li T, Zhao Y, Zhang C, Zhou K, Zhang X (2022) A semantic model-based fault detection approach for building energy systems. Build Environ 207:108548. https://doi.org/10.1016/j.buildenv.2021.108548
Liang J, Du R (2007) Model-based Fault Detection and diagnosis of HVAC systems using support Vector Machine method. Int J Refrig 30:1104–1114. https://doi.org/10.1016/j.ijrefrig.2006.12.012
Liu Q, Huang C (2019) Fault diagnosis method based on transfer convolutional neural networks. IEEE Access 7:171423–171430
Lyman PR, Georgakis M (1995) Plant-wide control of the Tennessee Eastman process. Comput Chem Eng 19:321–331. https://doi.org/10.1016/0098-1354(94)00057-U
Mahadevan S, Shah SL (2009) Fault detection and diagnosis in process data using one-class support vector machines. J Process Control 19:1627–1639. https://doi.org/10.1016/j.jprocont.2009.07.011
Majdani F, Petrovski A, Doolan D (2018) Evolving ANN–based sensors for a context–aware cyber physical system of an offshore gas turbine. Evol Syst 9:119–133. https://doi.org/10.1007/s12530-017-9206-8
McKenzie FD, Gonzalez AJ, Morris R (1998) An integrated model-based approach for real-time on-line diagnosis of complex systems. Eng Appl Artif Intell 11:279–291. https://doi.org/10.1016/S0952-1976(97)00054-7
Medina E, Petraglia MR, Gomes JGRC, Petraglia A (2017) Comparison of CNN and MLP classifiers for algae detection in underwater pipelines. Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA). https://doi.org/10.1109/IPTA.2017.8310098
Oliveira MVM, Cunha BZ, Daniel GB (2021) A model-based technique to identify lubrication condition of hydrodynamic bearings using the rotor vibrational response. Tribol Int 160:107038. https://doi.org/10.1016/j.triboint.2021.107038
Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Trans Knowl Data Eng 22:1345–1359. https://doi.org/10.1109/TKDE.2009.191
Park P, Di Marco P, Shin H, Bang J (2019) Fault detection and diagnosis using combined uutoencoder and long short-term memory network. Sensors. https://doi.org/10.3390/s19214612
Pu X, Li C (2021) Online semisupervised broad learning system for industrial fault diagnosis. IEEE Trans Industr Inf 17(10). https://doi.org/10.1109/TII.2020.3048990
Renton G, Chatelain C, Adam S, Kermorvant C, Paquet T (2017) Handwritten text line segmentation using fully convolutional network. 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), pp 5–9. https://doi.org/10.1109/ICDAR.2017.321
Ricker NL (2005) Tennessee Eastman Challenge Archive. http://depts.washington.edu/control/LARRY/TE/download.html. Accessed 20 December 2021
Rieth CA, Amsel BD, Tran R, Cook MB (2017) Additional Tennessee Eastman Process Simulation Data for Anomaly Detection Evaluation. Harvard Dataverse, V1. https://doi.org/10.7910/DVN/6C3JR1
Rostek K, Morytko L, Jankowska A (2015) Early detection and prediction of leaks in fluidized-bed boilers using artificial neural networks. Energy 89:914–923. https://doi.org/10.1016/j.energy.2015.06.042
Russell EL, Chiang LH, Braatz RD (2000) Fault detection in industrial processes using canonical variate analysis and dynamic principal component analysis. Chemometr Intell Lab Syst 51:81–93. https://doi.org/10.1016/S0169-7439(00)00058-7
Santos MR, Costa BSJ, Bezerra CG, Andonovski G, Guedes LA (2022) An evolving approach for fault diagnosis of dynamic systems. Expert Syst Appl 189:115983. https://doi.org/10.1016/j.eswa.2021.115983
Saxena A, Kumar R, Rawat AK, Majid M, Singh J, Devakirubakaran S, Singh GK (2023) Abnormal health monitoring and assessment of a three-phase induction motor using a supervised CNN-RNN-based machine learning algorithm. Math Probl Eng. https://doi.org/10.1155/2023/1264345
Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39:640–651. https://doi.org/10.1109/TPAMI.2016.2572683
Shi J, Peng D, Peng Z, Zhang Z, Goebel K, Wu D (2022) Planetary gearbox fault diagnosis using bidirectional-convolutional LSTM networks. Mech Syst Signal Process 162(107996). https://doi.org/10.1016/j.ymssp.2021.107996
Shin HJ, Eom D, Kim S (2005) One-class support vector machines—an application in machine fault detection and classification. Comput Ind Eng 48:395–408. https://doi.org/10.1016/j.cie.2005.01.009
Shu Y et al (2016) Abnormal situation management: Challenges and opportunities in the big data era. Comput Chem Eng 91:104–113. https://doi.org/10.1016/j.compchemeng.2016.04.011
Simani S, Fantuzzi C (2006) Dynamic system identification and model-based fault diagnosis of an industrial gas turbine prototype. Mechatronics 16:341–363. https://doi.org/10.1016/j.mechatronics.2006.01.002
Souza ACO (2021) new-tep-datasets. v1. https://github.com/anasouza26/new_tep_datasets. Accessed 20 December 2021
Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2015) Striving for simplicity: the all convolutional net. International Conference on Learning Representations (ICLR), pp 1–14
Subbaraj P, Kannapiran B (2014) Fault detection and diagnosis of pneumatic valve using adaptive neuro-fuzzy inference system approach. Appl Soft Comput 19:362–371. https://doi.org/10.1016/j.asoc.2014.02.008
Tian T, Chu Z, Hu Q, Ma L (2021) Class-wise fully convolutional network for semantic segmentation of remote sensing images. Remote Sens. https://doi.org/10.3390/rs13163211
Tidriri K, Chatti N, Verron S, Tiplica T (2018) Model-based fault detection and diagnosis of complex chemical processes: A case study of the Tennessee Eastman process. Proceeding of the Institution of Mechanical Engineers Part I - Journal of Systems and Control Engineering 232(6):742–760. https://doi.org/10.1177/0959651818764510
Torrecilla JL, Romo J (2018) Stat Probab Lett 136:15–19. https://doi.org/10.1016/j.spl.2018.02.038. Data learning from big data
Toubakh H, Sayed-Mouchaweh M (2015) Hybrid dynamic data-driven approach for drift-like fault detection in wind turbines. Evol Syst 6:115–129. https://doi.org/10.1007/s12530-014-9119-8
Venkatasubramanian V (2019) The promise of artificial intelligence in chemical engineering: is it here. finally? AlChE Journal 65(2):466–478. https://doi.org/10.1002/aic.16489
Venkatasubramanian V, Vaidyanathan R, Yamamoto Y (1990) Process fault detection and diagnosis using neural networks—I. steady-state processes. Comput Chem Eng 14:699–712. https://doi.org/10.1016/0098-1354(90)87081-Y
Venkatasubramanian V et al (2003a) A review of process fault detection and diagnosis, part I: quantitative model-based methods. Comput Chem Eng 27:293–311. https://doi.org/10.1016/S0098-1354(02)00160-6
Venkatasubramanian V et al (2003b) A review of process fault detection and diagnosis, part II: qualitative models and search strategies. Comput Chem Eng 27:313–326. https://doi.org/10.1016/S0098-1354(02)00161-8
Venkatasubramanian V et al (2003c) A review of process fault detection and diagnosis, part III: process history based methods. Comput Chem Eng 27:327–346. https://doi.org/10.1016/S0098-1354(02)00162-X
Wang H, Li P, Gao F, Song Z, Ding SX (2006) Kernel classifier with adaptive structure and fixed memory for process diagnosis. AIChE J 52:3515–3531. https://doi.org/10.1002/aic.10982
Wang X, Liu X, Li Y (2019) An incremental model transfer method for complex process fault diagnosis. IEEE/CAA J Automatica Sinica 6(5):1268–1280. https://doi.org/10.1109/JAS.2019.1911618
Wang K, Zhou W, Mo Y, Yuan X, Wang Y, Yang C (2022) New mode cold start monitoring in industrial processes: a solution of spatial–temporal feature transfer. Knowl Based Syst 248:108851. https://doi.org/10.1016/j.knosys.2022.108851
Wu H, Zhao J (2018) Deep convolutional neural network model based chemical process fault diagnosis. Computers & Chemical Engineering 115:185–197. https://doi.org/10.1016/j.compchemeng.2018.04.009
Wu H, Zhao J (2020) Fault detection and diagnosis based on transfer learning for multimode chemical processes. Comput Chem Eng. https://doi.org/10.1016/j.compchemeng.2020.106731
Xavier GM, Seixas JM (2018) Fault detection and diagnosis in a chemical process using long short-term memory recurrent neural network. 2018 International Joint Conference on Neural Networks (IJCNN). https://doi.org/10.1109/IJCNN.2018.8489385
Xie D, Bai L (2015) A hierarchical deep neural network for fault diagnosis on Tennessee-Eastman process. 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA). https://doi.org/10.1109/ICMLA.2015.208
Xie Z, Yang X, Li A, Ji Z (2019) Fault diagnosis in Industrial Chemical processes using optimal probabilistic neural network. Can J Chem Eng 97:2453–2464. https://doi.org/10.1002/cjce.23491
Yong LZ, Nugroho H (2022) Acoustic anomaly detection of mechanical failure: time-distributed CNN-RNN deep learning models. Control, instrumentation and mechatronics: theory and practice. Lecture Notes in Electrical Engineering 921:662–672. https://doi.org/10.1007/978-981-19-3923-5_57
Zhang Z, Zhao J (2017) A deep belief network based fault diagnosis model for complex chemical processes. Comput Chem Eng 107:395–407. https://doi.org/10.1016/j.compchemeng.2017.02.041
Zhang R, Tao H, Wu L, Guan Y (2017) Transfer learning with neural networks for bearing fault diagnosis in changing working conditions. IEEE Access 5:14347–14357. https://doi.org/10.1109/ACCESS.2017.2720965
Zhang S, Bi K, Qiu T (2020) Bidirectional recurrent neural network-based chemical process fault diagnosis. Ind Eng Chem Res 59:824–834. https://doi.org/10.1021/acs.iecr.9b05885
Zhu Q, Jia Y, Peng D, Xu Y (2014) Study and application of fault prediction methods with improved reservoir neural networks. Chin J Chem Eng 22:812–819. https://doi.org/10.1016/j.cjche.2014.05.016
Acknowledgements
Authors appreciate the financial support provided by Conselho Nacional de Desenvolvimento Científico e Tecnológico – CNPq (Grant number: 140913/2019-0). Professor Maurício B. de Souza Jr. is grateful to financial support from CNPq (Grant number: 311153/2021-6).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
e Souza, A.O., de Souza, M.B. & da Silva, F.V. Enhancing fault detection and diagnosis systems for a chemical process: a study on convolutional neural networks and transfer learning. Evolving Systems 15, 611–633 (2024). https://doi.org/10.1007/s12530-023-09523-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12530-023-09523-y