1. Introduction
In the slurry pipeline transportation system, the high-pressure diaphragm pump is the core power source of the system. As an important mechanical part of the high-pressure diaphragm pump, the working condition of the check valve affects the performance of the entire system; if internal damage occurs, it will affect the operation of the whole system. Therefore, it is of great significance to monitor the operating status of the check valve [
1,
2].
The high-pressure diaphragm pump is a typical nonlinear dynamical system. The vibration signal generated by the check valve during operation has non-stationary and nonlinear characteristics. In recent years, the entropy theory of nonlinear dynamics methods has been widely used in the field of fault diagnosis because of its good ability to characterize fault information [
3,
4,
5]. Cui Ruihua [
6] proposed a method for extracting fault features based on variational mode decomposition-approximate entropy, combined with the support-vector machine to accurately identify arc faults. Chen K. [
7] used the complementary ensemble empirical mode decomposition (CEEMD) algorithm to analyze the vehicle condition signal and used the sample entropy to eliminate the noise, which improved the reliability of the operational path analysis (OPAX) method. Chen Qiangqiang [
8] used smoothness prior analysis (SPA) to adaptively decompose the rolling bearing signal into tendency items and fluctuation items and established a rolling-bearing performance-degradation-prediction model based on permutation entropy, which effectively monitored the bearing operation.
The above literature has been successfully applied to the problem of mechanical-fault diagnosis, but its popularization and application is limited by the deficiency in feature extraction of the signal, such as the deviation of approximate entropy when matching itself. Sample entropy is heavily dependent on data length and poor anti-interference, and permutation entropy is not sensitive to abnormal points in the internal sequence when calculating the probability distribution [
9]. In addition, all of the above methods ignore the frequency-domain entropy characteristics of the signal. In order to overcome the above problems, the frequency-domain fuzzy entropy of SPA components is used for check-valve fault-information extraction. The SPA adaptive decomposition of the check-valve vibration signal is performed to extract the tendency and fluctuation terms of the signal, and the frequency-domain fuzzy entropy of the tendency and fluctuation terms is calculated as the characterization vector of the operating state of the check valve to achieve better feature extraction.
A reliable and stable fault-state-identification model based on the frequency-domain fuzzy entropy feature-information-extraction method of the SPA component is the key to the fault diagnosis of the check valve. The extreme learning machine (ELM), as a single hidden layer forward neural network, is widely used in the construction of fault-diagnosis models with its good nonlinear fitting ability and efficient learning efficiency [
10,
11,
12,
13]. However, the random selection of hidden nodes in ELM results in the unstable output results of the hidden layer, which reduces its generalization ability and robustness. For this reason, Zhang [
14] used the L1 norm as a constraint item of the loss function and proposed an outlier robust extreme-learning machine (ORELM), which effectively improved the generalization performance of the model. Although the ORELM based on the L1 norm requires greater computational time cost, the successful application of ORELM provides a new way to improve the generalization performance of ELM. Drawing on ORELM, the paper proposes the kernel extreme-learning machine (KELM) functional norm-regularization method to construct the Structure Constrained kernel extreme-learning machine (SC-KELM) model and applies it to check-valve fault diagnosis. The introduction of the functional norm-regularization method improves the generalization ability and recognition accuracy of the model.
2. Basic Theory
2.1. Smoothing Prior Approach (SPA)
SPA is an estimation method for the smoothing tendency of nonlinear signals, which is now widely used in the geological [
15] and medical [
16] fields for signal processing, and its principles are mainly as follows.
If the original signal is
Z and its nonlinear trend term is represented by
Zt, construct an observation model for
Zt.
where
is the observation matrix,
is the data length,
is the regression parameter, and
v is the observation error.
In the process of solving the optimal solution
, based on the least-squares method, a regular term factor is introduced to restrict the estimated tendency term, that is,
where
λ is the regularization parameter and
Dd is the matrix of the
dth order differential operator for the discretization of the original signal, and the calculation of
Dd is illustrated below in terms of the second order discrete differential operator.
If there are
N local peaks inside the original signal, the tendency term can be expressed as
Zt = [
Z1,
Z2, …,
ZN]
T; then,
where the constant matrix is the representation of
Dd; by analogy with the above procedure, the solution of the discrete differential operator matrices of other orders can be achieved.
Find the derivative of Equation (2), it follows that
(when the above formula is equal to 0, the
θ obtained is the optimal solution of Equation (2)).
where
H is usually chosen to be the identity matrix
, for the matrix
, which gives a good estimation of the tendency term in the signal when the order is 2. It can be expressed as
According to the above process, the fluctuation term of the original signal
Zdet is
2.2. Frequency-Domain Entropy (FDE)
The frequency-domain entropy reflects the modal information of the signal from the perspective of the frequency-component structure and the characteristics of the signal and uses the spectrum-energy-difference coefficient to measure the complexity of the signal. The more discrete the distribution of different frequency components, the larger the entropy value, and the calculation process is as follows [
17].
Given the vibration signal
X = {
x1,
x2 …,
xN}, the spectral energy sequence is obtained by processing with the Fourier transform method.
Based on the definition of Shannon entropy, its frequency-domain entropy is expressed as follows.
where
, denotes the proportion of the
kth spectrum among all spectra.
2.3. Frequency-Domain Fuzzy Entropy (FFE)
Based on the calculation process of the fuzzy entropy definition of the frequency-domain entropy, the frequency-domain fuzzy-entropy algorithm is proposed. First, the spectrum component extracted from formula (9) is restructured in phase space with length m, and a total of
N-
M+1 vector is obtained, that is,
where
I = 1, 2, …
N-m+1,
is a vector consisting of
m consecutive values starting from the
ith point minus the value of the mean
.
Define the distance
between
,
as the one with the largest difference between the corresponding elements of both.
where
i,
j = 1, 2,
N-m,
i ≠
j.
Calculate the fuzzy affiliation of
,
based on the distance d
.
where
n,
r are the boundary gradient and width of the fuzzy function
, respectively.
Find the mean of all vague affiliations other than itself.
Growing
m to
m+1 and repeating the above process; then,
When the length of the sequence is a finite value, the frequency-domain entropy of the sequence can be expressed as follows:
3. Structurally Constrained KELM (SC-KELM)
ELM is a single hidden layer forward neural network, and the principle is as follows:
Given
N training samples
, where
,
. If the number of hidden layer nodes of ELM is
L, the following condition should be met in order to minimize the output error of the learning target:
There is
βi,
Wi, and
, such that
where
g is the activation function,
Wi = [
wi1,
wi2,…wim]
T is the input weight and
βi is the output weight;
bi is the bias of the
ith hidden layer cell; and
WiXj denotes the inner product of
Wi and
Xj, which can be represented by the matrix as follows:
where
H is the output matrix of the hidden layer,
β is the output weight matrix, and
Y is desired output result of the learning model.
To solve the instability of output results caused by the random initialization of ELM parameters, Huang [
18] proposed the kernel extreme-learning machine (KELM, kernel extreme-learning machine), which introduces a nonlinear mapping
φ for constructing the kernel matrix
HELM [
19,
20]. The elements of
HELM at row
i and column
j are defined as follows:
K(
xi,
xj) is generally obtained using the radial basis function:
where
σ is the kernel function width; then, its output is
In order to improve the generalization performance of KELM, the paper proposes the function parametric constraint KELM algorithm to construct the SC-KELM diagnostic model. The optimization target function is as follows:
where
is the function norm constraint term, which is the norm of the function
f in the regenerating kernel Hilbert space (RKHS, reproducing kernel Hilbert space), and α is the corresponding penalty factor.
In the RKHS, the solution of
f is as follows:
where
φ is the nonlinear mapping function, the function
f in RKHS consists of
, and
L is the number of hidden layers.
Let
β = [
β1,
β2,…
βL]
T,
φ = [
φ(
x1),
φ(
x2),…
φ(
xL)]; then, the norm of the function
can be solved as follows:
where
K is the Gram matrix in the Hilbert space of the regenerating kernel. Substituting Equation (26) into Equation (24), we obtain
The derivation of the above equation.
When the derivative is equal to 0, the output weight matrix is obtained as
Input the test sample
x, and the output result of the model is
4. Structurally Constrained KELM Fault-Diagnosis Model Based on Frequency-Domain Fuzzy Entropy
The basic process of structurally constrained KELM based on the frequency-domain fuzzy entropy is as follows:
(1) The check-valve vibration signal acquisition: to obtain the vibration signal data of the check valve under normal, stuck valve, and wear states.
(2) The nonlinear tendency and fluctuation term extraction of the vibration signal: using the SPA method to separate the nonlinear tendency and fluctuation term of the signal.
(3) The vibration signal feature vector extraction: the frequency-domain fuzzy entropy of the component signal is obtained to construct the input vector of the fault identification model.
(4) Sample partitioning: the feature vector set obtained is randomly partitioned into 50% for training and 50% for testing sets.
(5) Construct and optimize the model: calculate the HELM matrix according to formula (22), set the range of α, input the training set to the SC-KELM recognition model, and calculate the output weight β according to formula (29).
(6) Input the test samples to identify the operation status of check value and evaluate the model performance in terms of accuracy of recognition.
5. Experiments and Analysis
5.1. Experimental Equipment and Data
In this paper, a high-pressure diaphragm pump station check valve of an iron ore concentrate pipeline No. 3 in Yunnan is taken as the research object, and the vibration signal data of its normal, wear, and stuck valve operation states are selected to verify the effectiveness of the scheme proposed in this paper. The names and models of the equipment are shown in
Table 1.
In the process of data acquisition, the sampling frequency f of the check valve acceleration sensor is set to 2560 Hz, the data length of a single sampling is 1280, and 60 groups of single data are collected under different operating states. The vibration acceleration signals are shown in
Figure 1, where a is the acceleration; the horizontal axis corresponds to the number of sampling points, from which it can be seen that in the normal operating state, its signal is relatively smooth. Occasionally, there will be certain fluctuations, mainly by the noise from the outside, but when its operating state is the stuck or wear state, the signal contains shock characteristics.
5.2. Feature Extraction
When extracting the nonlinear tendency and fluctuation terms of vibration signals with SPA, λ will bring some influence on the results. Hence, a randomly selected section of the stuck signal with different coefficients λ was subjected to SPA decomposition, and the correlation coefficient was used to measure the level of separation of the tendency and fluctuation term from the original signal, as shown in
Figure 2 and
Figure 3.
From
Figure 2 and
Figure 3, it can be seen that when λ = 6, the separation of the tendency term, the fluctuation term, and the original signal tends to be stable; if the value of λ is too large, the extraction of the tendency term will be too aggressive, while if it is too small it will be too smooth and reduce the distinction between different states [
16], so we set λ = 6. The result of the SPA decomposition is shown in
Figure 4.
It can be seen from
Figure 4 that after SPA decomposition, the obtained tendency item and fluctuation item are clearly distinguished. They reflect the basic characteristics of the vibration signals from different aspects. The tendency items accurately synchronize the curve trajectory of the original signal, the fluctuation items record the original detailed information such as signal amplitude and peak value, and the decomposition results illustrate the rationality of the SPA’s signal decomposition.
After the separation of the nonlinear trend and fluctuation terms of the check-valve vibration signal, the FFE value of the corresponding component is used the input vector of the diagnostic model. The solution process of FFE mainly includes phase-space reconstruction and fuzzy membership calculation, where the dimension m in phase-space reconstruction, the boundary width r of the fuzzy affiliation function in the affiliation calculation process, and the gradient n will bring an impact on the results. The value of m is generally 2/3 in order to effectively ensure the integrity of the sequence information; if r is too large it will cause the loss of information in the signal, and if it is too small it will reduce the noise resistance. Usually, it is set to 0.15–0.25SD (SD is the standard deviation of the sequence), while n mainly plays a weighting role in the similarity calculation process of the reconstruction vector, generally consistent with the dimension of the reconstruction component [
21], so this paper sets m = 2, r = 0.2 SD, n = 2 in turn. According to the above settings, a total of 3 groups * 60 frequency-domain fuzzy entropy vectors are obtained, and their distribution is shown in
Figure 5 and
Figure 6. As can be seen from the figure, from the perspective of the components, the difference in entropy values between the fluctuation term and the trend term is obvious; this is because the entropy measures the degree of complexity and regularity of the signal; the tendency term depicts the basic physical characteristics of the vibration signal, which is relatively smooth and regular, so the value of entropy is smaller; the fluctuation term specifies the change process of the vibration signal in the adjacent time period; and the sharpness of its change is much larger than that of the tendency term, so there are obvious differences in entropy values between the two components. From the entropy value of the different operating conditions of the check valve, whether it is the tendency term or the fluctuation term, the entropy value in different operating states has good stratification in spatial distribution. Therefore, the frequency-domain fuzzy entropy can be used to complete the fault information extraction of the vibration signal of the check valve, and the effective combination of the frequency-domain fuzzy entropy of the trend term and the fluctuation term can be used to characterize the different operating states of the check valve.
5.3. Operational-Status Recognition
After the above processing, the effective combination of the frequency-domain fuzzy entropy of the extracted nonlinear trend item and fluctuation item is used as the input vector of the fault-diagnosis model. First, 30 samples are randomly selected in the fault-feature sample set of each state as training samples, and the remaining 30 samples are used as test samples. The labels of normal, stuck valve, and wear state correspond to “1”, “2”, and “3” respectively; secondly, the training samples are sent to the SC-KELM model for training, and the output weight matrix is obtained; finally, the test samples are used to verify the model, and the diagnostic results are shown in
Figure 7. It can be seen from the figure that the fault-identification accuracy rate of the model is 96.67%, which proves the effectiveness of the scheme proposed in this paper.
In order to illustrate the extraction performance of the fault features, SPA-FFE, EMD-FE, EMD-FFE, and SPA-FE are used for fault-feature extraction and compared with the proposed scheme in this paper, respectively. After EMD decomposition, 10 intrinsic mode functions are obtained from the original signal of each operating state. It is generally believed that the IMF, which is highly correlated with the original signal, contains adequate information of the fault feature. Therefore, the correlation coefficients between multiple IMFs and the original signal are solved separately, and the results are shown in
Table 2. It can be seen from the table that IMF1, IMF2, and IMF4 in the normal state maintain a high correlation with the original signal, while the wear state is IMF3, IMF8, and IMF9, respectively, and in the stuck valve state, the first three-order IMF and the original signal has a high Pearson coefficient, so the FFE and FE of the IMF obtained from the above decomposition are used to characterize the operating state of the check valve. Finally, the eigenvectors extracted under the different schemes were input into SC-KELM for fault identification, and the results are shown in
Table 3. It can be seen from the figure that both the local fault-tolerance rate under the same working conditions and the overall recognition accuracy have been improved to a certain extent by the scheme in this paper.
Meanwhile, to illustrate the generalization performance of SC-KELM, the fault features of the check valve extracted by SPA-FFE are used as the input vectors of the ELM and KELM, respectively, and the diagnostic results are compared with MC-KELM. The ELM selects the Sigmoid activation function; the number of hidden layer nodes is set to 30, and the regulation parameters in MC-KELM and KELM are set to 0.5. During the experiment, the training and testing samples were randomly selected, the ratio remained unchanged, and each algorithm was run independently 5 times; its recognition accuracy curve is shown in
Figure 8, from which it can be seen that the recognition accuracy of SC-KELM is significantly higher that the ELM and KELM, and the stability of the SC-KELM recognition rate is better than the KELM because the regular term of the function can more effectively control the range of the output weight and enhance the stability and generalization ability of the model.
6. Conclusions
A function norm regularization method suitable for the KELM is proposed, which is used to constrain the structure of KELM, and the SC-KELM check-valve fault-diagnosis model is established based on the regularized KELM. The nonlinear dynamics of the check valve are characterized by the SPA component frequency-domain fuzzy entropy to characterize the operating state of the check valve, which is used to train the SC-KELM fault-diagnosis model, and the model is applied to the fault-diagnosis problem of the check valve of the high-pressure diaphragm pump; the results show that:
(1) The SPA algorithm adaptively decomposes the vibration signal to obtain the tendency item and fluctuation item of the vibration signal, which can effectively separate the nonlinear tendency in the signal and highlight the signal component characteristics; it is beneficial for extracting the frequency domain characteristics of the vibration signal of the check valve.
(2) The frequency-domain fuzzy-entropy algorithm proposed can measure the frequency-domain complexity of the vibration signal and effectively extract the fault information contained in the vibration signal of the check valve. The SPA component frequency-domain fuzzy entropy can accurately characterize the operating state of the check valve.
(3) The SC-KELM fault-diagnosis model is established based on the frequency-domain fuzzy entropy because its structure is constrained by the functional norm, and the generalization performance has been improved. Applying the model to the fault problem of the check valve, the accuracy of the diagnosis reaches 96.67%, which verifies the effectiveness of the model.
Author Contributions
Conceptualization, X.F. and G.Z.; methodology, G.Z.; software, X.F. and G.Z.; validation, X.Y. and G.Z.; formal analysis, G.Z. and Y.F; investigation, X.F.; resources, X.F.; data curation, X.F.; writing—original draft preparation, G.Z.; writing—review and editing, X.F.; visualization, X.F.; supervision, X.Y. and G.Z.; project administration, X.F.; and funding acquisition, Y.F. All authors have read and agreed to the published version of the manuscript.
Funding
This research was supported by the Open Research Project of the State Key Laboratory of Industrial Control Technology, Zhejiang University, China (No. ICT2022B06).
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Feng, Z.; Xiong, X.; Wang, X. Diaphragm pump check valve fault diagnosis method based on cyclic spectral coherence and DCNN. Vib. Shock 2021, 40, 237–244. [Google Scholar]
- Ma, J.; Wu, J.; Wang, X. Fault Diagnosis Method of Check Valve Based on Multikernel Cost-Sensitive Extreme Learning Machine. Complexity 2017, 2017, 1–19. [Google Scholar] [CrossRef] [Green Version]
- Han, Y.; Qi, W.; Ding, N. Short-time wavelet entropy integrating improved LSTM for fault diagnosis of modular multilevel converter. IEEE Trans. Cybern. 2021, 52, 7504–7512. [Google Scholar] [CrossRef] [PubMed]
- Ge, J.; Niu, T.; Xu, D. A Rolling Bearing Fault Diagnosis Method Based on EEMD-WSST Signal Reconstruction and Multi-Scale Entropy. Entropy 2020, 22, 290–317. [Google Scholar] [CrossRef] [Green Version]
- Zhang, C.; Zhao, R.; Deng, L. A rolling bearing fault diagnosis method based on EEMD singular value entropy. Vib. Test Diagn. 2019, 39, 353–358. [Google Scholar]
- Cui, R.; Wang, C.; Wang, Y. Application of VMD-ApEn in aerospace AC series-type arc fault detection. J. Electr. Mach. Control 2020, 24, 141–149. [Google Scholar]
- Chen, K.; Zhang, X.; Li, N. Application of CEEMD-based combined noise reduction with adaptive wavelet thresholding in OPAX method. Vib. Shock 2021, 40, 192–198. [Google Scholar]
- Chen, Q.; Dai, S.; Dai, H. Prediction of rolling bearing performance degradation trend based on SPA-FIG with optimi-zed ELM. Vib. Shock 2020, 39, 187–194. [Google Scholar]
- Zheng, J.; Pan, H.; Zhang, J. Fault diagnosis of planetary gearboxes based on multivariate multiscale fuzzy entropy. Vib. Shock 2019, 38, 187–193. [Google Scholar]
- Manoharan, J.S. Study of variants of Extreme Learning Machine (ELM) brands and its performance measure on classification algorithm. J. Soft Comput. Paradigm 2021, 3, 83–95. [Google Scholar]
- Hua, L.; Zhang, C.; Peng, T. Integrated framework of extreme learning machine (ELM) based on improved atom search optimization for short-term wind speed prediction. Energy Convers. Manag. 2022, 252, 115102. [Google Scholar] [CrossRef]
- Liu, C.; Wang, Y.; Pan, T. Fault diagnosis of electro-hydraulic servo valve using extreme learning machine. Int. Trans. Electr. Energy Syst. 2020, 30, e12419. [Google Scholar] [CrossRef]
- Li, X.; Hu, Y.; Xue, B. State-of-health estimation for the lithium-ion battery based on gradient boosting decision tree with autonomous selection of excellent features. Int. J. Energy Res. 2022, 46, 1756–1765. [Google Scholar]
- Zhang, K.; Luo, M. Outlier-robust extreme learning machine for regression problems. Neurocomputing 2015, 151, 1519–1527. [Google Scholar] [CrossRef]
- Jiao, D.; Wang, Z.J.L. The chaotic characteristics detection based on multifractal detrended fluctuation analysis of the elderly 12-lead ECG signals. Phys. A Stat. Mech. Appl. 2020, 540, 123234. [Google Scholar] [CrossRef]
- Huang, H.; Yi, W.; Yi, Q. Smoothness priors approach in displacement decomposition prediction of landslides. Hydrogeol. Eng. Geol. 2014, 41, 95–100. [Google Scholar]
- Liang, Y.; Chen, W.; Magin, R. Connecting complexity with spectral entropy using the Laplace transformed solution to the fractional diffusion equation. Phys. A Stat. Mech. Appl. 2016, 453, 327–335. [Google Scholar] [CrossRef]
- Huang, G.B. An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels. Cogn. Comput. 2014, 6, 376–390. [Google Scholar] [CrossRef]
- Yarrakula, M.; Dabbakuti, J.R.K. Modeling and prediction of TEC based on multivariate analysis and kernel-based extreme learning machine. Astrophys. Space Sci. 2022, 367, 34. [Google Scholar] [CrossRef]
- Ansari, K.; Seok, H.W.; Jamjareegulgarn, P. Quasi zenith satellite system-reflectometry for sea-level measurement and implication of machine learning methodology. Sci. Rep. 2022, 12, 21445. [Google Scholar] [CrossRef]
- Zheng, J.; Chen, M.; Cheng, J. Multiscale fuzzy entropy and its application in rolling bearing fault diagnosis. J. Vib. Eng. 2014, 27, 145–151. [Google Scholar]
| Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).