Nothing Special   »   [go: up one dir, main page]

Next Article in Journal
A Technology Acceptance Model-Based Analytics for Online Mobile Games Using Machine Learning Techniques
Next Article in Special Issue
A Real-Time Detection Method for Concrete Surface Cracks Based on Improved YOLOv4
Previous Article in Journal
Comparative Study of Univariate and Multivariate Long Short-Term Memory for Very Short-Term Forecasting of Global Horizontal Irradiance
Previous Article in Special Issue
Force Analysis of Self-Anchored Suspension Bridges after Cable Clamp Slippage
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Post-Processing of High Formwork Monitoring Data Based on the Back Propagation Neural Networks Model and the Autoregressive—Moving-Average Model

1
Key Laboratory of New Technology for Construction of Cities in Mountain Area, Ministry of Education, Chongqing University, Chongqing 400044, China
2
School of Civil Engineering, Chongqing University, Chongqing 400044, China
*
Author to whom correspondence should be addressed.
Symmetry 2021, 13(8), 1543; https://doi.org/10.3390/sym13081543
Submission received: 31 July 2021 / Revised: 13 August 2021 / Accepted: 16 August 2021 / Published: 23 August 2021
(This article belongs to the Special Issue Symmetry in Structural Health Monitoring)
Figure 1
<p>Single neuron calculation and BPNN structure.</p> ">
Figure 2
<p>System identification block diagram.</p> ">
Figure 3
<p>ARMA model-building method.</p> ">
Figure 4
<p>Training neural network of ARMA (3, 2): (<b>a</b>) ARMA (3, 2), (<b>b</b>) ARMA (1, 2).</p> ">
Figure 5
<p>MSE of BPNN: (<b>a</b>) ARMA (2, 2), (<b>b</b>) ARMA (2, 1).</p> ">
Figure 6
<p>The verification of causality and invertibility.</p> ">
Figure 7
<p>Comparison of the correct number of estimation methods for each order under different coefficients: (<b>a</b>) ARMA (1, 2), (<b>b</b>) ARMA (2, 3), (<b>c</b>) ARMA (4, 2).</p> ">
Figure 8
<p>Comparison of the correct number of estimation methods for each order under different sequence length: (<b>a</b>) ARMA (1, 2), (<b>b</b>) ARMA (2, 3), (<b>c</b>) ARMA (4, 2).</p> ">
Figure 9
<p>Comparison of the correct number of estimation methods for each order under different orders.</p> ">
Figure 10
<p>The composition of the high formwork safety monitoring system.</p> ">
Figure 11
<p>Monitoring arrangement of the high formwork system: (<b>a</b>) the 3D model of the high formwork; (<b>b</b>) the installation of the collector; (<b>c</b>) the installation of the analyzer.</p> ">
Figure 12
<p>Simulation results of different methods: (<b>a</b>) Sequence trend (<b>b</b>) Residual sequence.</p> ">
Figure 13
<p>Simulation results of different methods: (<b>a</b>) Sequence trend (<b>b</b>) Residual sequence.</p> ">
Versions Notes

Abstract

:
Many high formwork systems are currently equipped with health monitoring systems, and the analysis of the data obtained can determine whether high formwork is a hazard. Therefore, the post-processing of monitoring data has become an issue of widespread concern. In this paper, we discussed the fitting effect of the symmetrical high formwork monitoring data using the autoregressive–moving-average (ARMA) model and the back propagation neural networks (BPNN) combined model to process. In the actual project, the symmetry of the high formwork system allows the analysis of local monitoring results to be well extended to the whole. For the establishment of the ARMA model, the accurate judgment of the model order has a significant impact. In this paper, back propagation neural networks (BPNN) are used to simulate the ARMA process. The order of the ARMA model is estimated by determining the optimal neural network structure, which is suitable for linear or nonlinear sequences. We validated this approach from the ARMA model data simulated in Monte Carlo and compared it with the Akaike information criterion (AIC) and Bayesian information criterion (BIC). The length of the sequence, the coefficients and the order of the ARMA model are considered as factors that influence the judgment effect. Under different conditions, the BPNN always shows an accuracy rate of more than 90%, while the BIC only has a higher accuracy rate when the model order is low and the judgment efficiency of the AIC is below 50%. Finally, the proposed method successfully modeled the stress sequence and obtained the stress change trend. Compared with AIC and BIC, the efficiency of the processing time series is increased by about 50% when an order is obtained by BPNN.

1. Introduction

The safety management of the high formwork is one of the important tasks of construction safety management, and the majority of failures occur due to inadequate site supervision and poor design [1]. Undoubtedly, the real-time monitoring of near-miss accidents provides an insight into possible accidents and can significantly improve safety performance by appropriate action being taken before potentially impending accidents occur [2]. In view of this, many high formwork systems have installed health monitoring systems of different sizes around the world, and these have accumulated a large amount of data over a long period of time [3,4]. Therefore, how to process this huge monitoring data accurately and timely has become the key process of the high formwork condition assessment and performance prediction [5].
Structural damage will lead to changes in the physical properties of the structure, and these changes are often reflected in the monitoring sequence [6,7]. In the previous evaluation of structural safety performance, most of its data were related to time [8,9,10,11,12]. The methods of dealing with stress sequences from health monitoring include the time e-frequency analysis method, modal analysis method, analytic hierarchy process, genetic algorithm, neural network analysis method, time series analysis method, and reliability theory analysis method [13,14,15]. Among them, the autoregressive–moving-average (ARMA) is a method widely used to model time series [16]. Two steps of the ARMA model that have an important impact on the establishment process are order estimation and coefficient estimation [17]. Coefficient estimation is based on an accurate estimate of the order. The most widely used methods of order estimation are the Akaike information criterion (AIC) [18] and the Bayesian information criterion (BIC) [19]. AIC and BIC are based on the concept of entropy and provide criteria for weighing the complexity of the estimation model against the goodness of the fitted data. In recent years, with the popularity of deep learning, ARMA models and artificial neural network associations have been used to analyze time series [20,21,22,23,24]. These studies prove that the combination of the two is effective for time series analysis [25]. However, in previous literature, the simulation performance of neural networks lacks comprehensive research on different models.
As widely used time series models, ARMA and BPNN are used less in structural monitoring. This paper applies these two methods to the template system for the first time. In previous studies, we have successfully applied neural networks to the safety assessment of long-span bridges and achieved good results [26]. The timeliness of the structure monitoring sequence is more obvious than the safety assessment of long-span bridges, so we model this using the ARMA model and the BPNN model [27]. Compared with the previous literature, we have improved the network structure of BPNN to a better mathematical model. The paper has mainly improved three aspects: (a) Designed and improved the BPNN structure according to the characteristics of the monitoring system; (b) Improved the judgment criteria of the ARMA model order and the model fitting effect; (c) Considering the influence of bias in BPNN modeling, the recognition of discrete data is enhanced.
In this paper, we use neural networks and ARMA to model and analyze the high formwork monitoring sequences with the goal of data-driven modeling. We use back propagation neural network (BPNN) [28] structures for the identification of the order of the ARMA model. The order estimation of the model uses the mean square error (MSE) of the neural network as the basis for the judgment of the order [29]. For neural network structures with low MSE, the structure of the input layer corresponds to the order of the ARMA model. Through the Monte Carlo simulation, a series of model simulation data is obtained. We used the defined neural network model to make a comprehensive comparative analysis of the sequences of different coefficients, sequence lengths, and orders.
This paper is organized as follows. The theoretical basis of the two methods is described in Section 2. In Section 3, the setting of neural network parameters is introduced and verified by the Monte Carlo method. In Section 4 and Section 5, the methods proposed in this paper are compared with the typical existing methods, and the effect of using the actual observation data is also analyzed. Finally, the conclusions are provided in Section 6.

2. Methodology

2.1. ARMA (p, q) Model

The autoregressive–moving-average is an important simulation method of stationary time series. Before discussing the order judgment of the time series, we need to analyze the structure of the ARMA model. { X t } is an ARMA (p, q) process if { X t } is stationary and if for every t ,
X t ϕ 1 X t 1 ϕ p X t p = Z t + θ 1 Z t 1 + + θ q Z t q
where { Z t } ~ W N ( 0 , σ 2 ) and the polynomials ( 1 ϕ 1 z ϕ p z p ) and ( 1 θ 1 z θ p z p ) have no common factors [17]. The p of the left-hand side of Equation (1) represents the order of the autoregressive (AR) process. Similarly, the q of the right-hand side is the order of the moving-average (MA) process. When they are equal, the ARMA model has mathematical symmetry.
For a mathematical model, it is an important requirement for the effectiveness to be able to fully represent information of the sequence, which is also true for the ARMA model. In Equation (1), Z t is actually a sequence of white noise. Its characteristic is that the value of Z t does not affect the trend of X t . At the same time, when the parameters of Equation (1) and X t are known, the value of Z t can also be determined within a certain range. The characteristics of Z t provide a basis for us to determine the order of the ARMA model through the neural network.

2.2. Back Propagation Neural Networks (BPNN)

BPNN discover intricate structures in large datasets by using the backpropagation algorithm to indicate how a machine should change its internal parameters [30]. The ARMA model in this paper is a linear time-invariant system, which can be effectively simulated by using BPNN. BPNN is a multi-layer feedforward neural network trained according to the error back propagation algorithm. The complete neural network structure is composed of a large number of neurons. A typical BPNN consists of three layers: input layer, hidden layer, and output layer. Generally, we use normalized data as the input layer. Different from the input layer, the neurons in the hidden layer and the output layer have computational functions and have similar definitions. For neurons in the hidden layer and output layer, its iteration consists of two parts, namely forward propagation and back propagation. The forward propagation of a single neuron consists of two steps. First, calculate { z } through weight and bias, and then calculate { a } through an activation function g ( x ) , where { a } is the input layer of the next layer of neurons or output layer. According to the calculation result of forwarding propagation, the weight and deviation are updated through back propagation. The back propagation of the BPNN is calculated by the gradient descent method. After many iterations, the neural network can fit the data with less error. It is worth noting that the activation functions of the hidden layer and the output layer can be different. Figure 1 shows single neuron calculation and BPNN structure.
When using the BPNN to simulate the ARMA model, we expect this method to be able to estimate the parameters of the ARMA model and obtain a method for determining the order of the model. Hossain et al., 2020, studied artificial neural networks (ANN) to determine the order of ARMA model, but this method did not consider the influence of bias in the process of formula derivation [20]. Therefore, we re-derive the relevant formula. Equation (1) can be rewritten in the following form
X t = i = 1 p ϕ i X t i + j = 0 q θ j Z t j ( θ 0 = 1 )
where X t is the time series, Z t is the noise sequence, ϕ i and θ j are coefficients of ARMA model.
Next, we compare the difference between the calculation method of BPNN and Equation (2). Figure 1 shows the processing of the input data by a single neuron. According to this, we can obtain the calculation process of the hidden layer neuron on the input data as follows
[ z 1 z 2 z 3 z m ] = [ w 11 w 12 w 13 w 1 n w 21 w 22 w 23 w 2 n w 31 w 32 w 33 w 3 n w m 1 w m 2 w m 3 w m n ] · [ x 1 x 2 x 3 x n ] + [ b 1 b 2 b 3 b n ]
or
Z [ 1 ] = W [ 1 ] X + b [ 1 ]
Next,
[ a 1 a 2 a 3 a m ] = [ g 1 ( z 1 ) g 1 ( z 2 ) g 1 ( z 3 ) g 1 ( z m ) ]
or
a [ 1 ] = g 1 ( Z [ 1 ] )
where X is a column vector composed of input data, W [ 1 ] is a column vector composed of W i T , b [ 1 ] sis a column vector composed of bias, g is the activation function used, and a [ 1 ] is a column vector composed of activation value. The output of the proposed BPNN can be written as follows
[ z 1 ] = [ w 11 w 12 w 13 w 1 m ] · [ a 1 a 2 a 3 a m ] + [ b 1 ]
or
Z [ 2 ] = W [ 2 ] a [ 1 ] + b [ 2 ]
Next,
y ^ = a [ 2 ] = g 2 ( Z [ 2 ] )
where the meaning of each letter is similar to before. In this process, if we do not consider the bias and the activation function of the hidden layer, and at the same time set the activation function of the output layer to the linear activation function, we will obtain the following results
y ^ = W [ 2 ] W [ 1 ] X
Equation (7) is consistent with the conclusion derived by Hossain et al., 2020 [20].
Although the method described in Equation (7) can easily obtain the coefficient estimates of the ARMA model, it does not consider the influence of the bias and the nonlinear activation function on the neural network process. The existence of bias is of great significance to the operation of neural networks. It can improve the accuracy of neural network classification and reduce the noise in the evaluation process [31]. When we add bias, although the effect of neural network iteration can be improved, the coefficient estimates cannot be obtained as easily as Equation (7). This is because of the influence of the deviation column vector, the coefficient calculation of the ARMA model in the calculation of the BPNN can no longer be simply obtained through the weight matrix. Our other improvement to Equation (7) is the addition of a nonlinear activation function. This is not only because the nonlinear activation function can better exert the computational performance of the neural network but also the coefficient estimation of the ARMA model itself is a nonlinear process. In the symmetric formwork system, BPNN can overcome the shortcomings of insufficient randomness of ARMA order estimation. It is worth noting that the coefficient of the model can be better estimated by the least square method when we can accurately determine the order of the model [32,33].

3. Model Establishment

3.1. Simulation Settings

This section introduces the simulation methods separately from the simulation of data and the design of the artificial neural network. The paper mainly uses MATLAB 2017a to establish an analytical model, and the relevant calculations are also completed in the software.
In the real world, most systems can be modeled by ARMA (5, 5), so in this paper, we set the maximum value of AR and MA order to 5 (AR (1–5) and MA (0–5), the numbers represent the range of values for the corresponding order) [34]. All the simulated datasets in this paper are generated by Monte Carlo simulation. We constructed a time series ( X t ) based on the random simulated noise series ( Z t ) and the coefficients of the ARMA model. The expectation of the noise sequence is 0 and the variance is 1. The coefficients of the model were generated by a random method and met the conditions of causality and invertibility. The initial value of the time series was determined by the noise series.
For the neural network, we used Equation (8) to calculate the number of neurons in the hidden layer, and its value was a dynamic integer. The maximum number of epochs to train was 100, the performance goal was set to 10 7 , and the training was terminated when the MSE did not drop for 10 consecutive iterations. The neural network parameters were updated using Adam optimizer, and its learning rate was set to 0.01, which was chosen empirically [35]. Although the ARMA model is a linear time-invariant system, the linear unit (ReLU) activation function of hidden neurons cannot handle occasional discrete data well. Thus, we used a nonlinear activation function (Sigmoid) as the activation function [36,37,38].
M = integer ( s q r t ( m + 1 ) + 15 )
Based on the above conditions, we built 30 neural networks (combination of AR (1–5) and MA (0–5)) to analyze time series. For different neural networks, we converted the time series into corresponding datasets, 80% of the processed data was used as the training set and the rest as the validation set. We used the MSE of the validation set as the basis for judging the order. Figure 2 and Figure 3 show a system identification block diagram.

3.2. Pre-Simulation

According to the settings in Section 3.1, we verified the established model. We tested whether the neural network is suitable for the simulation of the ARMA model to verify the correctness of the derivation in Section 3.2. On the other hand, the proposed method is used for order estimation, and special cases are discussed at the same time.
Figure 4 is the MSE loss value of the time series conforming to the ARMA (3, 2) model. Figure 4a,b represent the time series by simulating the neural network of ARMA (3, 2) and ARMA (1, 2) respectively. We use this example to illustrate the judgment theory of neural networks. As shown in Figure 4a, when the time series passes the correct model, MSE has been in a downward trend and, after a sufficient period of the epoch, MSE reaches the target value ( 10 7 ). In Figure 4b, when the time series passes through the mismatched model, we find that MSE reaches the optimal value ( 10 3 ) at 33 Epochs and does not drop again for ten consecutive times. The reason for this phenomenon is that, for the correct neural network model, the model can approach an analytical solution after sufficient iterations. For the wrong neural network models, the value of MSE will often not drop after reaching the critical point, and the correct model can obtain a satisfactory MSE. This is also the basis for us to judge the order of the ARMA model through MSE.
Next, the problem we needed to solve was how to determine the order of the ARMA model through the BPNN. From Figure 1 and Figure 4, we can see that when determining the best input layer of the BPNN, the p and q of the input layer corresponded to the best order of the ARMA model. Therefore, we expected that the neural network’s MSE loss function should be the smallest for the correct model order. Finally, the time series obtained MSE through 30 possible neural network structures.
Figure 5 shows the MSE calculation results of two different time series. It can be seen from Figure 5a that, as the order increases, the MSE presents an obvious downward trend, in which the red circle marks the true model orders. When the critical point is reached, the MSE will not change significantly with the increase of the order because high-level neural network models can reflect low-level changes. In the calculation, we found that the calculation result of MSE has the special case shown in Figure 5b. Figure 5b simulates a special case of the ARMA (2, 1) calculation. The three points represented by the red circle in Figure 5 may all be the value of the order, and the MSE is relatively small at these three points. Therefore, in addition to comparing MSE, we also introduce the gradient to determine the order of the model when there are multiple critical points. When the descending gradient of the critical point is the largest and the MSE is small, the point is considered to be the best value for this set of critical points. From Figure 5, we find that the asymmetric ARMA structure is more prone to result judgment difficulties because the descending gradient of its MSE is gentler near the correct values.

4. Performance on Simulated Data

4.1. Different Coefficients

In the process of simulating data conforming to the ARMA model, the coefficients are restricted by many conditions. According to the definition of the ARMA model, the coefficients need to meet the requirements of causality and invertibility. In [17], the judgments of causality and invertibility are given by Equations (9) and (10).
Causality is equivalent to the condition
ϕ ( z ) = 1 ϕ 1 z ϕ p z p 0   for   all   | z | 1
Invertibility is equivalent to the condition
θ ( z ) = 1 + θ 1 z + + θ q z q 0   for   all   | z | 1
where ϕ ( · ) and θ ( · ) are the p t h and q t h -degree polynomials. The complex z is used here since the zeros of a polynomial of degree p > 1 or q > 1 may be either real or complex. The region is defined by the set of complex z such that | z | = 1 is referred to as the unit circle. From Equations (9) and (10), the conditions of causality and invertibility are satisfied when the roots of ϕ ( z ) = 0 and θ ( z ) = 0 are outside the unit circle. In the calculation, we found that it is also necessary to consider whether the selected coefficients can effectively reflect the characteristics of the model in addition to causality and invertibility. In order to improve the sensitivity of the model, we set the minimum absolute value of the coefficient to 0.1. This avoids the fact that the coefficients are too small to make the polynomial difficult to identify.
In this section, we have simulated three ARMA models, each of which used 25 sets of different coefficients to simulate time series. Since the symmetrical ARMA model was less prone to result judgment difficulties, we used the asymmetrical ARMA model here. The three models were ARMA (1, 2), ARMA (2, 3), and ARMA (4, 2). Table 1 is the model coefficients we obtained through the random method, and Figure 6 is the verification of causality and invertibility.
In Figure 6, the roots of ϕ ( z ) = 0 and θ ( z ) = 0 for each model are shown in a different color. All roots are outside the unit circle, which shows that the coefficients meet the requirements of causality and invertibility. For the coefficients in Table 1, we simulated 30 different realizations of the system’s response with time series lengths of 400. From these overdetermined ARMA model orders, the goal was to determine the correct ARMA model order using BPNN and compare its results with AIC and BIC. Another purpose was to study whether the effects of different order determination methods under random parameters were consistent. Model identification using the AIC and BIC was performed using functions in MATLAB R2017a.
Figure 7 is a stacked area diagram of the order estimation results. Figure 7 shows that the order estimation accuracy of BPNN is above 90%, AIC is below 10%, and the results of BIC are unstable. Comparing Figure 7a,b, the judgment results of BPNN and AIC are relatively stable, while the judgment efficiency of BIC criteria is significantly reduced and affected by the change of coefficients. For Figure 7c, the judgment effect of the BIC is basically the same as that of the AIC, and there is no obvious change in the BPNN. For the same model, the correct rate of BPNN is the highest, and the AIC is the lowest. The BIC is somewhere in between, but it is more sensitive to changes in model coefficients. For different ARMA models, the order estimation results of BPNN under different coefficients are relatively stable and accurate. In addition, the accuracy of the BIC is significantly reduced when the ARMA order is higher. For example, in ARMA (4, 2), its judgment effect is almost the same as that of the AIC. The influence of the change of order on different judgment criteria is analyzed in detail in Section 4.3. On the whole, the judgment result of BPNN has obvious advantages.

4.2. Different Length

In Section 4.1, we discussed the effect of each judgment criterion under different coefficients. Next, we study the effect of the length of the time series on the accuracy. We selected a set of representative coefficients from the three models in Section 4.1, where ARMA (1, 2) selected the 13th group, ARMA (2, 3) selected the 21st group, and ARMA (4, 2) selected the 9th group. Then, we simulated 100 different responses with time series lengths of 200, 400, 600, 800, and 1000. The expressions of the three models are shown in Equation (11).
A R M A ( 1 , 2 ) : X t = Z t + 0.5733 X t 1 + 0.1680 Z t 1 + 0.4097 Z t 2 A R M A ( 2 , 3 ) : X t = Z t + 0.3272 X t 1 + 0.5129 X t 2 + 0.1052 Z t 1 + 0.1403 Z t 2 + 0.6325 Z t 3 A R M A ( 4 , 2 ) : X t = Z t + 0.1401 X t 1 + 0.1314 X t 2 + 0.1436 X t 3 + 0.5057 X t 4 + 0.3571 Z t 1 + 0.2189 Z t 2
The model order estimation results are presented in Figure 8. From Figure 8, we can find that the BPNN can provide accurate order estimates for each length of the signal in models of different orders and the accuracy rate is above 90%. The accuracy of AIC and BIC has a certain upward trend with the increase of sequence length, while the estimated result of BIC can reach 90% under certain models. In Figure 8a,b, the judgment effect of the BIC and the BPNN is basically the same in the case of a long sequence. From Figure 8c, we can clearly find that the judgment result of the BPNN is much more accurate than the AIC and the BIC under the high-order model. In Figure 8c, the accuracy of AIC and BIC is below 40%. Similar to Section 4.2, the BIC performs better under low-order models than high-order models. In addition, we find that the accuracy of the AIC is low, but the effect is relatively stable under different models.

4.3. Different Order

In this section, we fixed the maximum AR and MA orders at 5 (AR (1–5) and MA (0–5)). We performed 100 Monte Carlo simulations on these 30 models and used the AIC, BIC, and BPNN to estimate the order. In Section 4.1, we found that the coefficient affects the estimate of the order. In order to make the results more representative, we randomized the coefficients of each model and met the conditions of causality and invertibility. In Section 4.2, we already knew that the length of the time series would affect the estimation of the order, so we set the length of the series to 1000 for better performance of all the methods. The setting of coefficient randomization can better study the effect of BPNN order estimation under different models. The length of the time series can make the accuracy of the AIC and the BIC higher, so as to better compare with the estimation results of the BPNN.
Figure 9 shows the order estimation results of different models. In Figure 9, the accuracy of BPNN is generally above 90%. The accuracy of the BIC is above 70% when the order is small, but it does not work well under higher-order models. Although the accuracy of the AIC is below 30%, the result is relatively stable. Combined with the present conditions, the order estimation of BPNN can have a prominent performance under random coefficient and different model orders. Another point worth noting is that when the order of the model is higher, only the BPNN can obtain satisfactory estimation results. From this example, it can be found that BPNN still has an excellent estimation effect, even though the ARMA model has mathematical symmetry.
Hossain et al., 2020, simulated physiological systems through ARMA and BPNN. As with their findings, the BPNN always shows an accuracy rate of more than 90% under different conditions. However, we found that AIC and BIC accuracy were low in our study, which may be due to a different coefficient selection. This may be because we did not have too much human intervention in the choice of coefficients.

5. Application

5.1. High Formwork Safety Monitoring System

The high formwork safety monitoring system is a solution for real-time automatic safety monitoring of many major safety risk points during the pouring construction process of the tall formwork support system. The system uses wireless automatic networking, high-frequency continuous sampling, real-time data analysis and on-site sound and light alarms. There are four main components of the high formwork safety monitoring system: collector, analyzer, cloud platform, and client. The collector is responsible for sampling and uploading sensor data; the analyzer networks the collector, transfers the data, alerts, and uploads the data to the cloud platform; the cloud platform is responsible for data storage, display, early warning, data analysis, and other functions on the server; the client mainly implements the remote configuration of the data display and monitoring system on the cloud platform. The structure monitored in this paper has obvious symmetry, and the arrangement of the measuring points is also symmetrical and orderly. The composition of the high formwork safety monitoring system is shown in the Figure 10. Figure 11 shows the 3D model of the high formwork and the installation scheme of the instrument. Table 2 lists the instrument-related parameters.

5.2. Application in Stress Sequence

In the past, the ARMA model was often used to remove the noise of the time series to obtain the trend of the series [39,40,41]. These documents select a number of different ARMA models to process the time series and obtain the optimal solution by comparing the results. Selecting a model through the results often takes more time when the amount of data is large, and an accurate estimation of the order can reduce the workload and facilitate the batch processing of data. In this subsection, we demonstrate that the proposed model order selection method based on BPNN can be used to analyze stress sequences. The time series we analyzed comes from a part of the stress change of the high formwork system. According to the loading status of the system, the stress change of the high formwork can be divided into the loading phase and load stabilization phase. For the stress time series in the use phase, the ARMA model generally satisfies the requirements of the series causality. If the time series contains data in the loading phase, then we often need to perform nonlinear processing (differential) on the data to meet the requirements of causality. The accurate processing of monitoring data results is an indispensable part of the high formwork safety monitoring system. Based on the initial data collected by the high formwork safety monitoring system in the actual project, this paper discusses the specific application of the proposed method in the post-processing of monitoring data. In the following, we use two examples to verify the effect of the order selection method proposed earlier.
Example 1.
This example considers a time series that meets the requirements of causality, and the data is obtained from engineering field measurements. The data includes stress changes at 37 positions, and the sequence used in this example is one of the data. Since the increase in the length of the sequence has no adverse effects, we intercepted the sequence with a length of 5000, which is the stress change at the steady stage of the load. We use AIC, BIC, and BPNN to estimate the best order of the model. As before, regarding the setting of the BPNN, we use 80% of the data as the training set and the rest as the test set. The parameter settings are also the same as before. Finally, the ARMA parameters were estimated using the least-squares method for the model order estimated by the BPNN, the AIC and the BIC.
Figure 12a plots the original data and the sequence obtained by different processing methods, and the residuals of the different methods are shown in Figure 12b. In order to better describe the distribution of the data, we draw the envelope of the obtained sequence and calculate the average width between the upper and lower envelopes. Compared with the AIC and the BIC, the BPNN method reduces the average width of the envelope by 83.08% and 9.16%. It can be found that the BPNN and BIC have similar and accurate judgments on sequence trends for the data in this example, while the AIC has a higher degree of dispersion. In addition, there is no obvious difference in residuals of the three judgment methods.
Example 2.
The data used in this example includes the loading phase and the load stabilization phase, and the length of the sequence is 29,610. The setup of the neural network is the same as in Example 1. The difference from Example 1 is that this time series does not meet the requirements of causality, so we have performed different processing on it. The differentiated sequence meets the requirements of causality. Similar to before, we estimated the order of the differenced sequence and used the ARMA process for fitting. Finally, we restored the sequence [42].
Figure 13 shows the processing results of different judgment methods. The obvious difference between Figure 12a and 13a is that the sequence of the former is stable, while the latter has an obvious rising stage, which is why the latter needs to be processed by difference. Compared with the AIC and the BIC, the BPNN method reduces the average width of the envelope by 51.91% and 52.14%. Therefore, we find that the BPNN’s analysis of data trends is more compact than the AIC and the BIC. This shows that the model obtained by the BPNN for order estimation has a better effect on noise extraction.

6. Conclusions

This paper proposes a modeling method for the high formwork monitoring data. The details of establishing the ARMA model and BPNN have been presented, and the algorithm of model order estimation by BPNN is introduced. Through the method of Monte Carlo simulation, we studied the accuracy of the three methods under different coefficients, different sequence lengths, and different model orders. For the actual measured stress series, we used three methods to estimate the model order and then used the least square method to estimate the model coefficients. Finally, we applied the established model to the symmetrical high formwork monitoring data. According to the simulation and application results, the following conclusions can be made.
  • For each system, the accuracy rate of the proposed model order selection method is above 90%, and both show better performance than the AIC or the BIC. At the same time, the BIC criterion is better than the AIC when the model order is lower;
  • In the Monte Carlo simulation, changing the model’s coefficients will affect the accuracy of the BIC judgment, the instability increases significantly in the higher-order model. However, the order judgment method of BPNN still has an accuracy rate of more than 90%;
  • The mathematically symmetric ARMA model is more likely to make errors in the BPNN method, so this type of model needs to be judged in conjunction with the MSE descent gradient.
  • The judgment efficiency of AIC and BIC will increase as the length of the time series increases. The proposed BPNN order judgment method is not sensitive to the change of sequence length and has a relatively high accuracy rate;
  • For changes in the order of the model, both AIC and BIC are more sensitive. In particular, the BIC cannot be judged correctly when the model order is high. The BPNN still maintains a good judgment effect;
  • For the measured data used in the paper that meets the requirements of causality, the judgment effect of BPNN is not significantly different from that of the BIC, but the AIC is obviously inferior. When the time series does not meet the causality requirements, we will transform it into a stationary series. The analysis result shows that the processing result of BPNN increased by about 50%;
  • The stress sequence of the high formwork can be processed by the ARMA process to obtain its change trend and noise sequence. This is feasible for obtaining effective information on the stress sequence.
Due to the influence of computing resources, the model of all orders is not calculated when considering sequence coefficients and sequence length. In addition, the model established in this paper does not consider the impact of accidental factors. We will discuss the effects of accidental factors on model-building in future studies, and further study the methods of predicting periodic data.

Author Contributions

Conceptualization, Y.Y. and G.Y.; methodology, Y.Y. and G.Y.; software, Y.Y. and L.Y.; formal analysis, Y.Y. and L.Y.; writing—original draft preparation, Y.Y. and G.Y.; writing—review and editing, Y.Y. and G.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by National Key R&D Program of the Ministry of Science and Technology (No. 2019YFD1101005-4), Fundamental Research Funds for the Central Universities (2020CDJQY-A067) and the 111 project of the Ministry of Education and the Bureau of Foreign Experts of China (No. B18062).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Please contact the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Beale, R.G. Scaffold research—A review. J. Constr. Steel Res. 2014, 98, 188–200. [Google Scholar] [CrossRef] [Green Version]
  2. Yang, Y.; Cheng, Q.; Zhu, Y.; Wang, L.; Jin, R. Feasibility Study of Tractor-Test Vehicle Technique for Practical Structural Condition Assessment of Beam-Like Bridge Deck. Remote Sens. 2020, 12, 114. [Google Scholar] [CrossRef] [Green Version]
  3. Wu, W.; Yang, H.; Chew, D.A.S.; Yang, S.-H.; Gibb, A.G.F.; Li, Q. Towards an autonomous real-time tracking system of near-miss accidents on construction sites. Autom. Constr. 2010, 19, 134–141. [Google Scholar] [CrossRef]
  4. Huang, Y.L.; Chen, W.F.; Chen, H.J.; Yen, T.; Kao, Y.G.; Lin, C.Q. A monitoring method for scaffold-frame shoring systems for elevated concrete formwork. Comput. Struct. 2000, 78, 681–690. [Google Scholar] [CrossRef]
  5. Entezami, A.; Sarmadi, H.; Behkamal, B.; Mariani, S. Big Data Analytics and Structural Health Monitoring: A Statistical Pattern Recognition-Based Approach. Sensors 2020, 20, 2328. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Yang, Y.; Yang, Y.B.; Chen, Z.X. Seismic damage assessment of RC structures under shaking table tests using the modified direct stiffness calculation method. Eng. Struct. 2017, 131, 574–586. [Google Scholar] [CrossRef]
  7. Yang, Y.; Xiang, C.; Jiang, M.; Li, W.; Kuang, Y. Bridge Damage Identification Method Considering Road Surface Roughness by Using Indirect Measurement Technique. China J. Highw. Transp. 2019, 32, 99–106. [Google Scholar]
  8. Bai, J.; Chen, H.; Zhao, J.; Liu, M.; Jin, S. Seismic design and subassemblage tests of buckling-restrained braced RC frames with shear connector gusset connections. Eng. Struct. 2021, 234, 112018. [Google Scholar] [CrossRef]
  9. Chen, H.; Bai, J. Seismic performance evaluation of buckling-restrained braced RC frames considering stiffness and strength requirements and low-cycle fatigue behaviors. Eng. Struct. 2021, 239, 112359. [Google Scholar] [CrossRef]
  10. Qin, Y.; Shu, G.P.; Zhou, G.G.; Han, J.H. Compressive behavior of double skin composite wall with different plate thicknesses. J. Constr. Steel Res. 2019, 157, 297–313. [Google Scholar] [CrossRef]
  11. Yao, G.; Wu, C.; Yang, Y. Scientometric analysis for mechanical performance on broken-line long-span steel structure in construction considering geometric nonlinearity. Symmetry 2021, 137, 1229. [Google Scholar] [CrossRef]
  12. Wang, Y.H.; Liu, Y.J.; Zhou, X.H. Seismic behavior of steel coupling beam with different buckling constraint materials. Constr. Build. Mater. 2017, 149, 111–129. [Google Scholar] [CrossRef]
  13. Huang, N.E.; Shen, Z.; Long, S.R.; Wu, M.L.C.; Shih, H.H.; Zheng, Q.N.; Yen, N.C.; Tung, C.C.; Liu, H.H. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 1998, 454, 903–995. [Google Scholar] [CrossRef]
  14. Bellahsene, H.; Taleb-Ahmed, A. ARMA order model detection using minimum of Kurtosis: Application on seismic data. Arab. J. Geosci. 2018, 11, 1–7. [Google Scholar] [CrossRef]
  15. Yang, Y.; Li, C.; Ling, Y.; Tan, X.; Luo, K. Research on new damage detection method of frame structures based on generalized pattern search algorithm. Chin. J. Sci. Instrum. 2021, 42, 123–131. [Google Scholar]
  16. Momin, B.; Chavan, G. Univariate Time Series Models for Forecasting Stationary and Non-stationary Data: A Brief Review. Inf. Commun. Technol. Intell. Syst. 2018, 84, 219–226. [Google Scholar]
  17. Brockwell, P.J.; Davis, R.A.; Brockwell, P.J.; Davis, R.A. ARMA Models. In Introduction to Time Series and Forecasting, 3rd ed.; Springer Texts in Statistics; Springer: Cham, Switzerland, 2016; Volume 3, pp. 73–96. [Google Scholar]
  18. Akaike, H. A Bayesian analysis of the minimum AIC procedure. Ann. I Stat. Math. 1978, 30, 9–14. [Google Scholar] [CrossRef]
  19. Akaike, H. Statistical predictor identification. Ann. I Stat. Math. 1970, 22, 203–217. [Google Scholar] [CrossRef]
  20. Hossain, M.-B.; Moon, J.; Chon, K.H. Estimation of ARMA Model Order via Artificial Neural Network for Modeling Physiological Systems. IEEE Access 2020, 8, 186813–186820. [Google Scholar] [CrossRef]
  21. Hang, J.; Zhang, J.; Cheng, M. Fault diagnosis of wind turbine based on multi-sensors information fusion technology. IET Renew. Power Gener. 2014, 8, 289–298. [Google Scholar] [CrossRef]
  22. Qian, X.; Iop. Parameter prediction based on Improved Process neural network and ARMA error compensation in Evaporation Process. In IOP Conference Series: Earth and Environmental Science; IOP Publishing: Bristol, UK, 2018; Volume 108, p. 022078. [Google Scholar] [CrossRef]
  23. Kocak, C.; Dalar, A.Z.; Yolcu, O.C.; Bas, E.; Egrioglu, E. A new fuzzy time series method based on an ARMA-type recurrent Pi-Sigma artificial neural network. Soft Comput. 2020, 24, 8243–8252. [Google Scholar] [CrossRef]
  24. Khashei, M.; Bijari, M. An artificial neural network (p, d, q) model for timeseries forecasting. Expert Syst. Appl. 2010, 37, 479–489. [Google Scholar] [CrossRef]
  25. Chon, K.H.; Cohen, R.J. Linear and nonlinear ARMA model parameter estimation using an artificial neural network. IEEE Trans. Biomed. Eng. 1997, 44, 168–174. [Google Scholar] [CrossRef] [PubMed]
  26. Yang, Y.; Lin, Y.; Bo, W.; Gang, Y.; Hang, L.; Soltys, R. Safety Prediction Using Vehicle Safety Evaluation Model Passing on Long-Span Bridge with Fully Connected Neural Network. Adv. Civil Eng. 2019, 2019, 1–12. [Google Scholar] [CrossRef]
  27. Yao, G.; Guo, H.; Yang, Y.; Xiang, C.; Robert, S. Dynamic Characteristics and Time-History Analysis of Hydraulic Climbing Formwork for Seismic Motions. Adv. Civil Eng. 2021, 2021, 1–17. [Google Scholar]
  28. Zipser, D.; Andersen, R.A. A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature 1988, 331, 679–684. [Google Scholar] [CrossRef]
  29. Xu, L. Least mean-square error reconstruction principle for self-organizing neural-nets. Neural Netw. 1993, 6, 627–648. [Google Scholar] [CrossRef]
  30. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef]
  31. Yao, X.; Liu, Y. A new evolutionary system for evolving artificial neural networks. IEEE Trans. Neural Netw. 1997, 8, 694–713. [Google Scholar] [CrossRef] [Green Version]
  32. Graupe, D.; Krause, D.J.; Moore, J.B. Identification of autoregressive moving-average parameters of time series. IEEE Trans. Autom. Control 1975, AC20, 104–107. [Google Scholar] [CrossRef]
  33. Martinelli, G.; Orlandi, G.; Burrascano, P. ARMA estimation by the classical predictor. IEEE Trans. Circuits Syst. 1985, 32, 506–507. [Google Scholar] [CrossRef]
  34. Lee, K.C.; Oh, S.B. An intelligent approach to time series identification by a neural network-driven decision tree classifier. Decis. Support Syst. 1996, 17, 183–197. [Google Scholar] [CrossRef]
  35. Kingma, D.P.; Ba, J. Adam: A Method for Stochastic Optimization. In Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA, 7 May 2015. [Google Scholar]
  36. Stanley, K.O.; Clune, J.; Lehman, J.; Miikkulainen, R. Designing neural networks through neuroevolution. Nat. Mach. Intell. 2019, 1, 24–35. [Google Scholar] [CrossRef]
  37. Guenther, F.; Fritsch, S. Neuralnet: Training of Neural Networks. R J. 2010, 2, 30–38. [Google Scholar] [CrossRef] [Green Version]
  38. Gu, J.; Wang, Z.; Kuen, J.; Ma, L.; Shahroudy, A.; Shuai, B.; Liu, T.; Wang, X.; Wang, G.; Cai, J.; et al. Recent advances in convolutional neural networks. Pattern Recognit. 2018, 77, 354–377. [Google Scholar] [CrossRef] [Green Version]
  39. Wang, K.; Wu, Y.; Gao, Y.; Li, Y. New methods to estimate the observed noise variance for an ARMA model. Measurement 2017, 99, 164–170. [Google Scholar] [CrossRef]
  40. Zhang, Y.; Kim, C.-W.; Zhang, L.; Bai, Y.; Yang, H.; Xu, X.; Zhang, Z. Long term structural health monitoring for old deteriorated bridges: A copula-ARMA approach. Smart Struct. Syst. 2020, 25, 285–299. [Google Scholar]
  41. De Livera, A.M.; Hyndman, R.J.; Snyder, R.D. Forecasting Time Series With Complex Seasonal Patterns Using Exponential Smoothing. J. Am. Stat. Assoc. 2011, 106, 1513–1527. [Google Scholar] [CrossRef] [Green Version]
  42. Valipour, M.; Banihabib, M.E.; Behbahani, S.M.R. Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir. J. Hydrol. 2013, 476, 433–441. [Google Scholar] [CrossRef]
Figure 1. Single neuron calculation and BPNN structure.
Figure 1. Single neuron calculation and BPNN structure.
Symmetry 13 01543 g001
Figure 2. System identification block diagram.
Figure 2. System identification block diagram.
Symmetry 13 01543 g002
Figure 3. ARMA model-building method.
Figure 3. ARMA model-building method.
Symmetry 13 01543 g003
Figure 4. Training neural network of ARMA (3, 2): (a) ARMA (3, 2), (b) ARMA (1, 2).
Figure 4. Training neural network of ARMA (3, 2): (a) ARMA (3, 2), (b) ARMA (1, 2).
Symmetry 13 01543 g004
Figure 5. MSE of BPNN: (a) ARMA (2, 2), (b) ARMA (2, 1).
Figure 5. MSE of BPNN: (a) ARMA (2, 2), (b) ARMA (2, 1).
Symmetry 13 01543 g005
Figure 6. The verification of causality and invertibility.
Figure 6. The verification of causality and invertibility.
Symmetry 13 01543 g006
Figure 7. Comparison of the correct number of estimation methods for each order under different coefficients: (a) ARMA (1, 2), (b) ARMA (2, 3), (c) ARMA (4, 2).
Figure 7. Comparison of the correct number of estimation methods for each order under different coefficients: (a) ARMA (1, 2), (b) ARMA (2, 3), (c) ARMA (4, 2).
Symmetry 13 01543 g007
Figure 8. Comparison of the correct number of estimation methods for each order under different sequence length: (a) ARMA (1, 2), (b) ARMA (2, 3), (c) ARMA (4, 2).
Figure 8. Comparison of the correct number of estimation methods for each order under different sequence length: (a) ARMA (1, 2), (b) ARMA (2, 3), (c) ARMA (4, 2).
Symmetry 13 01543 g008
Figure 9. Comparison of the correct number of estimation methods for each order under different orders.
Figure 9. Comparison of the correct number of estimation methods for each order under different orders.
Symmetry 13 01543 g009
Figure 10. The composition of the high formwork safety monitoring system.
Figure 10. The composition of the high formwork safety monitoring system.
Symmetry 13 01543 g010
Figure 11. Monitoring arrangement of the high formwork system: (a) the 3D model of the high formwork; (b) the installation of the collector; (c) the installation of the analyzer.
Figure 11. Monitoring arrangement of the high formwork system: (a) the 3D model of the high formwork; (b) the installation of the collector; (c) the installation of the analyzer.
Symmetry 13 01543 g011
Figure 12. Simulation results of different methods: (a) Sequence trend (b) Residual sequence.
Figure 12. Simulation results of different methods: (a) Sequence trend (b) Residual sequence.
Symmetry 13 01543 g012
Figure 13. Simulation results of different methods: (a) Sequence trend (b) Residual sequence.
Figure 13. Simulation results of different methods: (a) Sequence trend (b) Residual sequence.
Symmetry 13 01543 g013
Table 1. ARMA coefficient.
Table 1. ARMA coefficient.
(a) ARMA (1, 2)
Number ϕ 1 θ 1 θ 2
10.685980.525010.30802
20.644420.316320.25568
30.68580.525590.43188
40.692340.167240.36293
50.641720.402180.26578
60.691250.106830.69129
70.673550.138280.39175
80.581890.448220.29035
90.653460.50680.37852
100.657510.468530.31898
110.576120.558280.1989
120.55490.56770.36828
130.573280.168010.40967
140.625060.119170.45852
150.643030.124130.6465
160.664120.188320.58978
170.527940.590220.20596
180.654840.546870.44928
190.500260.149560.65269
200.570710.651670.23093
210.513640.239270.27787
220.588890.182030.58252
230.55520.192950.54223
240.661970.224950.50503
250.694810.311730.66661
(b) ARMA (2, 3)
Number ϕ 1 ϕ 2 θ 1 θ 2 θ 3
10.561870.110880.317310.103060.44403
20.293680.221570.170510.274670.32838
30.192650.663230.481510.265840.21114
40.284690.262030.2270.209430.46187
50.120390.542070.128160.507770.13457
60.506850.182350.112740.224570.43534
70.255650.661830.125750.160690.66979
80.240220.264470.262830.277530.25457
90.300660.256470.252590.100250.44024
100.233850.278770.293010.362220.33182
110.522570.240830.267880.297620.27343
120.376190.156210.302970.130640.25225
130.295190.361470.115770.217340.46065
140.415790.421250.184910.104730.568
150.256020.570180.135550.146480.5147
160.378810.452230.184190.213380.48166
170.337870.311890.200470.274740.24118
180.403620.453380.26180.21510.3823
190.152860.386830.511480.156720.16223
200.397630.161280.140970.294330.26854
210.327160.512920.10520.140280.63252
220.227490.288740.169850.163770.46749
230.413440.438320.426880.235690.27483
240.269620.644280.505790.255140.10056
250.624150.116420.212410.237870.27413
(c) ARMA (4, 2)
Number ϕ 1 ϕ 2 ϕ 3 ϕ 4 θ 1 θ 2
10.11730.146690.111940.288980.268580.27696
20.103560.388660.276420.221150.346280.58485
30.190030.104350.164070.194780.358670.35484
40.195580.172310.183330.408220.527550.18906
50.199870.11650.126410.472650.529570.18639
60.168810.141110.44360.17780.265260.59525
70.13850.17940.11310.427910.355140.29305
80.120840.268840.136370.381520.375620.20007
90.140090.13140.143630.505680.357140.21889
100.116970.176430.192670.197140.576550.28871
110.321490.149790.130270.357250.192310.45819
120.115960.11460.294220.220750.68980.30744
130.198250.23230.1110.125950.1070.58112
140.151960.101870.220660.451850.236080.36163
150.271410.19680.152570.284220.570480.39562
160.110620.229390.374380.258470.689810.19552
170.143970.108050.392790.150330.12660.458
180.197120.202370.285270.123750.230740.68393
190.184430.16250.104340.327890.334920.2104
200.42230.192470.118110.216220.224150.35038
210.110760.265850.424860.119080.169950.58259
220.150440.192210.149570.198050.387590.4243
230.117060.137430.147610.143520.103870.51243
240.173830.18150.176880.300870.550790.35127
250.231350.236910.109510.372750.131110.42879
Table 2. The instrument-related parameters.
Table 2. The instrument-related parameters.
Wireless ReceiverWireless InclinometerWireless Load MeterWireless Displacement Meter
VersionWH-GNSSWH-WTSWH-WLSWH-WDS
Communication interface10 M, RS232NBTOTNB-IOT/LORANBTOT
Power consumption<20 uA<60 uA<60 uA<60 uA
Positioning accuracyPlane: ±3 mm
Elevation: ±5 mm
±0.01°0.050.2%F·S
Operating temperature−30~70 °C−40~85 °C−20~65 °C−20~65 °C
ProducerHUAHEIOTHUAHEIOTHUAHEIOTHUAHEIOT
CountryChinaChinaChinaChina
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yang, Y.; Yang, L.; Yao, G. Post-Processing of High Formwork Monitoring Data Based on the Back Propagation Neural Networks Model and the Autoregressive—Moving-Average Model. Symmetry 2021, 13, 1543. https://doi.org/10.3390/sym13081543

AMA Style

Yang Y, Yang L, Yao G. Post-Processing of High Formwork Monitoring Data Based on the Back Propagation Neural Networks Model and the Autoregressive—Moving-Average Model. Symmetry. 2021; 13(8):1543. https://doi.org/10.3390/sym13081543

Chicago/Turabian Style

Yang, Yang, Lin Yang, and Gang Yao. 2021. "Post-Processing of High Formwork Monitoring Data Based on the Back Propagation Neural Networks Model and the Autoregressive—Moving-Average Model" Symmetry 13, no. 8: 1543. https://doi.org/10.3390/sym13081543

APA Style

Yang, Y., Yang, L., & Yao, G. (2021). Post-Processing of High Formwork Monitoring Data Based on the Back Propagation Neural Networks Model and the Autoregressive—Moving-Average Model. Symmetry, 13(8), 1543. https://doi.org/10.3390/sym13081543

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop