Open AccessArticle

Gradient-Based Iterative Identification for Wiener Nonlinear Dynamic Systems with Moving Average Noises

Lincheng Zhou

Xiangli Li

^*,

Huigang Xu

and

Peiyi Zhu

School of Electrical and Automatic Engineering, Changshu Institute of Technology, Hushan RoadNo.99, Changshu 215500, China

Author to whom correspondence should be addressed.

Algorithms 2015, 8(3), 712-722; https://doi.org/10.3390/a8030712

Submission received: 30 June 2015 / Revised: 20 July 2015 / Accepted: 20 August 2015 / Published: 26 August 2015

(This article belongs to the Special Issue Numerical Algorithms for Solving Nonlinear Equations and Systems)

Download

Browse Figures

Versions Notes

Abstract

This paper focuses on the parameter identification problem for Wiener nonlinear dynamic systems with moving average noises. In order to improve the convergence rate, the gradient-based iterative algorithm is presented by replacing the unmeasurable variables with their corresponding iterative estimates, and to compute iteratively the noise estimates based on the obtained parameter estimates. The simulation results show that the proposed algorithm can effectively estimate the parameters of Wiener systems with moving average noises.

Keywords:

nonlinear dynamic system; stochastic gradient; iterative algorithm; output error moving average; parameter estimation

1. Introduction

In actual industry processes, block-oriented nonlinear systems are often introduced to model nonlinear systems. Block-oriented nonlinear systems can be commonly divided into Hammerstein systems and Wiener systems [1,2,3]. Hammerstein systems consist of a linear block following a static nonlinear block [4,5,6]. Wiener systems are composed of a linear block preceding a static nonlinear block [7,8,9]. The output of Wiener systems is nonlinear, so the modeling for Wiener systems is more sophisticated than that for Hammerstein systems. Differing from the work in [8,9], this paper focuses on the identification problem for Wiener nonlinear systems with moving average noises which are called Wiener output error moving average (OEMA) systems. In most existing works, the nonlinear part of Wiener systems is assumed a linear combination or a piecewise-linear function [10], or has a invertible and monotone function representation over the operating range [11,12]. Wang and Ding derived a least squares-based and a gradient-based iterative identification algorithms for Wiener nonlinear systems by separating one bilinear cost function into two linear cost functions [13]. Hagenblad et al. presented a maximum likelihood method to identify Wiener models [14].

The stochastic gradient (SG) algorithm has less computational burden and slower convergence rate than the recursive least squares algorithm [15,16,17]. Some new algorithms were presented to improve the convergence rate of the SG algorithm [18,19,20]. For example, Ding et al. introduced the convergence index to the SG algorithm and obtained a faster convergence rate than stochastic gradient algorithm [21]; Liu et al. derived the multi-innovation extended stochastic gradient algorithm for controlled autoregressive moving average models by expanding the scalar innovation to an innovation vector and analyzed its performance in detail [22]. Recently, the gradient-based iterative (GI) algorithm was also presented to improve the convergence rate of the SG algorithm [23,24,25]. By making sufficient use of all the measured information, the GI algorithm can obtain a faster convergence rate than the SG algorithm. Wang et al. presented a gradient-based iterative identification algorithms for Box-Jenkins systems with finite measurement input-output data [26]. Li et al. proposed a gradient based iterative algorithm to determine the parameters of a nonlinear system by using the negative gradient search [27]. Zhang et al. derived a hierarchical gradient based iterative estimation algorithm for multivariable output error moving average systems using the hierarchical identification principle [28].

To the best of our knowledge, few contributions have addressed the modeling and estimation issues for Wiener nonlinear OEMA systems, which are the focus of this work. For Wiener nonlinear OEMA systems, our objectives are as follows:

To establish the identification model of the Wiener nonlinear OEMA system from input to output.
To present a gradient-based iterative identification algorithm for the Wiener nonlinear OEMA model.
To analyze the performances of the proposed algorithm using a numerical simulation, including the convergence rates and the estimation errors of this algorithm.

The rest of this paper is organized as follows. Section 2 establishes the identification model of the Wiener nonlinear OEMA system. Section 3 presents a gradient-based iterative identification algorithm for the Wiener nonlinear OEMA model. Section 4 provides an example to illustrate the effectiveness of the proposed algorithm. The conclusions of the paper are summarized in Section 5.

2. The Derivation of the Wiener OEMA Model

Let us firstly introduce some notations. The superscript T denotes the matrix transpose;

1_{n}

represents an n-dimensional column vector whose elements are 1; the norm of a matrix X is defined by

{∥ X ∥}^{2} = tr [X X^{T}]

Figure 1. The Wiener nonlinear OEMA system.

Consider a Wiener nonlinear OEMA system shown in Figure 1:

\begin{matrix} m (t) = \frac{B (z)}{A (z)} u (t) \end{matrix}

(1)

\begin{matrix} y (t) = f (m (t)) + D (z) v (t) \end{matrix}

(2)

where

u (t)

is the system input,

y (t)

is the system output and

v (t)

is an additive noise with zero mean; the inner variable

m (t)

(namely, the output of the linear block) is unmeasurable;

A (z)

B (z)

and

D (z)

are polynomials in the shift operator

z^{- 1} [z^{- 1} y (t) = y (t - 1)]

with

\begin{array}{l} A (z) : = & 1 + a_{1} z^{- 1} + a_{2} z^{- 2} + \dots + a_{n_{a}} z^{- n_{a}} \\ B (z) : = & b_{1} z^{- 1} + b_{2} z^{- 2} + \dots + b_{n_{b}} z^{- n_{b}} \\ D (z) : = & 1 + d_{1} z^{- 1} + d_{2} z^{- 2} + \dots + d_{n_{d}} z^{- n_{d}} \end{array}

The nonlinear part

f (\cdot)

in the Wiener system is a polynomial of a known order as follows:

\begin{matrix} f (m (t)) = γ_{1} m (t) + γ_{2} m^{2} (t) + \dots + γ_{n_{γ}} m^{n_{γ}} (t) \end{matrix}

(3)

where

n_{γ}

is the polynomial orders.

Equation (1) can be rewritten to

\begin{matrix} m (t) = [1 - A (z)] m (t) + B (z) u (t) \end{matrix}

(4)

In order to get unique parameter estimates, we introduce the key term separation technique presented in [7,29] and let the first coefficient of the nonlinear part be unity, i.e.,

γ_{1} = 1

. Then, we have

\begin{matrix} y (t) = m (t) + \sum_{i = 2}^{n_{γ}} γ_{i} m^{i} (t) + D (z) v (t) \end{matrix}

(5)

Here

m (t)

in Equation (5) is called as the key term. Substituting Equation (4) into Equation (5) gives

\begin{matrix} y (t) = [1 - A (z)] m (t) + B (z) u (t) + \sum_{i = 2}^{n_{γ}} γ_{i} m^{i} (t) + D (z) v (t) \end{matrix}

(6)

Define the information vectors and the parameter vectors

\begin{matrix} ϕ_{s} (t) : = & {[- m (t - 1), - m (t - 2), \dots, - m (t - n_{a}), u (t - 1), u (t - 2), \dots, u (t - n_{b})]}^{T} \in ℝ^{n_{a} + n_{b}} \\ ϕ_{γ} (t) : = & {[m^{2} (t), m^{3} (t), \dots, m^{n_{γ}} (t)]}^{T} \in ℝ^{n_{γ} - 1} \\ ϕ_{n} (t) : = & {[v (t - 1), v (t - 2), \dots, v (t - n_{d})]}^{T} \in ℝ^{n_{d}} \end{matrix}

ϕ (t) : = [\begin{matrix} ϕ_{s} (t) \\ ϕ_{γ} (t) \\ ϕ_{n} (t) \end{matrix}] \in ℝ^{n_{a} + n_{b} + n_{γ} + n_{d} - 1}

\begin{matrix} ϑ_{s} : = {[a_{1}, a_{2}, \dots, a_{n_{a}}, b_{1}, b_{2}, \dots, b_{n_{b}}]}^{T} \in ℝ^{n_{a} + n_{b}} \\ ϑ_{γ} : = {[γ_{2}, γ_{3}, \dots, γ_{n_{γ}}]}^{T} \in ℝ^{n_{γ} - 1} \\ ϑ_{n} : = {[d_{1}, d_{2}, \dots, d_{n_{d}}]}^{T} \in ℝ^{n_{d}} \end{matrix}

ϑ : = [\begin{matrix} ϑ_{s} \\ ϑ_{γ} \\ ϑ_{n} \end{matrix}] \in ℝ^{n_{a} + n_{b} + n_{γ} + n_{d} - 1}

Thus, Equation (4) can be written in a vector form

m (t) = ϕ_{s}^{T} (t) ϑ_{s}

(7)

Combining Equations (6) and (7), we can obtain the following identification model:

\begin{array}{l} y (t) & = ϕ_{s}^{T} (t) ϑ_{s} + ϕ_{γ}^{T} (t) ϑ_{γ} + ϕ_{n}^{T} (t) ϑ_{n} + v (t) \\ = ϕ^{T} (t) ϑ + v (t) \end{array}

(8)

The objective of this paper is to present a gradient based iterative identification algorithm to estimate the parameters a_i, b_i, γ_i, and d_i for the Wiener nonlinear OEMA model using the auxiliary model identification idea in [23].

3. The Gradient-Based Iterative Algorithm

This section derives the gradient-based iterative identification algorithm for the Wiener nonlinear OEMA model.

Define the stacked output vector

Y (N)

, the stacked information vector

Ψ (N)

and the white noise vector

V (N)

\begin{matrix} Y (N) & : = & {[y (N), y (N - 1), \dots, y (1)]}^{T} \in R^{N} \end{matrix}

(9)

\begin{matrix} Ψ (N) & : = & {[ϕ (N), ϕ (N - 1), \dots, ϕ (1)]}^{T} \in R^{N \times n_{0}} \end{matrix}

(10)

\begin{matrix} V (N) & : = & {[v (N), v (N - 1), \dots, v (1)]}^{T} \in R^{N} \end{matrix}

(11)

\begin{matrix} n_{0} : = & n_{a} + n_{b} + n_{γ} + n_{d} - 1 \end{matrix}

From Equations (8) to (11), we have

\begin{matrix} Y (N) & = & Ψ (N) ϑ + V (N) \end{matrix}

(12)

Define a quadratic criterion function

\begin{matrix} J (ϑ) : = & {∥ Y (N) - Ψ (N) ϑ ∥}^{2} \end{matrix}

(13)

Let

k = 1, 2, 3, \dots

be an iteration variable, and

{\hat{ϑ}}_{k}

be the iterative estimate of ϑ.

Using the negative gradient search for the optimization problem in Equation (13), we obtain the iterative algorithm of computing

{\hat{ϑ}}_{k}

as follows:

\begin{matrix} {\hat{ϑ}}_{k} & = & {\hat{ϑ}}_{k - 1} - \frac{1}{r_{k}} grad [J ({\hat{ϑ}}_{k - 1})] \\ = & {\hat{ϑ}}_{k - 1} + \frac{1}{r_{k}} Ψ^{T} (N) [Y (N) - Ψ (N) {\hat{ϑ}}_{k - 1}] \end{matrix}

(14)

\begin{matrix} r_{k} & = & r_{k - 1} + {∥ Ψ^{T} (N) Ψ (N) ∥}^{2} \end{matrix}

(15)

However,

Ψ (N)

in Equations (14) and (15) containing unknown inner variable

m (t)

and the unmeasurable noise term

v (t)

lead to a difficulty that the iterative solution

{\hat{ϑ}}_{k}

of ϑ is impossible to be computed. In order to solve this difficulty, the approach here is based on the auxiliary model idea. Let

{\hat{m}}_{k} (t)

and

{\hat{v}}_{k} (t)

be the estimate of

m (t)

and

v (t)

at iteration k, respectively, and define

\begin{matrix} {\hat{ϕ}}_{k} (t) : = & [\begin{matrix} {\hat{ϕ}}_{s, k} (t) \\ {\hat{ϕ}}_{γ, k} (t) \\ {\hat{ϕ}}_{n, k} (t) \end{matrix}] \end{matrix}

(16)

where

\begin{array}{l} {\hat{ϕ}}_{s, k} (t) & = & {[- {\hat{m}}_{k - 1} (t - 1), - {\hat{m}}_{k - 1} (t - 2), \dots, - {\hat{m}}_{k - 1} (t - n_{a}), u (t - 1), u (t - 2), \dots, u (t - n_{b})]}^{T} \\ {\hat{ϕ}}_{γ, k} (t) & = & {[{\hat{m}}_{k - 1}^{2} (t), {\hat{m}}_{k - 1}^{3} (t), \dots, {\hat{m}}_{k - 1}^{n_{γ}} (t)]}^{T} \\ {\hat{ϕ}}_{n, k} (t) & = & {[{\hat{v}}_{k - 1} (t - 1), {\hat{v}}_{k - 1} (t - 2), \dots, {\hat{v}}_{k - 1} (t - n_{d})]}^{T} \end{array}

Replacing

ϕ_{s} (t)

and

ϑ_{s}

in Equation (7) with

{\hat{ϕ}}_{s, k} (t)

and

{\hat{ϑ}}_{s, k}

, respectively, the iterative estimate

{\hat{m}}_{k} (t)

can be obtained by the following auxiliary model:

\begin{matrix} {\hat{m}}_{k} (t) = {\hat{ϕ}}_{s, k}^{T} (t) {\hat{ϑ}}_{s, k}, t = 1, 2, \dots, N \end{matrix}

(17)

Similarly, from Equation (8), the estimate

v_{k} (t)

can be computed by

{\hat{v}}_{k} (t) = y (t) - {\hat{ϕ}}_{k}^{T} (t) {\hat{ϑ}}_{k}

(18)

Define

\begin{matrix} {\hat{Ψ}}_{k} (N) : = [\begin{matrix} {\hat{ϕ}}_{k}^{T} (N) \\ {\hat{ϕ}}_{k}^{T} (N - 1) \\ ⋮ \\ {\hat{ϕ}}_{k}^{T} (1) \end{matrix}] \in R^{N \times n_{0}} \end{matrix}

(19)

Let

{\hat{ϑ}}_{k} = [\begin{matrix} {\hat{ϑ}}_{s, k} \\ {\hat{ϑ}}_{γ, k} \\ {\hat{ϑ}}_{n, k} \end{matrix}]

be the estimate of

ϑ = [\begin{matrix} ϑ_{s} \\ ϑ_{γ} \\ ϑ_{n} \end{matrix}]

at iteration k. Using

{\hat{Ψ}}_{k} (N)

in place of

Ψ (N)

in Equations (14) and (15), we have

\begin{matrix} {\hat{ϑ}}_{k} & = & {\hat{ϑ}}_{k - 1} + \frac{1}{r_{k}} {\hat{Ψ}}_{k}^{T} (N) [Y (N) - {\hat{Ψ}}_{k} (N) {\hat{ϑ}}_{k - 1}] \end{matrix}

(20)

\begin{matrix} r_{k} & = & r_{k - 1} + {∥ {\hat{Ψ}}_{k}^{T} (N) {\hat{Ψ}}_{k} (N) ∥}^{2} \end{matrix}

(21)

Equations (14)–(21) form the gradient-based iterative (GI) identification algorithm for the Wiener nonlinear OEMA model, which can be summarized as follows:

\begin{matrix} {\hat{ϑ}}_{k} & = & {\hat{ϑ}}_{k - 1} + \frac{1}{r_{k}} {\hat{Ψ}}_{k}^{T} (N) [Y (N) - {\hat{Ψ}}_{k} (N) {\hat{ϑ}}_{k - 1}] \end{matrix}

(22)

\begin{matrix} r_{k} & = & r_{k - 1} + {∥ {\hat{Ψ}}_{k}^{T} (N) {\hat{Ψ}}_{k} (N) ∥}^{2} \end{matrix}

(23)

\begin{matrix} {\hat{Ψ}}_{k} (N) & = & [\begin{matrix} {\hat{ϕ}}_{k}^{T} (N) \\ {\hat{ϕ}}_{k}^{T} (N - 1) \\ ⋮ \\ {\hat{ϕ}}_{k}^{T} (1) \end{matrix}] \end{matrix}

(24)

\begin{matrix} Y (N) & = & {[y (N), y (N - 1), \dots, y (1)]}^{T} \end{matrix}

(25)

\begin{matrix} {\hat{ϑ}}_{k} & = & {[{\hat{ϑ}}_{s, k}, {\hat{ϑ}}_{γ, k}, {\hat{ϑ}}_{n, k}]}^{T} \end{matrix}

(26)

\begin{matrix} {\hat{ϕ}}_{k} (t) & = & {[{\hat{ϕ}}_{s, k} (t), {\hat{ϕ}}_{γ, k} (t), {\hat{ϕ}}_{n, k} (t)]}^{T} \end{matrix}

(27)

\begin{matrix} {\hat{ϕ}}_{s, k} (t) & = & [- {\hat{m}}_{k - 1} (t - 1), - {\hat{m}}_{k - 1} (t - 2), \dots, - {\hat{m}}_{k - 1} (t - n_{a}), \\ u (t - 1), u (t - 2), \dots, u (t - n_{b})]^{T} \end{matrix}

(28)

\begin{matrix} {\hat{ϕ}}_{γ, k} (t) & = & {[{\hat{m}}_{k - 1}^{2} (t), {\hat{m}}_{k - 1}^{3} (t), \dots, {\hat{m}}_{k - 1}^{n_{γ}} (t)]}^{T} \end{matrix}

(29)

\begin{matrix} {\hat{ϕ}}_{n, k} (t) & = & {[{\hat{v}}_{k - 1} (t - 1), {\hat{v}}_{k - 1} (t - 2), \dots, {\hat{v}}_{k - 1} (t - n_{d})]}^{T} \end{matrix}

(30)

\begin{matrix} {\hat{m}}_{k} (t) & = & {\hat{ϕ}}_{s, k}^{T} (t) {\hat{ϑ}}_{s, k}, t = 1, 2, \dots, N \end{matrix}

(31)

\begin{matrix} {\hat{v}}_{k} (t) & = & y (t) - {\hat{ϕ}}_{k}^{T} (t) {\hat{ϑ}}_{k} \end{matrix}

(32)

The steps involved in computing the parameter estimate

{\hat{ϑ}}_{k}

in the GI algorithm are listed as follows:

Collect the input-output data ${u (t), y (t) : t = 1, 2, \dots, N}$ and form $Y (N)$ by Equation (25).
To initialize, let $k = 1$ , $r_{0} = 1$ , ${\hat{ϑ}}_{0} = 10^{- 6} 1_{n_{0}}$ , ${\hat{m}}_{0} (t) = 10^{- 6}$ , form ${\hat{ϕ}}_{1} (t)$ by Equations (27) to (30) and ${\hat{Ψ}}_{1} (t)$ by Equation (24).
Form ${\hat{ϕ}}_{k} (t)$ by Equations (27) to (30) and ${\hat{Ψ}}_{k} (t)$ by Equation (24).
Compute $r_{k}$ by Equation (23) and update the estimate ${\hat{ϑ}}_{k}$ by Equation (22).
Compute ${\hat{m}}_{k} (t)$ and ${\hat{v}}_{k} (t)$ by Equations (31) and (32), respectively.
Compare ${\hat{ϑ}}_{k}$ with ${\hat{ϑ}}_{k - 1}$ : if $∥ {\hat{ϑ}}_{k} - {\hat{ϑ}}_{k - 1} ∥^{2} ⩽ ε$ , then terminate the procedure and obtain the iterative times k and estimate $ϑ_{k}$ ; otherwise, increment k by 1 and go to step 3.

4. Example

An example is given to demonstrate the feasibility of the proposed algorithm. Consider the following Wiener nonlinear OEMA system:

\begin{matrix} y (t) & = & [1 - A (z)] m (t) + B (z) u (t) + γ_{2} m^{2} (t) + γ_{3} m^{3} (t) + D (z) v (t) \end{matrix}

\begin{array}{l} A (z) & = & 1 + a_{1} z^{- 1} + a_{2} z^{- 2} = 1 + 0.20 z^{- 1} + 0.44 z^{- 2} \\ B (z) & = & b_{1} z^{- 1} + b_{2} z^{- 2} = 0.99 z^{- 1} + 0.30 z^{- 2} \\ D (z) & = & 1 + d_{1} z^{- 2} = 1 + 0.21 z^{- 1} \end{array}

\begin{matrix} ϑ & = & {[a_{1}, a_{2}, b_{1}, b_{2}, γ_{2}, γ_{3}, d_{1}]}^{T} = [0.20, 0.44, 0.99, 0.30, 0.50, 0.25, 0.21] \end{matrix}

Figure 2. The GI estimation error δ versus k.

Figure 3. The GI and NI estimation error δ versus k (

σ^{2} = 0 . 20^{2}

Figure 3. The GI and NI estimation error δ versus k (

σ^{2} = 0 . 20^{2}

For this example system,

{u (t)}

is taken as persistent excitation signal with zero mean and unit variance, and

{v (t)}

as a white noise process with zero mean and constant variance

σ^{2} = 0 . 20^{2}

and

0 . 40^{2}

. Here, we take the whole data lengths

N = 1000

, and then apply the proposed GI algorithm in Equations (22)–(32) to estimate the unknown parameters (

a_{i}, b_{i}, γ_{i}, d_{i}

) of this nonlinear system. The parameter estimates and their errors with different noise variances are shown in Table 1 and Table 2, and the parameter estimation errors δ versus k are shown in Figure 2, where

δ : = ∥ {\hat{ϑ}}_{k} (t) - ϑ ∥ / ∥ ϑ ∥

For the sake of performance comparison, we apply the Newton iterative (NI) algorithm in [30] to estimate the unknown parameters of the proposed Wiener nonlinear system. The parameter estimation errors δ versus k are shown in Figure 3.

From Table 1 and Table 2, and Figure 2 and Figure 3, we can draw the following conclusions:

It is clear that the estimation errors become smaller (in general) as k increases: see the error curves in Figure 2 and the estimation errors of the last columns of Table 1 and Table 2.
A lower noise level results in a faster rate of convergence of the parameter estimates to the true parameters: see the error curves in Figure 2 and the estimation errors in Table 1 and Table 2.
The NI algorithm has a faster convergence rate than the GI algorithm, but the GI algorithm can generate more accurate parameter estimates than the NI algorithm: see the error curves in Figure 3.

Table 1. The parameter estimates (a_i, b_i, γ_i, d_i) and their errors (σ² = 0.40²).

**Table 1.** The parameter estimates (a_i, b_i, γ_i, d_i) and their errors (σ² = 0.40²).
k	a₁	a₂	b₁	b₂	γ₂	γ₃	d₁	δ(%)
10	0.02215	0.40793	1.00446	0.11168	0.49314	0.27343	0.15400	20.88476
50	0.14113	0.43950	0.97319	0.23592	0.53438	0.27736	0.17933	8.15348
100	0.19382	0.44038	0.97556	0.29595	0.52870	0.26852	0.21157	3.04925
200	0.21402	0.44122	0.99065	0.32470	0.50913	0.24897	0.23549	2.97170
300	0.21692	0.44127	0.99601	0.33017	0.50279	0.24304	0.24145	3.59966
400	0.21757	0.44127	0.99744	0.33149	0.50114	0.24152	0.24314	3.79156
500	0.21773	0.44127	0.99780	0.33182	0.50071	0.24112	0.24364	3.84560
True values	0.20000	0.44000	0.99000	0.30000	0.50000	0.25000	0.21000

Table 2. The parameter estimates (a_i, b_i, γ_i, d_i) and their errors (σ² = 0.20²).

**Table 2.** The parameter estimates (a_i, b_i, γ_i, d_i) and their errors (σ² = 0.20²).
k	a₁	a₂	b₁	b₂	γ₂	γ₃	d₁	δ (%)
10	0.02115	0.40802	1.02095	0.10735	0.47432	0.25670	0.12715	21.79777
50	0.13019	0.43964	0.98093	0.22118	0.52043	0.27002	0.12067	11.04226
100	0.18373	0.43985	0.97722	0.28055	0.52339	0.26897	0.13687	6.58059
200	0.20564	0.44044	0.98854	0.30949	0.50892	0.25355	0.16558	3.61544
300	0.20865	0.44051	0.99326	0.31470	0.50328	0.24815	0.18529	2.28582
400	0.20927	0.44054	0.99454	0.31591	0.50170	0.24670	0.19970	1.57463
500	0.20943	0.44057	0.99489	0.31622	0.50122	0.24628	0.21044	1.39000
True values	0.20000	0.44000	0.99000	0.30000	0.50000	0.25000	0.21000

5. Conclusions

In this paper we have derived the gradient-based iterative identification algorithm for Wiener nonlinear OEMA systems. The proposed algorithm can simultaneously estimate the parameters of the linear and nonlinear parts of Wiener nonlinear OEMA systems. The simulation results showed the parameters of Wiener nonlinear OEMA systems can be estimate effectively by the proposed algorithm. The method in the paper can be applied to study identification problems for other linear or nonlinear systems.

Acknowledgments

This work was supported by the Natural Science Foundation of the Jiangsu Higher Education Institutions of China (No. 15KJB120001), the Foundation of the Changshu Institute of Technology, China (Nos. KYZ2015006Z, KYZ2015007Z), Talent Peak of Six Industries of Jiangsu Province (2014-NY-021), and Qing Lan Project of Jiangsu Province.

Author Contributions

Lincheng Zhou prepared the manuscript and the simulation. Huigang Xu and Peiyi Zhu assisted in the revising work and the simulation. Xiangli Li was in charge of the overall research and critical revision of the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

Ding, F.; Liu, X.P.; Liu, G. Identification methods for Hammerstein nonlinear systems. Digit. Signal Proc. 2011, 21, 215–238. [Google Scholar] [CrossRef]
Li, J.H. Parameter estimation for Hammerstein CARARMA systems based on the Newton iteration. Appl. Math. Lett. 2013, 26, 91–96. [Google Scholar] [CrossRef]
Chen, J.; Wang, X.P.; Ding, R.F. Gradient based estimation algorithm for Hammerstein systems with saturation and dead-zone nonlinearities. Appl. Math. Model. 2012, 36, 238–243. [Google Scholar] [CrossRef]
Yu, L.; Zhang, J.B.; Liao, Y.; Ding, J. Parameter estimation error bounds for Hammerstein finite impulsive response models. Appl. Math. Comput. 2008, 202, 472–480. [Google Scholar] [CrossRef]
Li, X.L.; Ding, R.F.; Zhou, L.C. Least-squares-based iterative identification algorithm for Hammerstein nonlinear systems with non-uniform sampling. Int. J. Comput. Math. 2013, 90, 1524–1534. [Google Scholar] [CrossRef]
Wang, Y.Y.; Wang, X.D.; Wang, D.Q. Identification of Dual-Rate Sampled Hammerstein Systems with a Piecewise-Linear Nonlinearity Using the Key Variable Separation Technique. Algorithms 2015, 8, 366–379. [Google Scholar] [CrossRef]
Vörös, J. Parameter identification of Wiener systems with multisegment piecewise-linear nonlinearities. Syst. Control Lett. 2007, 56, 99–105. [Google Scholar] [CrossRef]
Zhou, L.C.; Li, X.L.; Pan, F. Gradient based iterative parameter identification for Wiener nonlinear systems. Appl. Math. Model. 2013, 37, 8203–8209. [Google Scholar] [CrossRef]
Zhou, L.C.; Li, X.L.; Pan, F. Gradient-based iterative identification for Wiener nonlinear systems with non-uniform sampling. Nonlinear Dyn. 2014, 76, 627–634. [Google Scholar] [CrossRef]
Chen, J. Gradient based iterative algorithm for wiener systems with piece-wise nonlinearities using analytic parameterization methods. Comput. Appl. Chem. 2011, 28, 855–857. [Google Scholar]
Zhou, L.C.; Li, X.L.; Pan, F. Gradient-based iterative identification for MISO Wiener nonlinear systems: Application to a glutamate fermentation process. Appl. Math. Model. 2013, 26, 886–892. [Google Scholar] [CrossRef]
Pelckmans, K. MINLIP for the identification of monotone Wiener systems. Automatica 2011, 47, 2298–2305. [Google Scholar] [CrossRef]
Wang, D.Q.; Ding, F. Least squares based and gradient based iterative identification for Wiener nonlinear systems. Signal Process. 2011, 91, 1182–1189. [Google Scholar] [CrossRef]
Hagenblad, A.; Ljung, L.; Wills, A. Maximum likelihood identification of Wiener models. Automatica 2008, 44, 2697–2705. [Google Scholar] [CrossRef]
Liu, Y.J.; Ding, F.; Shi, Y. Least squares estimation for a class of non–uniformly sampled systems based on the hierarchical identification principle. Circuits Syst. Signal Process. 2012, 31, 1985–2000. [Google Scholar] [CrossRef]
Liu, Y.J.; Wang, D.Q.; Ding, F. Least squares based iterative algorithms for identifying Box-Jenkins models with finite measurement data. Digit. Signal Process. 2010, 20, 1458–1467. [Google Scholar] [CrossRef]
Chen, H.; Lv, X.; Qiao, Y. Application of gradient descent method to the sedimentary grain-size distribution fitting. J. Comput. Appl. Math. 2009, 233, 1128–1138. [Google Scholar] [CrossRef]
Chen, J.; Ding, F. Modified stochastic gradient algorithms with fast convergence rates. J. Vib. Control 2011, 17, 1281–1286. [Google Scholar] [CrossRef]
Jiang, H.; Wilford, P. A stochastic conjugate gradient method for the approximation of functions. J. Comput. Appl. Math. 2012, 236, 2529–2544. [Google Scholar] [CrossRef]
Calo, V.M.; Collier, N.; Gehre, M.; Jin, B.; Radwan, H.; Santillana, M. Gradient-based estimation of Manning’s friction coefficient from noisy data. J. Comput. Appl. Math. 2013, 238, 1–13. [Google Scholar] [CrossRef]
Ding, J.; Shi, Y.; Wang, F.; Ding, H. A modified stochastic gradient based parameter estimation algorithm for dual-rate sampled-data systems. Digit. Signal Process. 2010, 20, 1238–1249. [Google Scholar] [CrossRef]
Liu, Y.J.; Yu, L.; Ding, F. Multi-innovation extended stochastic gradient algorithm and its performance analysis. Circuits Syst. Signal Process. 2010, 29, 649–667. [Google Scholar] [CrossRef]
Ding, F.; Liu, X.P.; Liu, G. Gradient based and least-squares based iterative identification methods for OE and OEMA systems. Digit. Signal Process. 2010, 20, 664–677. [Google Scholar] [CrossRef]
Xie, L.; Yang, H.Z. Gradient based iterative identification for non-uniform sampling output error systems. J. Vib. Control 2011, 17, 471–478. [Google Scholar] [CrossRef]
Xiong, W.L.; Ma, J.X.; Ding, R.F. An iterative numerical algorithm for modeling a class of Wiener nonlinear systems. Appl. Math. Lett. 2013, 26, 487–493. [Google Scholar] [CrossRef]
Wang, D.Q.; Yang, G.W.; Ding, R.F. Gradient-based iterative parameter estimation for Box-Jenkins systems. Comput. Math. Appl. 2010, 60, 1200–1208. [Google Scholar] [CrossRef]
Li, J.H.; Ding, R.F.; Yang, Y. Iterative parameter identification methods for nonlinear functions. Appl. Math. Model. 2012, 36, 2739–2750. [Google Scholar] [CrossRef]
Zhang, Z.N.; Ding, F.; Liu, X.G. Hierarchical gradient based iterative parameter estimation algorithm for multivariable output error moving average systems. Comput. Math. Appl. 2011, 61, 672–682. [Google Scholar] [CrossRef]
Wang, D.Q.; Chu, Y.Y.; Ding, F. Auxiliary model-based RELS and MI-ELS algorithms for Hammerstein OEMA systems. Comput. Math. Appl. 2010, 59, 3092–3098. [Google Scholar] [CrossRef]
Liu, M.M.; Xiao, Y.S.; Ding, R.F. Iterative identification algorithm for Wiener nonlinear systems using the Newton method. Appl. Math. Model. 2013, 37, 6584–6591. [Google Scholar] [CrossRef]

© 2015 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/).

Share and Cite

MDPI and ACS Style

Zhou, L.; Li, X.; Xu, H.; Zhu, P. Gradient-Based Iterative Identification for Wiener Nonlinear Dynamic Systems with Moving Average Noises. Algorithms 2015, 8, 712-722. https://doi.org/10.3390/a8030712

AMA Style

Zhou L, Li X, Xu H, Zhu P. Gradient-Based Iterative Identification for Wiener Nonlinear Dynamic Systems with Moving Average Noises. Algorithms. 2015; 8(3):712-722. https://doi.org/10.3390/a8030712

Chicago/Turabian Style

Zhou, Lincheng, Xiangli Li, Huigang Xu, and Peiyi Zhu. 2015. "Gradient-Based Iterative Identification for Wiener Nonlinear Dynamic Systems with Moving Average Noises" Algorithms 8, no. 3: 712-722. https://doi.org/10.3390/a8030712

APA Style

Zhou, L., Li, X., Xu, H., & Zhu, P. (2015). Gradient-Based Iterative Identification for Wiener Nonlinear Dynamic Systems with Moving Average Noises. Algorithms, 8(3), 712-722. https://doi.org/10.3390/a8030712

Article Menu

Gradient-Based Iterative Identification for Wiener Nonlinear Dynamic Systems with Moving Average Noises

Abstract

1. Introduction

2. The Derivation of the Wiener OEMA Model

3. The Gradient-Based Iterative Algorithm

4. Example

5. Conclusions

Acknowledgments

Author Contributions

Conflicts of Interest

References

Share and Cite

Article Metrics

Article Access Statistics

Further Information

Guidelines

MDPI Initiatives

Follow MDPI