IMPROVED MODEL ORDER ESTIMATION FOR NONLINEAR DYNAMIC SYSTEMS

Authors

  • Laszlo Sragner
  • Gabor Horvath

DOI:

https://doi.org/10.47839/ijc.2.2.212

Keywords:

Model order, Errors-in-Variables, Lipschitz-method

Abstract

In system modeling the choice of proper model structure is an essential task. Model structure is defined if both the model class and the size of the model within this class are determined. In dynamic system modeling model size is mainly determined by model order. The paper deals with the question of model order estimation when neural networks are used for modeling nonlinear dynamic systems. One of the possible ways of estimating the order of a neural model is the application of Lipschitz quotient. Although it is easy to use this method, its main drawback is the high sensitivity to noisy data. The paper proposes a new way to reduce the effect of noise. The idea of the proposed method is to combine the original Lipschitz method and the Errors In Variables (EIV) approach. The paper presents the details of the proposed combined method and gives the results of an extensive experimental study.

References

K. Hornik, M. Stinchcombe, H. White. Multilayer Feedforward Networks are Universal Approximators, Neural Networks Vol. 2 (1989). pp. 359-366.

J. Park, I. W. Sandberg. Approximation and Radial-Basis-Function Networks, Neural Computation, Vol. 5 No. 2 (1993). pp. 305-316.

J. Sjoberg, Q. Zhang, L. Ljung, A. Benveniste, B.Delyon, P.-Y. Glorennec, H. Hjalmarsson, A.Juditsky. Non-linear Black-box Modeling in System Identification: A Unified Overview, Automatica, 31 1691-1724 (1995).

H. Akaike. A New Look at the Statistical Model Identification, IEEE Transaction on Aut. Control Vol. AC-19, No. 6 (1974). pp.716-723.

J. Rissanen. Estimation of Structure by Minimum Description Length, Circuits, Systems and Signal Processing, special issue on Rational Approximations, Vol. 1, No. 3-4 (1982). pp. 395-406.

H. Akaike. Statistical Predictor Identification, Ann. Istitute of Statistical Mathematics, Vol. 22 (1970). pp. 203-217.

X. He, H Asada. A New Method for Identifying Orders of Input-output Models for Nonlinear Dynamic Systems. Proceedings of the American Control Conference, San Francisco, California June 1993, pp. 2520-2523.

G. Vandersteen. Identification of Linear and Nonlinear Systems in an Errors-In-Variables Least Squares and Total Least Squares Framework. PhD thesis, Vrije Universiteit Brussel, Belgium April 1997.

J. Van Gorp, J. Schoukens, R. Pintelon. The Errors-In-Variables Cost Function for Learning Neural Networks with Noisy Inputs, ANNIE 1998, Intelligent Engineering Systems Through Artificial Neural Networks, Vol. 8 (1998). pp. 141-146.

Downloads

Published

2014-08-01

How to Cite

Sragner, L., & Horvath, G. (2014). IMPROVED MODEL ORDER ESTIMATION FOR NONLINEAR DYNAMIC SYSTEMS. International Journal of Computing, 2(2), 93-100. https://doi.org/10.47839/ijc.2.2.212

Issue

Section

Articles