Abstract
Rule systems have failed to attract much interest in large data analysis problems because they tend to be too simplistic to be useful or consist of too many rules for human interpretation. We present a method that constructs a hierarchical rule system, with only a small number of rules at each stage of the hierarchy. Lower levels in this hierarchy focus on outliers or areas of the feature space where only weak evidence for a rule was found in the data. Rules further up, at higher levels of the hierarchy, describe increasingly general and strongly supported aspects of the data. We demonstrate the proposed method’s usefulness on several classification benchmark data sets using a fuzzy rule induction process as the underlying learning algorithm. The results demonstrate how the rule hierarchy allows to build much smaller rule systems and how the model—especially at higher levels of the hierarchy—remains interpretable. The presented method can be applied to a variety of local learning systems in a similar fashion.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Abe, S., Lan, M.-S.: A method for fuzzy rules extraction directly from numerical data and its application to pattern classifiction. IEEE Transactions on Fuzzy Systems 3(1), 18–28 (1995)
Apte, C., Hong, S., Hosking, J., Lepre, J., Pednault, E., Rosen, B.K.: Decomposition of heterogeneous classification problems. Intelligent Data Analysis 2(2), 17–28 (1998)
Berthold, M.R.: Learning fuzzy models and potential outliers. In: Computational Intelligence in Data Mining, pp. 111–126. Springer, Heidelberg (2000)
Berthold, M.R.: Mixed fuzzy rule formation. International Journal of Approximate Reasoning (IJAR) 32, 67–84 (2003)
Geva, A.B.: Hierarchical unsupervised fuzzy clustering. IEEE Transactions on Fuzzy Systems 7(6), 723–733 (1999)
Higgins, C.M., Goodman, R.M.: Learning fuzzy rule-based neural networks for control. In: Advances in Neural Information Processing Systems, California, vol. 5, pp. 350–357. Morgan Kaufmann, San Francisco (1993)
Michie, D., Spiegelhalter, D.J., Taylor, C.C. (eds.): Machine Learning, Neural and Statistical Classification. Ellis Horwood Limited (1994)
Nozaki, K., Ishibuchi, H., Tanaka, H.: Adaptive fuzzy rule-based classification systems. IEEE Transactions on Fuzzy Systems 4(3), 238–250 (1996)
Salzberg, S.: A nearest hyperrectangle learning method. Machine Learning 6, 251–276 (1991)
Silipo, R., Berthold, M.R.: Input features impact on fuzzy decision processes. IEEE Transcation on Systems, Man, and Cybernetics, Part B: Cybernetics 30(6), 821–834 (2000)
Simpson, P.K.: Fuzzy min-max neural networks – part 1: Classification. IEEE Transactions on Neural Networks 3(5), 776–786 (1992)
Wang, L.-X., Mendel, J.M.: Generating fuzzy rules by learning from examples. IEEE Transactions on Systems, Man, and Cybernetics 22(6), 1313–1427 (1992)
Wettschereck, D.: A hybrid nearest-neighbour and nearest-hyperrectangle learning algorithm. In: Proceedings of the European Conference on Machine Learning, pp. 323–335 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gabriel, T.R., Berthold, M.R. (2003). Constructing Hierarchical Rule Systems. In: R. Berthold, M., Lenz, HJ., Bradley, E., Kruse, R., Borgelt, C. (eds) Advances in Intelligent Data Analysis V. IDA 2003. Lecture Notes in Computer Science, vol 2810. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45231-7_8
Download citation
DOI: https://doi.org/10.1007/978-3-540-45231-7_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40813-0
Online ISBN: 978-3-540-45231-7
eBook Packages: Springer Book Archive