Article

Evolving Fuzzy Decision Trees with Genetic Programming and Clustering

Author:

Jeroen EggermontAuthors Info & Claims

EuroGP '02: Proceedings of the 5th European Conference on Genetic Programming

Pages 71 - 82

Published: 03 April 2002 Publication History

Abstract

In this paper we present a new fuzzy decision tree representation for data classification using genetic programming. The new fuzzy representation utilizes fuzzy clusters for handling continuous attributes. To make optimal use of the fuzzy classifications of this representation an extra fitness measure is used. The new fuzzy representation will be compared, using several machine learning data sets, to a similar non-fuzzy representation as well as to some other evolutionary and non-evolutionary algorithms from literature.

References

[1]

W. Banzhaf, P. Nordin, R.E. Keller, and F.D. Francone. Genetic Programming - An Introduction; On the Automatic Evolution of Computer Programs and its Applications . Morgan Kaufmann, 1998.

[2]

L. Breiman. Bagging predictors. Machine Learning , 26(2):123-140, 1996.

[3]

J. Eggermont and J. I. van Hemert. Adaptive genetic programming applied to new and existing simple regression problems. In J. Miller, M. Tomassini, P.L. Lanzi, C. Ryan, A.G.B. Tetamanzi, and W.B. Langdon, editors, Proceedings on the Fourth European Conference on Genetic Programming (EuroGP'01) , volume 2038 of LNCS , pages 23-35. Springer-Verlag, 2001.

[4]

Y. Freund and R.E. Schapire. Experiments with a new boosting algorithm. In Proc. 13th International Conference on Machine Learning , pages 148-146. Morgan Kaufmann, 1996.

[5]

J.M. de Graaf, W.A. Kosters, and J.J.W. Witteman. Interesting fuzzy association rules in quantitative databases. In L. de Raedt and A. Siebes, editors, 5th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD'01) , volume 2168 of LNAI , pages 140-151. Springer Verlag, 2001.

[6]

Th.D. Haynes, D.A. Schoenefeld, and R. L. Wainwright. Type inheritance in strongly typed genetic programming. In P.J. Angeline and K.E. Kinnear, Jr., editors, Advances in Genetic Programming 2 , chapter 18, pages 359-376. MIT Press, Cambridge, MA, USA, 1996.

[7]

L. Kaufman. Finding groups in data: An introduction to cluster analysis. In Finding Groups in Data: An Introduction to Cluster Analysis . Wiley, New York, 1990.

[8]

M. Keijzer, J. J. Merelo, G. Romero, and M. Schoenauer. Evolving objects: A general purpose evolutionary computation library. In P. Collet et al., editor, Proceedings of Evolution Artificielle'01 , LNCS. Springer Verlag, 2001. To appear.

[9]

J.R. Koza. Genetic Programming . MIT Press, 1992.

[10]

J.J. Liu and J.T. Kwok. An extended genetic rule induction algorithm. In Proc. of the 2000 Congress on Evolutionary Computation , pages 458-463, Piscataway, NJ, 2000. IEEE Service Center.

[11]

R.R.F. Mendes, F.B. Voznika, A.A. Freitas, and J.C. Nievola. Discovering fuzzy classification rules with genetic programming and co-evolution. In L. de Raedt and A.Siebes, editors, 5th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD'01) , volume 2168 of LNAI , pages 314-325. Springer Verlag, 2001.

[12]

D.J. Montana. Strongly typed genetic programming. Evolutionary Computation , 3(2):199-230, 1995.

[13]

J. Peña, J. Lozano, and P. Larrañaga. An empirical comparison of four initialization methods for the k -means algorithm. Pattern Recognition Letters , 20:1027-1040, 1999.

[14]

J.R. Quinlan. C4.5: Programs for machine learning . Morgan Kaufmann, 1993.

[15]

D. Palomo van Es. Fuzzy association rules and promotional sales data. Master's thesis, Leiden University, 2001.

Cited By

Agapitos AO'Neill MBrabazon ATheodoridis T(2011)Maximum margin decision surfaces for increased generalisation in evolutionary decision tree learningProceedings of the 14th European conference on Genetic programming10.5555/2008307.2008314(61-72)Online publication date: 27-Apr-2011
https://dl.acm.org/doi/10.5555/2008307.2008314
Espejo PVentura SHerrera F(2010)A survey on the application of genetic programming to classificationIEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews10.5555/1774041.177404240:2(121-144)Online publication date: 1-Mar-2010
https://dl.acm.org/doi/10.5555/1774041.1774042
Chen LChen CPedrycz W(2010)A gradient-descent-based approach for transparent linguistic interface generation in fuzzy modelsIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics10.1109/TSMCB.2009.203644340:5(1219-1230)Online publication date: 1-Oct-2010
https://dl.acm.org/doi/10.1109/TSMCB.2009.2036443
Show More Cited By

Evolving Fuzzy Decision Trees with Genetic Programming and Clustering
1. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
    2. Search methodologies
  2. Machine learning
    1. Learning paradigms
      1. Supervised learning
      2. Unsupervised learning
    2. Machine learning approaches

Recommendations

Extraction of fuzzy rules from fuzzy decision trees: An axiomatic fuzzy sets (AFS) approach

In this study, we introduce a new type of coherence membership function to describe fuzzy concepts, which builds upon the theoretical findings of the Axiomatic Fuzzy Set (AFS) theory. This type of membership function embraces both the factor of ...
Multicriteria fuzzy decision making based on interval-valued intuitionistic fuzzy sets

In this paper, we present a new method for multicriteria fuzzy decision making based on interval-valued intuitionistic fuzzy sets, where interval-valued intuitionistic fuzzy values are used to represent evaluating values of the decision-maker with ...
Fuzzy decision-making based on likelihood-based comparison relations
Special section on computing with words

In this paper, we present a new fuzzy decision-making method, which is based on likelihood-based comparison relations. First, we introduce the concepts of likelihood-based comparison relations for intervals. Then, we propose the concept of likelihood-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

EuroGP '02: Proceedings of the 5th European Conference on Genetic Programming

April 2002

335 pages

ISBN:3540433783

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 03 April 2002

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Agapitos AO'Neill MBrabazon ATheodoridis T(2011)Maximum margin decision surfaces for increased generalisation in evolutionary decision tree learningProceedings of the 14th European conference on Genetic programming10.5555/2008307.2008314(61-72)Online publication date: 27-Apr-2011
https://dl.acm.org/doi/10.5555/2008307.2008314
Espejo PVentura SHerrera F(2010)A survey on the application of genetic programming to classificationIEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews10.5555/1774041.177404240:2(121-144)Online publication date: 1-Mar-2010
https://dl.acm.org/doi/10.5555/1774041.1774042
Chen LChen CPedrycz W(2010)A gradient-descent-based approach for transparent linguistic interface generation in fuzzy modelsIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics10.1109/TSMCB.2009.203644340:5(1219-1230)Online publication date: 1-Oct-2010
https://dl.acm.org/doi/10.1109/TSMCB.2009.2036443
Shukla STiwari M(2009)Soft decision treesExpert Systems with Applications: An International Journal10.1016/j.eswa.2007.09.06536:1(551-563)Online publication date: 1-Jan-2009
https://dl.acm.org/doi/10.1016/j.eswa.2007.09.065
Suchý JKubalík J(2005)Inducing diverse decision forests with genetic programmingProceedings of the 8th European conference on Genetic Programming10.1007/978-3-540-31989-4_27(301-310)Online publication date: 30-Mar-2005
https://dl.acm.org/doi/10.1007/978-3-540-31989-4_27
Eggermont JKok JKosters WHaddad HOmicini AWainwright RLiebrock L(2004)Genetic Programming for data classificationProceedings of the 2004 ACM symposium on Applied computing10.1145/967900.968104(1001-1005)Online publication date: 14-Mar-2004
https://dl.acm.org/doi/10.1145/967900.968104
Galea MShen QLevine J(2004)Evolutionary approaches to fuzzy modelling for classificationThe Knowledge Engineering Review10.1017/S026988890400018919:1(27-59)Online publication date: 1-Mar-2004
https://dl.acm.org/doi/10.1017/S0269888904000189

View Options

View options

Media

Figures

Other

Tables

View Table of Contents