Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Fuzzy rule weight modification with particle swarm optimisation

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The most challenging problem in developing fuzzy rule-based classification systems is the construction of a fuzzy rule base for the target problem. In many practical applications, fuzzy sets that are of particular linguistic meanings, are often predefined by domain experts and required to be maintained in order to ensure interpretability of any subsequent inference results. However, learning fuzzy rules using fixed fuzzy quantity space without any qualification will restrict the accuracy of the resulting rules. Fortunately, adjusting the weights of fuzzy rules can help improve classification accuracy without degrading the interpretability. There have been different proposals for fuzzy rule weight tuning through the use of various heuristics with limited success. This paper proposes an alternative approach using Particle Swarm Optimisation in the search of a set of optimal rule weights, entailing high classification accuracy. Systematic experimental studies are carried out using common benchmark data sets, in comparison to popular rule based learning classifiers. The results demonstrate that the proposed approach can boost classification performance, especially when the size of the initially built rule base is relatively small, and is competitive to popular rule-based learning classifiers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Agrawal S, Panigrahi K, Tiwari MK (2008) Multiobjective particle swarm algorithm with fuzzy clustering for electrical power dispatch. Evolut Comput IEEE Trans 12(5):529–541

    Article  Google Scholar 

  • Cordón O, del Jesus MJ, Herrera F (1999) A proposal on reasoning methods in fuzzy rule-based classification systems. Int J Approx Reason 20(1):21–45

    Article  Google Scholar 

  • Cordón O, Herrera F (1997) A three-stage evolutionary process for learning descriptive and approximate fuzzy-logic-controller knowledge bases from examples. Int J Approx Reason 17(4):369–407

    Article  MATH  Google Scholar 

  • Delgado M, Marín N, Sánchez D, Vila M-A (2003) Fuzzy association rules: general model and applications. Fuzzy Syst IEEE Trans 11(2):214–225

    Article  Google Scholar 

  • Diao R, Shen Q (2012) “A harmony search based approach to hybrid fuzzy-rough rule induction. In: Proceedings of the 21th international conference on fuzzy systems, IEEE, pp 1–8

  • Diao R, Shen Q (2012) Feature selection with harmony search. Syst Man Cybern Part B: Cybern IEEE Trans 42(6):1509–1523

    Article  Google Scholar 

  • Galea M, Shen Q (2006) Simultaneous ant colony optimization algorithms for learning linguistic fuzzy rules. In: Swarm intelligence in data mining. Springer, pp 75–99

  • Huang Z, Gedeon TD, Nikravesh M (2008) Pattern trees induction: a new machine learning method. Fuzzy Syst IEEE Trans 16(4):958–970

    Article  Google Scholar 

  • Ishibuchi H, Nozaki K, Tanaka H (1992) Distributed representation of fuzzy rules and its application to pattern classification. Fuzzy Sets Syst 52(1):21–32

    Article  Google Scholar 

  • Ishibuchi H, Nozaki K, Yamamoto N, Tanaka H (1994) Construction of fuzzy classification systems with rectangular fuzzy rules using genetic algorithms. Fuzzy Sets Syst 65(2):237–253

    Article  MathSciNet  Google Scholar 

  • Ishibuchi H, Murata T, Türkşen I (1997) Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems. Fuzzy Sets Syst 89(2):135–150

    Article  Google Scholar 

  • Ishibuchi H, Nakashima T, Murata T (1999) Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems. Syst Man Cybern Part B: Cybern IEEE Trans 29(5):601–618

    Article  Google Scholar 

  • Ishibuchi H, Nakashima T, Morisawa T (1999) Voting in fuzzy rule-based systems for pattern classification problems. Fuzzy Sets Syst 103(2):223–238

    Article  Google Scholar 

  • Ishibuchi H, Nakashima T, Murata T (1999) Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems. Syst Man Cybern Part B: Cybern IEEE Trans 29(5):601–618

    Article  Google Scholar 

  • Ishibuchi H, Nakashima T, Morisawa T (1999) Voting in fuzzy rule-based systems for pattern classification problems. Fuzzy Sets Syst 103(2):223–238

    Article  Google Scholar 

  • Ishibuchi H, Nakashima T (2001) Effect of rule weights in fuzzy rule-based classification systems. Fuzzy Syst IEEE Trans 9(4):506–515

    Article  Google Scholar 

  • Ishibuchi H, Yamamoto T (2005) Rule weight specification in fuzzy rule-based classification systems. Fuzzy Syst IEEE Trans 13(4):428–435

    Article  Google Scholar 

  • Jahromi MZ, Taheri M (2008) A proposed method for learning rule weights in fuzzy rule-based classification systems. Fuzzy Sets Syst 159(4):449–459

    Article  MathSciNet  MATH  Google Scholar 

  • Jensen R, Cornelis C, Shen Q (2009) Hybrid fuzzy-rough rule induction and feature selection. In: Proceedings of the 18th international conference on fuzzy systems. IEEE, pp 1151–1156

  • Kennedy J, Kennedy JF, Eberhart RC (2001) Swarm intelligence. Morgan Kaufmann

  • Mansoori EG, Zolghadri MJ, Katebi SD (2007) A weighting function for improving fuzzy classification systems performance. Fuzzy Sets Syst 158(5):583–591

    Article  MathSciNet  MATH  Google Scholar 

  • Marín-Blázquez JG, Shen Q (2002) From approximative to descriptive fuzzy classifiers. Fuzzy Syst IEEE Trans 10(4):484–497

    Article  Google Scholar 

  • Mitra S, Hayashi Y (2000) Neuro-fuzzy rule generation: survey in soft computing framework. Neural Netw IEEE Trans 11(3):748–768

    Article  Google Scholar 

  • Nauck D, Kruse R (1998) How the learning of rule weights affects the interpretability of fuzzy systems. In: Proceedings of the 7th international conference on fuzzy systems, vol 2, IEEE, pp 1235–1240

  • Nozaki K, Ishibuchi H, Tanaka H (1996) Adaptive fuzzy rule-based classification systems. Fuzzy Syst IEEE Trans 4(3):238–250

    Article  Google Scholar 

  • Pena-Reyes CA, Sipper M (1999) A fuzzy-genetic approach to breast cancer diagnosis. Artif Intell Med 17(2):131–155

    Article  Google Scholar 

  • Rasmani KA, Shen Q (2003) Weighted linguistic modelling based on fuzzy subsethood values. In: Proceedings of the 12th international conference on fuzzy systems, vol 1, IEEE, pp 714–719

  • Rasmani K, Garibaldi JM, Shen Q, Ellis IO (2009) Linguistic rulesets extracted from a quantifier-based fuzzy classification system. In: Proceedings of the 18th international conference on fuzzy systems. IEEE, pp 1204–1209

  • Rezaee Jordehi A, Jasni J (2013) Parameter selection in particle swarm optimisation: a survey. J Exp Theor Artif Intell 25(4):527–542

    Article  Google Scholar 

  • Salman A, Ahmad I, Al-Madani S (2002) Particle swarm optimization for task assignment problem. Microprocess Microsyst 26(8):363–371

    Article  Google Scholar 

  • Salman A, Ahmad I, Al-Madani S (2002) Particle swarm optimization for task assignment problem. Microprocess Microsyst 26(8):363–371

    Article  Google Scholar 

  • Senge R, Hullermeier E (2011) Top-down induction of fuzzy pattern trees. Fuzzy Syst IEEE Trans 19(2):241–252

    Article  Google Scholar 

  • Senge R, Hullermeier E (2011) Top-down induction of fuzzy pattern trees. Fuzzy Syst IEEE Trans 19(2):241–252

    Article  Google Scholar 

  • Shen Q, Chouchoulas A (2002) A rough-fuzzy approach for generating classification rules. Pattern Recogn 35(11):2425–2438

    Article  MATH  Google Scholar 

  • Shi Y, Eberhart R, Chen Y (1999) Implementation of evolutionary fuzzy systems. Fuzzy Syst IEEE Trans 7(2):109–119

    Article  Google Scholar 

  • Shi Y, Eberhart R, Chen Y (1999) Implementation of evolutionary fuzzy systems. Fuzzy Syst IEEE Trans 7(2):109–119

  • Su P, Li Y, Li Y, Shiu SC-K (2013) An auto-adaptive convex map generating path-finding algorithm: Genetic convex a*. Int J Mach Learn Cybern 4(5):551–563

    Article  Google Scholar 

  • Wang L-X, Mendel JM (1992) Generating fuzzy rules by learning from examples. Syst Man Cybern IEEE Trans 22(6):1414–1427

    Article  MathSciNet  Google Scholar 

  • Witten IH, Frank E, Trigg LE, Hall MA, Holmes G, Cunningham SJ (1999) Weka: practical machine learning tools and techniques with java implementations

  • Yuan Y, Zhuang H (1996) A genetic algorithm for generating fuzzy classification rules. Fuzzy Sets Syst 84(1):1–19

    Article  MATH  Google Scholar 

  • Zolghadri MJ, Mansoori EG (2007) Weighting fuzzy classification rules using receiver operating characteristics (roc) analysis. Inf Sci 177(11):2296–2307

    Article  Google Scholar 

Download references

Acknowledgments

The first and third authors are grateful to Aberystwyth University for providing PhD scholarships in support of their research. The authors are also very grateful to the reviewers for their constructive comments which have helped improve this work significantly.

Author information

Authors and Affiliations

  1. Department of Computer Science, Institute of Mathematics, Physics and Computer Science, Aberystwyth University, Aberystwyth, UK

    Tianhua Chen, Qiang Shen, Pan Su & Changjing Shang

Authors
  1. Tianhua Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qiang Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pan Su
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Changjing Shang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Changjing Shang.

Ethics declarations

Conflict of interest

All authors declare that they have no conflicts of interest in publishing this paper.

Additional information

Communicated by D. Neagu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, T., Shen, Q., Su, P. et al. Fuzzy rule weight modification with particle swarm optimisation. Soft Comput 20, 2923–2937 (2016). https://doi.org/10.1007/s00500-015-1922-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-015-1922-z

Keywords

Search

Navigation