Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3377929.3398102acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Generic approaches for parallel rule matching in learning classifier systems

Published: 08 July 2020 Publication History

Abstract

The XCS classifier system (XCS) constitutes the most deeply investigated evolutionary rule-based machine learning algorithm. Due to its online learning nature, it is not as computationally intense as deep learning approaches. However, in order to increase XCS's realtime capabilities, it is worth to improve its runtime for the inference step. A iteration through XCS's main loop involves various steps. Among them, matching usually constitutes the computationally most expensive part. Various ways for improvements have been proposed, e.g. using specialized hardware or vector commands. However, existing approaches require either a certain hardware coupled with a specific instruction set, or a dedicated multiprocessing programming language. In this context, parallel programs are often evaluated in terms of their speed up, but it turns out that qualitative criteria such as flexibility and independence of a specific hardware are also relevant. We therefore present a generic parallel approach for matching. We only rely on the minimum assumption of a multicore CPU with standard synchronization mechanisms, e.g., locks. Those assumptions are satisfied in almost all modern computing systems and high-level programming languages today. Thus we show that our approaches cannot only decrease the runtime, but are also reusable for most learning classifier systems and computing systems.

References

[1]
M. Abedini, M. Kirley, R. Chiong, and T. Weise. 2013. GPU-accelerated eXtended Classifier System. In 2013 IEEE Symposium on Computational Intelligence and Data Mining (CIDM). 293--300.
[2]
Jaume Bacardit and Natalio Krasnogor. 2009. A Mixed Discrete-Continuous Attribute List Representation for Large Scale Classification Domains. 1155--1162.
[3]
Martin Butz, Pier Luca Lanzi, and Stewart Wilson. 2006. Hyper-ellipsoidal Conditions In XCS: Rotation, Linear Approximation, and Solution Structure ABSTRACT, Vol. 2. 1457--1464.
[4]
Martin V. Butz and Stewart W. Wilson. 2001. An Algorithmic Description of XCS.
[5]
Gilles Éné and Mathias Péroumalnaïk. 2010. Speedup Character-Based Matching in Learning Classifier Systems with Xor. In Proceedings of the 12th Annual Conference Companion on Genetic and Evolutionary Computation (GECCO '10). Association for Computing Machinery, New York, NY, USA, 1879--1884.
[6]
María Franco, Natalio Krasnogor, and Jaume Bacardit. 2010. Speeding up the BioHEL evolutionary learning system using GPGPUs. (12 2010).
[7]
Aurélien Géron. 2017. Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems (1st ed.). O'Reilly Media, Inc.
[8]
John H. Holland. 1975. Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor, MI. second edition, 1992.
[9]
David B. Kirk and Wen-mei W. Hwu. 2010. Programming Massively Parallel Processors: A Hands-on Approach (1st ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
[10]
Vipin Kumar. 2002. Introduction to Parallel Computing (2nd ed.). Addison-Wesley Longman Publishing Co., Inc., USA.
[11]
Pier Luca Lanzi and Daniele Loiacono. 2009. Speeding Up Matching in Learning Classifier Systems Using CUDA, Vol. 6471. 1--20.
[12]
Pier Luca Lanzi and Stewart Wilson. 2005. Classifier conditions based on convex hulls.
[13]
Xavier Llorà and Kumara Sastry. 2006. Fast Rule Matching for Learning Classifier Systems via Vector Instructions. In Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation (GECCO '06). Association for Computing Machinery, New York, NY, USA, 1513--1520.
[14]
Tim Mattson, Beverly Sanders, and Berna Massingill. 2004. Patterns for Parallel Programming. (09 2004).
[15]
Christian Müller-Schloer, Hartmut Schmeck, and Theo Ungerer. 2011. Organic Computing - A Paradigm Shift for Complex Systems (1st ed.). Springer-Verlag, Berlin, Heidelberg.
[16]
Kyoung-Su Oh and Keechul Jung. 2004. GPU implementation of neural networks. Pattern Recognition 37, 6 (2004), 1311 -- 1314.
[17]
David Pätzel and Jörg Hähner. 2018. An Algebraic Description of XCS. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO '18). Association for Computing Machinery, New York, NY, USA, 1434--1441.
[18]
David Pätzel, Anthony Stein, and Jörg Hähner. 2019. A Survey of Formal Theoretical Advances Regarding XCS. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO '19). ACM, New York, NY, USA, 1295--1302.
[19]
Jason Sanders and Edward Kandrot. 2010. CUDA by Example: An Introduction to General-Purpose GPU Programming (1st ed.). Addison-Wesley Professional.
[20]
Theo Ungerer. 1997. Parallelrechner und parallele Programmierung.
[21]
Ryan J. Urbanowicz and Will N. Browne. 2017. Introduction to Learning Classifier Systems (1st ed.). Springer Publishing Company, Incorporated.
[22]
Stewart Wilson. 2000. Get Real! XCS with Continuous-Valued Inputs. Lecture Note in Computer Science 1996.

Cited By

View all
  • (2022)XCS on embedded systemsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3533977(2071-2079)Online publication date: 9-Jul-2022

Index Terms

  1. Generic approaches for parallel rule matching in learning classifier systems
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    GECCO '20: Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion
    July 2020
    1982 pages
    ISBN:9781450371278
    DOI:10.1145/3377929
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 July 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. XCS classifier system
    2. evolutionary machine learning
    3. learning classifier systems
    4. parallel programming
    5. rule matching

    Qualifiers

    • Research-article

    Conference

    GECCO '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 12 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)XCS on embedded systemsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3520304.3533977(2071-2079)Online publication date: 9-Jul-2022

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media