Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1388969.1389015acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
demonstration

A new approach for multi-label classification based on default hierarchies and organizational learning

Published: 12 July 2008 Publication History

Abstract

Learning Classifier Systems (LCSs) are a class of expert systems that use a knowledge base of decision rules and a genetic algorithm (GA) [9] as a discovery mechanism. The set of decision rules allows the LCS to represent and learn control strategies, while the robust search ability of the GA allows it to search for new rules based on the performance of existing rules. LCS were first designed to solve machine learning problems, especially classification problems. Classification problems are problems where instances of a data set belong to a set of classes, and the system needs to infer, based on past experience, the correct class (or classes) of new, previously unseen, instances. However, the features of LCSs are also very useful for solving reinforcement learning problems, a class of problems where the system should learn to operate in the environment based only on performance feedback. This paper considers LCSs as an approach to classification problems, more specifically a more complex kind of classification called multi-label classification. This paper analyses the default hierarchy formation theory presented by [14] as a way of favoring the hierarchical arrangement of rules, and also the organizational learning theory [17] for adjusting the degree of individual and collective behaviors. We suggest a new method, combining both organizational learning and default hierarchy formation, for solving multi-label problems. The preliminary results with a simple multi-label problem show the potential of this method. Final discussion presents the conclusions and directions for further research.

References

[1]
F. Aiolli, F. Portera, and A. Sperduti. Speeding up the solution of multilabel problems with Support Vector Machines. In Supplementary Proc. of the Joint 13th International Conference on Artificial Neural Networks and 10th International Conference on Neural Information Processing), pages 118--121, 2003.
[2]
J. Bacardit and J. M. Garrell. Bloat control and generalization pressure using the minimum description length principle for a pittsburgh approach learning classifier system. In Proceedings of the 6th International Workshop on Learning Classifier Systems, 2003.
[3]
E. Bernadó-Mansilla, X. Llorá, and I. Traus. Multiobjective Learning Classifier Systems: An Overview. Technical report, University of Illinois at Urbana Champaign, Urbana, IL, 2005.
[4]
P. Bonelli, A. Parodi, S. Sen, and S. W. Wilson. NEWBOOLE: A fast GBML System. In Seventh International Conference on Machine Learning, pages 153--159. Morgan Kaufmann, 1990.
[5]
M. Boutell, J. Luo, X. Shen, and C. Brown. Learning multi-label scene classification. Pattern Recognition, 37(9):17571771, 2004.
[6]
A. Chan and A. A. Freitas. A New Ant Colony Algorithm for Multi-Label Classification with Applications in Bioinformatics. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 27--34, 2006.
[7]
R. H. Coase. The firm, the market, and the law. University of Chicago Press, Chicago, 1988.
[8]
J. H. Holland. Processing and Processors for schemata, contributed chapter in Associative Information Processing, EL jacks editor, 127--146, 1971.
[9]
J. H. Holland. Adaptation in Natural and Artificial Systems. The MIT Press, 1975.
[10]
J. H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. Pattern directed inference systems, pages 313--329, 1978.
[11]
A. Karalic and V. Pirnat. Significance level based multiple tree classification. Informatica, 15(5), 1991.
[12]
X. Llorà, K. Sastry, and D. E. Goldberg. The Compact Classifier System: Scalability Analysis and First Results. Technical report, University of Illinois at Urbana-Champaign, Urbana, IL, 2005.
[13]
J. Mendel and R. McLaren. Reinforcement learning control and pattern recognition systems, Adaptive, Learning and Pattern Recognition Systems: Theory and Applications, 1970.
[14]
R. Smith and D. Goldberg. Adaptive Default Hierarchy Formation. Applied Artificial Intelligence, 6(1):79--102, 1992.
[15]
G. Tsoumakas and I. Katakis. Multi-Label Classification: An Overview. International Journal of Data Warehousing and Mining, 3:1--13, 2007.
[16]
G. Tsoumakas and I. Katakis. Multi-Label Classification: An Overview. International Journal of Data Warehousing and Mining, 3:1--13, 2007.
[17]
J. R. Wilcox. Organizational learning within a learning classifier system. Master's thesis, University of Illinois at Urbana-Champaign, 1995. Illigal Report No.95003.
[18]
S. W. Wilson. Classifier Fitness Based on Accuracy. Evolutionary Computation, 3(2):149--175, 1995.
[19]
M.-L. Zhang and Z.-H. Zhou. A k-nearest neighbor based algorithm for multi-label classification. In Proceedings of the 1st IEEE International Conference on Granular Computing (GrC'05)), pages 718--721, 2005.

Cited By

View all
  • (2021)An effective action covering for multi-label learning classifier systemsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3449639.3459372(340-348)Online publication date: 26-Jun-2021
  • (2017)Multilabel Classification with Weighted Labels Using Learning Classifier Systems2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA.2017.0-147(275-280)Online publication date: Dec-2017
  • (2014)Knowledge in Memetic Algorithms for Stock ClassificationInternational Journal of Artificial Life Research10.4018/ijalr.20140101024:1(13-29)Online publication date: 1-Jan-2014
  • Show More Cited By

Index Terms

  1. A new approach for multi-label classification based on default hierarchies and organizational learning

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    GECCO '08: Proceedings of the 10th annual conference companion on Genetic and evolutionary computation
    July 2008
    1182 pages
    ISBN:9781605581316
    DOI:10.1145/1388969
    • Conference Chair:
    • Conor Ryan,
    • Editor:
    • Maarten Keijzer
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 July 2008

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. LCS
    2. default hierarchies
    3. organizational sizing

    Qualifiers

    • Demonstration

    Conference

    GECCO08
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 14 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)An effective action covering for multi-label learning classifier systemsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3449639.3459372(340-348)Online publication date: 26-Jun-2021
    • (2017)Multilabel Classification with Weighted Labels Using Learning Classifier Systems2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA.2017.0-147(275-280)Online publication date: Dec-2017
    • (2014)Knowledge in Memetic Algorithms for Stock ClassificationInternational Journal of Artificial Life Research10.4018/ijalr.20140101024:1(13-29)Online publication date: 1-Jan-2014
    • (2011)Voting based learning classifier system for multi-label classificationProceedings of the 13th annual conference companion on Genetic and evolutionary computation10.1145/2001858.2002019(355-360)Online publication date: 12-Jul-2011
    • (2009)A niching algorithm to learn discriminant functions with multi-label patternsProceedings of the 10th international conference on Intelligent data engineering and automated learning10.5555/1789574.1789648(570-577)Online publication date: 23-Sep-2009
    • (2009)The multi-label OCS with a genetic algorithm for rule discoveryProceedings of the 11th Annual conference on Genetic and evolutionary computation10.1145/1569901.1570078(1323-1330)Online publication date: 8-Jul-2009
    • (2009)A Niching Algorithm to Learn Discriminant Functions with Multi-Label PatternsIntelligent Data Engineering and Automated Learning - IDEAL 200910.1007/978-3-642-04394-9_69(570-577)Online publication date: 2009
    • (2009)A Tutorial on Multi-label Classification TechniquesFoundations of Computational Intelligence Volume 510.1007/978-3-642-01536-6_8(177-195)Online publication date: 2009

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media