Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3319619.3326755acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
abstract

Generating interpretable reinforcement learning policies using genetic programming

Published: 13 July 2019 Publication History

Abstract

The search for interpretable reinforcement learning policies is of high academic and industrial interest. Especially for industrial systems, domain experts are more likely to deploy autonomously learned controllers if they are understandable and convenient to evaluate. Basic algebraic equations are supposed to meet these requirements, as long as they are restricted to an adequate complexity. In our recent work "Interpretable policies for reinforcement learning by genetic programming" published in Engineering Applications of Artificial Intelligence 76 (2018), we introduced the genetic programming for reinforcement learning (GPRL) approach. GPRL uses model-based batch reinforcement learning and genetic programming and autonomously learns policy equations from preexisting default state-action trajectory samples. Experiments on three reinforcement learning benchmarks demonstrate that GPRL can produce human-interpretable policies of high control performance.

References

[1]
D. Hein, S. Depeweg, M. Tokic, S. Udluft, A. Hentschel, T.A. Runkler, and V. Sterzing. 2017. A benchmark environment motivated by industrial control problems. In 2017 IEEE Symposium Series on Computational Intelligence (SSCI). 1--8.
[2]
D. Hein, S. Udluft, and T.A Runkler. 2018. Interpretable policies for reinforcement learning by genetic programming. Engineering Applications of Artificial Intelligence 76 (2018), 158--169.
[3]
F. Maes, R. Fonteneau, L. Wehenkel, and D. Ernst. 2012. Policy search in a space of simple closed-form formulas: Towards interpretability of reinforcement learning. Discovery Science (2012), 37--50.
[4]
R.S. Sutton and A.G. Barto. 1998. Reinforcement learning: An introduction. A Bradford book.

Cited By

View all
  • (2024)Explainable Reinforcement Learning: A Survey and Comparative ReviewACM Computing Surveys10.1145/361686456:7(1-36)Online publication date: 9-Apr-2024
  • (2024)A Review on the Applications of Reinforcement Learning Control for Power Electronic ConvertersIEEE Transactions on Industry Applications10.1109/TIA.2024.343517060:6(8430-8450)Online publication date: Nov-2024
  • (2024)A survey on interpretable reinforcement learningMachine Learning10.1007/s10994-024-06543-w113:8(5847-5890)Online publication date: 19-Apr-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '19: Proceedings of the Genetic and Evolutionary Computation Conference Companion
July 2019
2161 pages
ISBN:9781450367486
DOI:10.1145/3319619
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 July 2019

Check for updates

Author Tags

  1. genetic programming
  2. interpretable reinforcement learning
  3. model-based
  4. symbolic regression

Qualifiers

  • Abstract

Conference

GECCO '19
Sponsor:
GECCO '19: Genetic and Evolutionary Computation Conference
July 13 - 17, 2019
Prague, Czech Republic

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)34
  • Downloads (Last 6 weeks)5
Reflects downloads up to 14 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Explainable Reinforcement Learning: A Survey and Comparative ReviewACM Computing Surveys10.1145/361686456:7(1-36)Online publication date: 9-Apr-2024
  • (2024)A Review on the Applications of Reinforcement Learning Control for Power Electronic ConvertersIEEE Transactions on Industry Applications10.1109/TIA.2024.343517060:6(8430-8450)Online publication date: Nov-2024
  • (2024)A survey on interpretable reinforcement learningMachine Learning10.1007/s10994-024-06543-w113:8(5847-5890)Online publication date: 19-Apr-2024
  • (2023)An Investigation of the Behaviours of Machine Learning Agents Used in the Game of Go2023 10th International Conference on Dependable Systems and Their Applications (DSA)10.1109/DSA59317.2023.00105(734-742)Online publication date: 10-Aug-2023
  • (2022)Explaining the Behaviour of Game Agents Using Differential ComparisonProceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering10.1145/3551349.3560503(1-8)Online publication date: 10-Oct-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media