Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3486622.3493944acmconferencesArticle/Chapter ViewAbstractPublication PageswiConference Proceedingsconference-collections
research-article

Quantum Reinforcement Learning Applied to Board Games

Published: 13 April 2022 Publication History

Abstract

Reinforcement learning is a machine learning paradigm where an agent learns how to optimize its behavior solely through its interaction with the environment. It has been extensively studied and successfully applied to complex problems of many different domains in the past decades, i.e., robotics, games, scheduling. However, the performance of these algorithms becomes limited as the complexity and dimension of the state-action space increases. Recent advances in quantum computing and quantum information have sparked interest in possible applications to machine learning. By taking advantage of quantum mechanics, it is possible to efficiently process immense quantities of information and improve computational speed. In this work, we combined quantum computing with reinforcement learning and studied its application to a board game to assess the benefits that it can introduce, namely its impact on the learning efficiency of an agent. From the results, we concluded that the proposed quantum exploration policy improved the convergence rate of the agent and promoted a more efficient exploration of the state space.

References

[1]
Francisco Albarrán-Arriagada, Juan C. Retamal, Enrique Solano, and Lucas Lamata. 2018. Measurement-based adaptation protocol with quantum reinforcement learning. Physical Review A 98 (10 2018), 042315. Issue 4. https://doi.org/10.1103/PhysRevA.98.042315
[2]
Richard E. Bellman and Rand Corporation. 1957. Dynamic Programming. Princeton University Press, Princeton, NJ, USA.
[3]
Jacob Biamonte, Peter Wittek, Nicola Pancotti, Patrick Rebentrost, Nathan Wiebe, and Seth Lloyd. 2017. Quantum machine learning. Nature 549 (9 2017), 195–202. Issue 7671. https://doi.org/10.1038/nature23474
[4]
Gilles Brassard, Peter Høyer, Michele Mosca, and Alain Tapp. 2002. Quantum amplitude amplification and estimation. Quantum Computation and Information 305 (2002), 53–74. https://doi.org/10.1090/conm/305/05215
[5]
Hans J. Briegel and Gemma De las Cuevas. 2012. Projective simulation for artificial intelligence. Scientific Reports 2 (12 2012), 400. Issue 1. https://doi.org/10.1038/srep00400
[6]
Samuel Yen-Chi Chen, Chao-Han Huck Yang, Jun Qi, Pin-Yu Chen, Xiaoli Ma, and Hsi-Sheng Goan. 2020. Variational Quantum Circuits for Deep Reinforcement Learning. IEEE Access 8(2020), 141007–141024. https://doi.org/10.1109/ACCESS.2020.3010470
[7]
Daoyi Dong, Chunlin Chen, Hanxiong Li, and Tzyh-Jong Tarn. 2008. Quantum Reinforcement Learning. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 38 (10 2008), 1207–1220. Issue 5. https://doi.org/10.1109/TSMCB.2008.925743
[8]
Frédéric Magniez, Ashwin Nayak, Jérémie Roland, and Miklos Santha. 2011. Search via Quantum Walk. SIAM J. Comput. 40 (1 2011), 142–164. Issue 1. https://doi.org/10.1137/090745854
[9]
Andrew Y. Ng, Daishi Harada, and Stuart J. Russell. 1999. Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping. In Proceedings of the Sixteenth International Conference on Machine Learning(ICML ’99). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 278–287.
[10]
Giuseppe Davide Paparo, Vedran Dunjko, Adi Makmal, Miguel Angel Martin-Delgado, and Hans J. Briegel. 2014. Quantum speedup for active learning agents. Physical Review X 4(2014), 031002. Issue 3. https://doi.org/10.1103/PhysRevX.4.031002
[11]
Arthur L. Samuel. 1959. Some Studies in Machine Learning Using the Game of Checkers. IBM Journal of Research and Development 3, 3 (1959), 210–229. https://doi.org/10.1147/rd.33.0210
[12]
Jonathan Schaeffer, Neil Burch, Yngvi Bjornsson, Akihiro Kishimoto, Martin Muller, Robert Lake, Paul Lu, and Steve Sutphen. 2007. Checkers Is Solved. Science 317 (9 2007), 1518–1522. Issue 5844. https://doi.org/10.1126/science.1144079
[13]
Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement Learning: An Introduction(Second ed.). The MIT Press, Cambridge, MA, USA.

Cited By

View all
  • (2024)Parametrized Quantum Circuits for Reinforcement Learning2024 4th International Multidisciplinary Information Technology and Engineering Conference (IMITEC)10.1109/IMITEC60221.2024.10850927(240-251)Online publication date: 27-Nov-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
WI-IAT '21: IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology
December 2021
698 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 April 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. board games
  2. quantum computing
  3. reinforcement learning

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

WI-IAT '21
Sponsor:
WI-IAT '21: IEEE/WIC/ACM International Conference on Web Intelligence
December 14 - 17, 2021
VIC, Melbourne, Australia

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)25
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Parametrized Quantum Circuits for Reinforcement Learning2024 4th International Multidisciplinary Information Technology and Engineering Conference (IMITEC)10.1109/IMITEC60221.2024.10850927(240-251)Online publication date: 27-Nov-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media