abstract

Artificial Playfulness: A Tool for Automated Agent-Based Playtesting

Authors:

Samantha . Stahlke,

Atiya Nova,

Pejman Mirza-BabaeiAuthors Info & Claims

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: LBW0176, Pages 1 - 6

https://doi.org/10.1145/3290607.3313039

Published: 02 May 2019 Publication History

Get Access

Abstract

Usertesting is commonly employed in games user research (GUR) to understand the experience of players interacting with digital games. However, recruitment and testing with human users can be laborious and resource-intensive, particularly for independent developers. To help mitigate these obstacles, we are developing a framework for simulated testing sessions with agents driven by artificial intelligence (AI). Specifically, we aim to imitate the navigation of human players in a virtual world. By mimicking the tendency of users to wander, explore, become lost, and so on, these agents may be used to identify basic issues with a game's world and level design, enabling informed iteration earlier in the development process. Here, we detail our progress in developing a framework for configurable agent navigation and simple visualization of simulated data. Ultimately, we hope to provide a basis for the development of a tool for simulation-driven usability testing in games.

References

[1]

Staffan Bjork and Jussi Holopainen. 2005. Patterns in Game Design. Charles River Media.

Google Scholar

[2]

Benjamin Cowley and Darryl Charles. 2016. Behavlets: a method for practical player modelling using psychologybased player traits and domain specific features. User Modeling and User-Adapted Interaction 26, 2 (June 2016), 257--306.

Digital Library

Google Scholar

[3]

C. Holmgård, A. Liapis, J. Togelius, and G. N. Yannakakis. 2014. Evolving personas for player decision modeling. In 2014 IEEE Conference on Computational Intelligence and Games. 1--8.

Google Scholar

[4]

T. Machado, D. Gopstein, A. Nealen, O. Nov, and J. Togelius. 2018. AI-Assisted Game Debugging with Cicero. In 2018 IEEE Congress on Evolutionary Computation (CEC). 1--8.

Google Scholar

[5]

Pejman Mirza-Babaei, Naeem Moosajee, and Brandon Drenikow. 2016. Playtesting for Indie Studios. In Proceedings of the 20th International Academic Mindtrek Conference (AcademicMindtrek '16). ACM, New York, NY, USA, 366--374.

Digital Library

Google Scholar

[6]

Lennart E. Nacke, Chris Bateman, and Regan L. Mandryk. 2014. BrainHex: A neurobiological gamer typology survey. Entertainment Computing 5, 1 (Jan. 2014), 55--62.

Crossref

Google Scholar

[7]

N. Shaker, J. Togelius, G. N. Yannakakis, L. Poovanna, V. S. Ethiraj, S. J. Johansson, R. G. Reynolds, L. K. Heether, T. Schumann, and M. Gallagher. 2013. The turing test track of the 2012 Mario AI Championship: Entries and evaluation. In 2013 IEEE Conference on Computational Inteligence in Games (CIG). 1--8.

Google Scholar

[8]

David Silver, Aja Huang, Chris J. Maddison, et al. 2016. Mastering the game of Go with deep neural networks and tree search. Nature 529, 7587 (Jan. 2016), 484--489.

Crossref

Google Scholar

[9]

Gillian Smith, Jim Whitehead, and Michael Mateas. 2010. Tanagra: A Mixed-initiative Level Design Tool. In Proceedings of the Fifth International Conference on the Foundations of Digital Games (FDG '10). ACM, New York, NY, USA, 209--216.

Digital Library

Google Scholar

[10]

Samantha N. Stahlke and Pejman Mirza-Babaei. 2018. Usertesting Without the User: Opportunities and Challenges of an AI-Driven Approach in Games User Research. Comput. Entertain. 16, 2 (April 2018), 9:1--9:18.

Digital Library

Google Scholar

[11]

J. Jay Todd and René Marois. 2004. Capacity limit of visual short-term memory in human posterior parietal cortex. Nature 428, 6984 (April 2004), 751--754.

Google Scholar

[12]

Jonathan Tremblay, Pedro Andrade Torres, Nir Rikovitch, and Clark Verbrugge. 2013. An Exploration Tool for Predicting Stealthy Behaviour. In Artificial Intelligence in the Game Design Process 2: Papers from the 2013 AIIDE Workshop.

Google Scholar

[13]

Georgios N. Yannakakis, Pieter Spronck, Daniele Loiacono, and Elisabeth André. 2013. Player Modeling. In Artificial and Computational Intelligence in Games, Simon M. Lucas, Michael Mateas, Mike Preuss, Pieter Spronck, and Julian Togelius (Eds.). Dagstuhl Follow-Ups, Vol. 6. Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany, 45--59.

Google Scholar

Cited By

View all

Gutiérrez-Sánchez PGómez-Martín MGonzález-Calero PGómez-Martín P(2024)A Progress-Based Algorithm for Interpretable Reinforcement Learning in Regression TestingIEEE Transactions on Games10.1109/TG.2024.342660116:4(844-853)Online publication date: Dec-2024
https://doi.org/10.1109/TG.2024.3426601
Sestini AGisslén LBergdahl JTollmar KBagdanov A(2024)Automated Gameplay Testing and Validation With Curiosity-Conditioned Proximal TrajectoriesIEEE Transactions on Games10.1109/TG.2022.322691016:1(113-126)Online publication date: Mar-2024
https://doi.org/10.1109/TG.2022.3226910
Yadgaroff DSestini ATollmar KOzcelikkale AGisslén L(2024)Improving Generalization in Game Agents with Data Augmentation in Imitation Learning2024 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC60901.2024.10612178(1-8)Online publication date: 30-Jun-2024
https://doi.org/10.1109/CEC60901.2024.10612178
Show More Cited By

Index Terms

Artificial Playfulness: A Tool for Automated Agent-Based Playtesting

Recommendations

PathOS+: A New Realm in Expert Evaluation
CHI PLAY '21: Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play

Expert evaluation is commonly employed in usability research as it is fast and cost-effective. However, as it heavily relies on evaluators’ expertise, it is associated with problems of subjective interpretation. This is particularly noticeable in the ...
Charting the Uncharted with GUR: How AI Playtesting Can Supplement Expert Evaluation
FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games

Despite the advantages of using expert evaluation as a method within games user research (GUR) (i.e. provides stakeholders low cost, rapid feedback), it does not always accurately reflect the general player’s experience. Testing the game out with real ...
Artificial Players in the Design Process: Developing an Automated Testing Tool for Game Level and World Design
CHI PLAY '20: Proceedings of the Annual Symposium on Computer-Human Interaction in Play

Iterative user-centred design has become a standard approach for developing interactive products. This process relies on prototyping and usertesting as early as possible to deliver a positive user experience and ensure that final products align with ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

3673 pages

ISBN:9781450359719

DOI:10.1145/3290607

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
304
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)3

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gutiérrez-Sánchez PGómez-Martín MGonzález-Calero PGómez-Martín P(2024)A Progress-Based Algorithm for Interpretable Reinforcement Learning in Regression TestingIEEE Transactions on Games10.1109/TG.2024.342660116:4(844-853)Online publication date: Dec-2024
https://doi.org/10.1109/TG.2024.3426601
Sestini AGisslén LBergdahl JTollmar KBagdanov A(2024)Automated Gameplay Testing and Validation With Curiosity-Conditioned Proximal TrajectoriesIEEE Transactions on Games10.1109/TG.2022.322691016:1(113-126)Online publication date: Mar-2024
https://doi.org/10.1109/TG.2022.3226910
Yadgaroff DSestini ATollmar KOzcelikkale AGisslén L(2024)Improving Generalization in Game Agents with Data Augmentation in Imitation Learning2024 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC60901.2024.10612178(1-8)Online publication date: 30-Jun-2024
https://doi.org/10.1109/CEC60901.2024.10612178
Lee SLaw MHoffman G(2024)When and How to Use AI in the Design Process? Implications for Human-AI Design CollaborationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2353451(1-16)Online publication date: 22-May-2024
https://doi.org/10.1080/10447318.2024.2353451
Fernandes PLopes MPrada R(2024)Data Driven Agents for User Experience TestingVideogame Sciences and Arts10.1007/978-3-031-51452-4_1(3-18)Online publication date: 3-Jan-2024
https://doi.org/10.1007/978-3-031-51452-4_1
Albaghajati AAhmed M(2023)Video Game Automated Testing Approaches: An Assessment FrameworkIEEE Transactions on Games10.1109/TG.2020.303279615:1(81-94)Online publication date: Mar-2023
https://doi.org/10.1109/TG.2020.3032796
Sestini ABergdahl JTollmar KBagdanov AGisslén L(2023)Towards Informed Design and Validation Assistance in Computer Games Using Imitation Learning2023 IEEE Conference on Games (CoG)10.1109/CoG57401.2023.10333234(1-8)Online publication date: 21-Aug-2023
https://doi.org/10.1109/CoG57401.2023.10333234
Gillberg JBergdahl JSestini AEakins AGisslén L(2023)Technical Challenges of Deploying Reinforcement Learning Agents for Game Testing in AAA Games2023 IEEE Conference on Games (CoG)10.1109/CoG57401.2023.10333194(1-8)Online publication date: 21-Aug-2023
https://doi.org/10.1109/CoG57401.2023.10333194
Ahlberg WSestini ATollmar KGisslén L(2023)Generating Personas for Games with Multimodal Adversarial Imitation Learning2023 IEEE Conference on Games (CoG)10.1109/CoG57401.2023.10333167(1-8)Online publication date: 21-Aug-2023
https://doi.org/10.1109/CoG57401.2023.10333167
Fisher J(2023)Centering the Human: Digital Humanism and the Practice of Using Generative AI in the Authoring of Interactive Digital NarrativesInteractive Storytelling10.1007/978-3-031-47655-6_5(73-88)Online publication date: 31-Oct-2023
https://doi.org/10.1007/978-3-031-47655-6_5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

PathOS+: A New Realm in Expert Evaluation

Charting the Uncharted with GUR: How AI Playtesting Can Supplement Expert Evaluation

Artificial Players in the Design Process: Developing an Automated Testing Tool for Game Level and World Design