research-article

Towards gameplay analysis via gameplay metrics

Authors:

Anders Drachen,

Alessandro CanossaAuthors Info & Claims

MindTrek '09: Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era

Pages 202 - 209

https://doi.org/10.1145/1621841.1621878

Published: 30 September 2009 Publication History

Abstract

User-oriented research in the game industry is undergoing a change from relying on informal user-testing methods adapted directly from productivity software development to integrating modern approaches to usability- and user experience testing. Gameplay metrics analysis form one of these techniques, being based on instrumentation methods in HCI. Gameplay metrics are instrumentation data about the user behavior and user-game interaction, and can be collected during testing, production and the live period of the lifetime of a digital game. The use of instrumentation data is relatively new to commercial game development, and remains a relatively unexplored method of user research. In this paper, the focus is on utilizing game metrics for informing the analysis of gameplay during commercial game production as well as in research contexts. A series of case studies are presented, focusing on the major commercial game titles Kane & Lynch and Fragile Alliance.

References

[1]

Bateman, C., Boon, R.: 21st Century Game Design. Charles River Media (2005)

Digital Library

[2]

Blythe, M. A., Overbeeke, K., Monk, A. F. Wright, P. C.: Funology -- from usability to enjoyment. Springer (2004)

Digital Library

[3]

Börner, K., Penumarthy, S.: Social Diffusion Patterns in Three-Dimensional Virtual Worlds. Information Visualization, 2 (2003), 182--198

[4]

Chittaro, L.&Ieronutti, L.: A visual tool for tracing users' behavior in virtual environments. In Proc. Working Conference on Advanced Visual Interfaces (2004), 40--47

Digital Library

[5]

Chittaro L., Ranon R., Ieronutti L.: VU-Flow: A Visualization Tool for Analyzing Navigation in Virtual Environments. IEEE Transactions on Visualization and Computer Graphics, 12, 6 (2006), 1475--1485

Digital Library

[6]

Davis, J.; Steury, K., Pagulayan, R.: A survey method for assessing perceptions of a game: The consumer playtest in game design. Game Studies: The International Journal of Computer Game Research, 5 (2005)

[7]

De Kort, Y., Ijsselssteijn, W: People, places and play: Player experience in a socio-spatial context. ACM Computers in Entertainment 6, 2, article no. 18 (2007)

Digital Library

[8]

DeRosa, P.: Tracking Player Feedback to Improve Game Design. Gamasutra, Aug. 7 (2007)

[9]

Desurvire, H., Caplan, M., Toth, J. A.: Using heuristics to evaluate the playability of games. In CHI '04 extended abstracts on Human factors in computing systems (2004)

Digital Library

[10]

Dumas, J. S. 2003. User-Based Evaluations. In: The HCI handbook. Lawrence Erlbaum Associates (2003), 1093--1117

Digital Library

[11]

Gilleade, K. M., Dix, A.: Using frustration in the design of adaptive videogames. In: Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, Singapore (2004), 228--232

Digital Library

[12]

Goetz, P.: Too Many Clicks! Unit-Based Interfaces Considered Harmful. Gamasutra, August 23 (2006)

[13]

Hilbert, D. M. and Redish, J. C.: A practical guide to usability testing. Intellect books (1999)

Digital Library

[14]

Hoobler, N., Humphreys, G., Agrawala, M.: Visualizing Competitive Behaviors in Multi-User Virtual Environments. In Proc. of the IEEE Visualization Conference (2004), 163--170

Digital Library

[15]

Hurst, A., Hudson, S. E., Mankoff, J.: Dynamic detection of novice vs. skilled use without a task model. In Proceedings of CHI 2007, ACM press (2007), 271--280

Digital Library

[16]

Ijsselsteijn, W., de Kort, Y., Poels, K., Jugelionis, A., Bellotti, F.: Characterizing and Measuring User Experiences in Digital Games. In: Proceedings of ACE, Toronto, Ontario (2007)

[17]

Isbister, K., Schaffer, N.: Game Usability: Advancing the Player Experience. Morgan Kaufman (2008)

[18]

Jørgensen, A. H.: Marrying HCI/Usability and Computer Games: A Preliminary Look, Proceedings of NordiCHI, Tampere, Finland (2004)

Digital Library

[19]

Kim, J. H., Gunn, D. V., Schuh, E., Phillips, B. C., Pagulayan, R. J., Wixon, D.: Tracking Real-Time User Experience (TRUE): A comprehensive instrumentation solution for complex systems. In Proceedings of CHI 2008, Florence, Italy (2008), 443--451

Digital Library

[20]

Kort, J., Steen, M. G. D., de Poot, H., ter Hofte, H., Mulder, I.: Studying usage of complex applications. In: Proceedings of Measuring Behavior. Noldus IT (2005), 266--269

[21]

Kuniavsky, M.: Observing the User Experience: A Practitioner's Guide to User Research. Morgan Kaufman (2003).

Digital Library

[22]

Longley, P.; Goodchild, M. F., Macquire, D.&Rhind, D.: Geographic Information Systems and Science. Wiley&sons (2005).

[23]

Mandryk, R., Atkins, M. S., Inkpen, K.: A continuous and objective evaluation of emotional experience with interactive play environments. In: Proceedings of CHI (2006.

Digital Library

[24]

Medlock, M. C., Wixon, D., Terrano, M., Romero, R. L., Fulton, B.: Using the RITE method to improve products: A definition and a case study. In: Proceedings of UPA (2002)

[25]

Mellon, L.: Metrics in MMP Development and Operations. Presentation at the GDC, Los Angeles, USA (2004)

[26]

Nørgaard, M., Rau, J.: User Testing in the Combat Zone. In: Proceedings of ACE, Toronto, Ontario (2007)

[27]

Pagulayan, R. J., Keeker, K., Wixon, D., Romero, R. L., Fuller, T.: User-centered design in games. In: The HCI handbook. Lawrence Erlbaum Associates (2003), 883--906

Digital Library

[28]

Pagulayan, R. J., Steury, K. R., Fulton, B., Romero, R. L.: Designing for fun: user-testing case studies. In: Blythe, M. A., Overbeeke, K., Monk, A. F. Wright, P. C. (Eds.): Funology: From usability to enjoyment. Human-Computer Interaction series. Kluwer Academic Publishers (2005).

Digital Library

[29]

Renaud, K. and Gray, P.: Making sense of low-level usage data to understand user activities. In: Proceedings of SAICSIT 2004, ACM Press (2004), 115--124.

Digital Library

[30]

Rouse, R. Game Design: Theory and Practice. Wordware publishing Inc. (2001).

Digital Library

[31]

Schultz, C. P.: Game Testing All in One. PTR (2005)

[32]

Swain, C. 2008. Master Metrics: The Science Behind the Art of Game Design. Presentation at NLGD Conference, Utrecht, Holland (2008)

[33]

Thompson, C.: Halo 3: How Microsoft Labs Invented a New Science of Play. Wired Magazine 15, 9 (2007)

[34]

Trappl, R., Petta, P.: Creating Personalities for Synthetic Actors: Towards Autonomous Personality Agents. Springer Publishers, Berlin (1997)

Digital Library

[35]

Tychsen, A., Canossa, A.: Defining Personas in Games Using Metrics. In: proceedings of Future Play 2008, Toronto, Canada. ACM publishers (2008), 73--80

Digital Library

[36]

Williams, D.; Yee, N., Caplan, S. E.: Who plays, how much, and why? Debunking the stereotypical gamer profile. Journal of Computer-Mediated Communication 13 (2005), 993--1018

Cited By

Costa Kohwalter TGresta Paulino Murta LWalter Gonzalez Clua E(2025)Prov-DIFF: Play traces analysis through provenance differencesEntertainment Computing10.1016/j.entcom.2024.10077752(100777)Online publication date: Jan-2025
https://doi.org/10.1016/j.entcom.2024.100777
Sargolzaei PRastogi MZaman L(2024)Advancing Mixed Reality Game Development: An Evaluation of a Visual Game Analytics Tool in Action-Adventure and FPS GenresProceedings of the ACM on Human-Computer Interaction10.1145/36770558:CHI PLAY(1-32)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677055
Pfau JSeif El-Nasr M(2024)On Video Game Balancing: Joining Player- and Data-Driven AnalyticsGames: Research and Practice10.1145/36758072:3(1-30)Online publication date: 30-Aug-2024
https://dl.acm.org/doi/10.1145/3675807
Show More Cited By

Index Terms

Towards gameplay analysis via gameplay metrics

Recommendations

Analyzing user behavior via gameplay metrics
Future Play '09: Proceedings of the 2009 Conference on Future Play on @ GDC Canada

User-oriented research in the game industry is undergoing a change from relying on informal user-testing methods adapted directly from productivity software development to integrating modern approaches to usability- and user experience testing. Gameplay ...
Feedback-based gameplay metrics: measuring player experience via automatic visual analysis
IE '12: Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System

Using gameplay metrics to articulate player interaction within game systems has received increased interest in game studies. The value of gameplay metrics comes from a desire to empirically validate over a decade of theorization of player experience and ...
Capture and Analysis of Racing Gameplay Metrics

This article presents a flexible, extendable system called Tracktivity that can capture gameplay metrics in any type of leaderboard-based video game. This system incorporates novel visualizations, including a dynamic competition balancing (DCB) measure ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MindTrek '09: Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era

September 2009

254 pages

ISBN:9781605586335

DOI:10.1145/1621841

Conference Chairs:
Artur Lugmayr
Tampere University of Technology, Finland
,
Heljä Franssila
University of Tampere, Finland
,
Olli Sotamaa
University of Tampere, Finland
,
Pertti Näränen
Tampere University of Applied Sciences, Finland
,
Jukka Vanhala
Tampere University of Technology, Finland
,
Editors:
Artur Lugmayr,
Heljä Franssila,
Olli Sotamaa,
Pertti Näränen,
Jukka Vanhala

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 September 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MindTrek '09

Sponsor:

MindTrek '09: Academic MindTrek 2009

September 30 - October 2, 2009

Tampere, Finland

Acceptance Rates

Overall Acceptance Rate 110 of 207 submissions, 53%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

65
Total Citations
View Citations
1,546
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)4

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Costa Kohwalter TGresta Paulino Murta LWalter Gonzalez Clua E(2025)Prov-DIFF: Play traces analysis through provenance differencesEntertainment Computing10.1016/j.entcom.2024.10077752(100777)Online publication date: Jan-2025
https://doi.org/10.1016/j.entcom.2024.100777
Sargolzaei PRastogi MZaman L(2024)Advancing Mixed Reality Game Development: An Evaluation of a Visual Game Analytics Tool in Action-Adventure and FPS GenresProceedings of the ACM on Human-Computer Interaction10.1145/36770558:CHI PLAY(1-32)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677055
Pfau JSeif El-Nasr M(2024)On Video Game Balancing: Joining Player- and Data-Driven AnalyticsGames: Research and Practice10.1145/36758072:3(1-30)Online publication date: 30-Aug-2024
https://dl.acm.org/doi/10.1145/3675807
Maram SKleinman EVillareale JZhu JSeif El-Nasr M(2024)"Ah! I see" - Facilitating Process Reflection in Gameplay through a Novel Spatio-Temporal Visualization SystemProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642484(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642484
Pfau J(2024)The Real MVP: Quantifying Individual Performances in Multiplayer Online Games2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645665(1-8)Online publication date: 5-Aug-2024
https://doi.org/10.1109/CoG60054.2024.10645665
Morard SPaukovics ESanchez E(2024)Understanding Player Experience in Museum-Based Learning Games: A Mixed-Methods AnalysisSerious Games10.1007/978-3-031-74138-8_14(177-195)Online publication date: 7-Nov-2024
https://dl.acm.org/doi/10.1007/978-3-031-74138-8_14
Balcerzak AŁączyński MHufschmitt AGackowski T(2024)Real-Time Gameplay Data and Biometric Measurement Integration as a Data Source for Game User ResearchDigital Interaction and Machine Intelligence10.1007/978-3-031-66594-3_15(144-156)Online publication date: 15-Aug-2024
https://doi.org/10.1007/978-3-031-66594-3_15
Arias JMarczak RDesainte-Catherine M(2024)Timed Automata for Video Games and InteractionEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_298(1879-1886)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_298
Pfau JSeif El-Nasr M(2023)Balancing Video Games: A Player-Driven InstrumentCompanion Proceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3573382.3616097(187-195)Online publication date: 6-Oct-2023
https://dl.acm.org/doi/10.1145/3573382.3616097
Vishwanath G(2023)Enhancing Engagement through Digital Cultural Heritage: A Case Study about Senior Citizens using a Virtual Reality MuseumProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596154(150-156)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596154
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents