research-article

Comparing Measures of Perceived Challenge and Demand in Video Games: Exploring the Conceptual Dimensions of CORGIS and VGDS

Authors:

Alena Denisova,

Nick BowmanAuthors Info & Claims

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 571, Pages 1 - 19

https://doi.org/10.1145/3544548.3581409

Published: 19 April 2023 Publication History

Abstract

Measuring perceived challenge and demand in video games is crucial as these player experiences are essential to creating enjoyable games. Two recent measures that identified seemingly distinct structures of challenge (Challenge Originating from Recent Gameplay Interaction Scale (CORGIS) - cognitive, emotional, performative, decision-making) and demand (Video Game Demand Scale (VGDS) - cognitive, emotional, controller, exertional, social) have been theorised to overlap, reflecting the five-factor demand structure. To investigate the overlap between these two scales we compared a five (complete overlap) and nine-factor (no overlap) model by surveying 1,101 players asking them to recall their last gaming experience before completing CORGIS and VGDS. After failing to confirm both models, we conducted an exploratory factor analysis. Our findings reveal seven dimensions, where the five-factor VGDS model holds alongside two additional CORGIS dimensions of performative and decision-making, ultimately providing a more holistic understanding of the concepts whilst highlighting unique aspects of each approach.

Supplementary Material

MP4 File (3544548.3581409-talk-video.mp4)

Pre-recorded Video Presentation

Download
15.23 MB

References

[1]

Espen J Aarseth. 1997. Cybertext: Perspectives on ergodic literature. JHU Press.

Digital Library

[2]

Ernest Adams. 2014. Fundamentals of game design. Pearson Education.

[3]

Julia Ayumi Bopp, Klaus Opwis, and Elisa D Mekler. 2018. “An Odd Kind of Pleasure” Differentiating Emotional Challenge in Digital Games. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–12.

Digital Library

[4]

Nicholas David Bowman. 2018. The demanding nature of video game play. In Video Games. Routledge, 1–24.

[5]

Nicholas David Bowman. 2019. Video games as demanding technologies. Media and Communication 7, 4 (2019), 144–148.

[6]

Nicholas David Bowman and Jaime Banks. 2020. Extending Gaming Demand: Subjective Experiences of Cognitive, Emotional, Physical, and Social Videogaming Requirements. AoIR Selected Papers of Internet Research(2020).

[7]

Nicholas David Bowman and Alan K Goodboy. 2020. Evolving considerations and empirical approaches to construct validity in communication science. Annals of the International Communication Association 44, 3(2020), 219–234.

[8]

Nicholas David Bowman, Jih-Hsuan Tammy Lin, and Kevin Koban. 2021. Demanding on many dimensions: Validating the interactivity-as-demand measurement model for VR-based video games. (2021).

[9]

Nicholas David Bowman, Jihhsuan Tammy Lin, and Chieh Wu. 2021. A chinese-language validation of the video game demand scale (vgds-c) measuring the cognitive, emotional, physical, and social demands of video games. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–10.

Digital Library

[10]

Nicholas D Bowman and Ron Tamborini. 2015. “In the Mood to Game”: Selective exposure and mood management processes in computer game play. New Media & Society 17, 3 (2015), 375–393.

[11]

Nicholas David Bowman, Joseph Wasserman, and Jaime Banks. 2018. Development of the video game demand scale. In Video Games. Routledge, 208–233.

[12]

Erik P Bucy. 2004. Interactivity in society: Locating an elusive concept. The information society 20, 5 (2004), 373–383.

[13]

Paul Cairns. 2019. Doing better statistics in human-computer interaction. Cambridge University Press.

[14]

Jenova Chen. 2007. Flow in games (and everything else). Commun. ACM 50, 4 (2007), 31–34.

Digital Library

[15]

Tom Cole, Paul Cairns, and Marco Gillies. 2015. Emotional and functional challenge in core and avant-garde games. In Proceedings of the 2015 annual symposium on computer-human interaction in play. 121–126.

Digital Library

[16]

Christine L Cook. 2019. Between a troll and a hard place: The demand framework’s answer to one of gaming’s biggest problems. Media and Communication 7, 4 (2019), 176–185.

[17]

Anna B Costello and Jason Osborne. 2005. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical assessment, research, and evaluation 10, 1(2005), 7.

[18]

Mihaly Csikszentmihalyi and Mihaly Csikzentmihaly. 1990. Flow: The psychology of optimal experience. Vol. 1990. Harper & Row New York.

[19]

Yvonne AW De Kort, Wijnand A IJsselsteijn, and Karolien Poels. 2007. Digital games as social presence technology: Development of the Social Presence in Gaming Questionnaire (SPGQ). Proceedings of PRESENCE 195203 (2007), 1–9.

[20]

Alena Denisova, Paul Cairns, Christian Guckelsberger, and David Zendle. 2020. Measuring perceived challenge in digital games: Development & validation of the challenge originating from recent gameplay interaction scale (CORGIS). International Journal of Human-Computer Studies 137 (2020), 102383.

Digital Library

[21]

Alena Denisova, Christian Guckelsberger, and David Zendle. 2017. Challenge in digital games: towards developing a measurement tool. In Proceedings of the 2017 chi conference extended abstracts on human factors in computing systems. 2511–2519.

Digital Library

[22]

James Paul Gee. 2004. Learning by design: Games as learning machines. Interactive educational multimedia: IEM(2004), 15–23.

[23]

Alan K Goodboy and Rex B Kline. 2017. Statistical and practical concerns with published communication research featuring structural equation modeling. Communication Research Reports 34, 1 (2017), 68–77.

[24]

Donna J Haraway. 1991. A Cyborg Manifesto: An ironic dream of a common language for women in the integrated circuit. In The Transgender Studies Reader Remix. Routledge, 429–443.

[25]

Andrew F Hayes and Jacob J Coutts. 2020. Use omega rather than Cronbach’s alpha for estimating reliability. But…. Communication Methods and Measures 14, 1 (2020), 1–24.

[26]

Joseph Henrich, Steven J Heine, and Ara Norenzayan. 2010. Most people are not WEIRD. Nature 466, 7302 (2010), 29–29.

[27]

Robin K Henson and J Kyle Roberts. 2006. Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological measurement 66, 3 (2006), 393–416.

[28]

Sarah E Hodge, Jacqui Taylor, and John McAlaney. 2020. (A) morally Demanding Game? An Exploration of Moral Decision-Making in a Purpose-Made Video Game. Media and Communication 7, 4 (2020), 213–225.

[29]

Elisabeth Holl, Steve Bernard, and André Melzer. 2020. Moral decision-making in video games: A focus group study on player perceptions. Human behavior and emerging technologies 2, 3 (2020), 278–287.

[30]

Kasper Hornbæk, Søren S Sander, Javier Andrés Bargas-Avila, and Jakob Grue Simonsen. 2014. Is once enough? On the extent and content of replications in human-computer interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3523–3532.

Digital Library

[31]

Matt C Howard. 2016. A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve?International Journal of Human-Computer Interaction 32, 1(2016), 51–62.

[32]

Matthew Hudson and Paul Cairns. 2014. Measuring social presence in team-based digital games. Interacting with Presence: HCI and the Sense of Presence in Computer-mediated Environments 83(2014).

[33]

Sara Mosberg Iversen. 2012. In the double grip of the game: Challenge and Fallout 3. Game Studies 12, 2 (2012).

[34]

Jesper Juul. 2005. Half-real. Video games between real rules and fictional worlds (2005).

Digital Library

[35]

Veli-Matti Karhulahti 2015. Adventures of Ludom: A videogame geneontology. (2015).

[36]

Kevin Koban and Nicholas D Bowman. 2020. Further validation and cross-cultural replication of the video game demand scale. Journal of Media Psychology(2020).

[37]

Lori Landay. 2014. Interactivity. In The Routledge companion to video game studies, Mark JP Wolf and Bernard Perron (Eds.). Routledge, 173–184.

[38]

Nicole Lazzaro. 2004. Why we play games: 4 keys to more emotion. In Proc. Game Developers Conference 2004.

[39]

Jih-Hsuan Tammy Lin, Dai-Yun Wu, and Nicholas Bowman. 2022. Beat Saber as Virtual Reality Exercising in 360 Degrees: A Moderated Mediation Model of VR Playable Angles on Physiological and Psychological Outcomes. Media Psychology 0, 0 (2022), 1–22.

[40]

Sebastian Linxen, Christian Sturm, Florian Brühlmann, Vincent Cassau, Klaus Opwis, and Katharina Reinecke. 2021. How WEIRD is CHI?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 143, 14 pages. https://doi.org/10.1145/3411764.3445488

Digital Library

[41]

J Derek Lomas, Kenneth Koedinger, Nirmal Patel, Sharan Shodhan, Nikhil Poonwala, and Jodi L Forlizzi. 2017. Is difficulty overrated? The effects of choice, novelty and suspense on intrinsic motivation in educational games. In Proceedings of the 2017 CHI conference on human factors in computing systems. 1028–1039.

Digital Library

[42]

Thomas Malone. 1981. What makes computer games fun?. In Proceedings of the Joint Conference on Easier and More Productive Use of Computer Systems.(Part-II): Human Interface and the User Interface-Volume 1981. 143.

Digital Library

[43]

Marcus Maloney, Steven Roberts, and Timothy Graham. 2019. Masculine Discourses in r/gaming. In Gender, Masculinity and Video Gaming. Springer, 59–72.

[44]

Samuele M Marcora, Walter Staiano, and Victoria Manning. 2009. Mental fatigue impairs physical performance in humans. Journal of applied physiology(2009).

[45]

Mariola Moeyaert, Kelly Wauters, Piet Desmet, and Wim Van den Noortgate. 2016. When easy becomes boring and difficult becomes frustrating: disentangling the effects of item difficulty level and person proficiency on learning and motivation. Systems 4, 1 (2016), 14.

[46]

Paraschos Moschovitis and Alena Denisova. 2022. Keep Calm and Aim for the Head: Biofeedback-Controlled Dynamic Difficulty Adjustment in a Horror Game. IEEE Transactions on Games(2022).

[47]

Mary Beth Oliver, Nicholas David Bowman, Julia K Woolley, Ryan Rogers, Brett I Sherrick, and Mun-Young Chung. 2016. Video games as meaningful entertainment experiences.Psychology of popular media culture 5, 4 (2016), 390.

[48]

Hee Sun Park, René Dailey, and Daisy Lemus. 2002. The use of exploratory factor analysis and principal components analysis in communication research. Human Communication Research 28, 4 (2002), 562–577.

[49]

Zenon Pylyshyn. 1999. Is vision continuous with cognition?: The case for cognitive impenetrability of visual perception. Behavioral and brain sciences 22, 3 (1999), 341–365.

[50]

Yves Rosseel. 2012. lavaan: An R package for structural equation modeling. Journal of statistical software 48 (2012), 1–36.

[51]

John L Sherry. 2004. Flow and media enjoyment. Communication theory 14, 4 (2004), 328–347.

[52]

Jonathan Steuer. 1992. Defining virtual reality: Dimensions determining telepresence. Journal of communication 42, 4 (1992), 73–93.

[53]

Jennifer Stromer-Galley. 2004. Interactivity-as-product and interactivity-as-process. The Information Society 20, 5 (2004), 391–394.

[54]

S Shyam Sundar. 2004. Theorizing interactivity’s effects. The information society 20, 5 (2004), 385–389.

[55]

Jukka Vahlo and Veli-Matti Karhulahti. 2020. Challenge types in gaming validation of video game challenge inventory (CHA). International Journal of Human-Computer Studies 143 (2020), 102473.

[56]

Joachim Vandekerckhove, Dora Matzke, and Eric-Jan Wagenmakers. 2015. Model comparison and the principle. The Oxford handbook of computational and mathematical psychology 300 (2015).

[57]

Peter Vorderer, Tilo Hartmann, and Christoph Klimmt. 2003. Explaining the enjoyment of playing video games: the role of competition. In Proceedings of the second international conference on Entertainment computing. 1–9.

Digital Library

[58]

Michael Wellenreiter. 2015. Screenwriting and authorial control in narrative video games. Journal of Screenwriting 6, 3 (2015), 343–361.

[59]

Max L Wilson, Wendy Mackay, Ed Chi, Michael Bernstein, Dan Russell, and Harold Thimbleby. 2011. RepliCHI-CHI should be replicating and validating results more: discuss. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. 463–466.

Digital Library

[60]

Nannan Xi, Juan Chen, Filipe Gama, Marc Riar, and Juho Hamari. 2022. The challenges of entering the metaverse: An experiment on the effect of extended reality on workload. Information Systems Frontiers(2022), 1–22.

Cited By

Domingues JFilipe VCarita ACarvalho V(2024)Understanding the Impact of Perceived Challenge on Narrative Immersion in Video Games: The Role-Playing Game Genre as a Case StudyInformation10.3390/info1506029415:6(294)Online publication date: 22-May-2024
https://doi.org/10.3390/info15060294
Pretty EMartins Guarese RFayek HZambetta F(2024)Comparing Subjective Measures of Workload in Video Game Play: Evaluating the Test-Retest Reliability of the VGDS and NASA-TLXCompanion Proceedings of the 26th International Conference on Multimodal Interaction10.1145/3686215.3690151(56-60)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3686215.3690151
Gonçalves DBarros DPais PGuerreiro JGuerreiro TRodrigues A(2024)The Trick is to Stay Behind?: Defining and Exploring the Design Space of Player Balancing MechanicsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642441(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642441
Show More Cited By

Index Terms

Comparing Measures of Perceived Challenge and Demand in Video Games: Exploring the Conceptual Dimensions of CORGIS and VGDS
1. Applied computing
  1. Computers in other domains
    1. Personal computers and PC applications
      1. Computer games
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. HCI design and evaluation methods
      1. User studies

Recommendations

A Chinese-Language Validation of the Video Game Demand Scale (VGDS-C): Measuring the Cognitive, Emotional, Physical, and Social Demands of Video Games
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Video games are engaging multimedia experiences that require players’ cognitive, emotional, physical (in terms of controllers and exertion), and social faculties. Recent theorizing has suggested that these dimensions of demand can explain processes by ...
The interplay between immersion and appeal in video games

A 2í 2 study on immersion and appeal of video games is presented.Immersion and appeal are found to be highly related.Immersion is found to be unaffected by playing experience.Appeal is found to be affected both by game played and playing experience. ...
The effect of multiplayer dynamic difficulty adjustment on the player experience of video games
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Multiplayer Dynamic Difficulty Adjustment (mDDA) is a method of reducing the difference in player performance and subsequent challenge in competitive multiplayer video games. As a balance of between player skill and challenge experienced is necessary ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

14911 pages

ISBN:9781450394215

DOI:10.1145/3544548

Editors:
Albrecht Schmidt
LMU Munich, Germany60028717
,
Kaisa Väänänen
Tampere University, Finland60011170
,
Tesh Goyal
Google Research, USA60006191
,
Per Ola Kristensson
University of Cambridge, UK60031101
,
Anicia Peters
University of Namibia, Namibia60072704
,
Stefanie Mueller
Massachusetts Institute of Technology, USA60022195
,
Julie R. Williamson
University of Glasgow, UK60001490
,
Max L. Wilson
University of Nottingham, UK60015138

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
553
Total Downloads

Downloads (Last 12 months)375
Downloads (Last 6 weeks)30

Reflects downloads up to 28 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Domingues JFilipe VCarita ACarvalho V(2024)Understanding the Impact of Perceived Challenge on Narrative Immersion in Video Games: The Role-Playing Game Genre as a Case StudyInformation10.3390/info1506029415:6(294)Online publication date: 22-May-2024
https://doi.org/10.3390/info15060294
Pretty EMartins Guarese RFayek HZambetta F(2024)Comparing Subjective Measures of Workload in Video Game Play: Evaluating the Test-Retest Reliability of the VGDS and NASA-TLXCompanion Proceedings of the 26th International Conference on Multimodal Interaction10.1145/3686215.3690151(56-60)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3686215.3690151
Gonçalves DBarros DPais PGuerreiro JGuerreiro TRodrigues A(2024)The Trick is to Stay Behind?: Defining and Exploring the Design Space of Player Balancing MechanicsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642441(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642441
Lee HLee YBowman NYao SChen S(2023)Gaming on the Go? Translation and Validation of the Video Game Demand Scale to KoreanInternational Journal of Human–Computer Interaction10.1080/10447318.2023.226098040:22(6984-6995)Online publication date: 27-Sep-2023
https://doi.org/10.1080/10447318.2023.2260980

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents