See through them: a framework for inferring the cognitive states of puzzle game players via eye gaze
Authors: 
Hao He, Yingying She, Yu Jiang, 
Wei CaiAuthors Info & Claims
Pages 1 - 4
Abstract
In this paper, we investigate the potential of eye gaze modality in understanding the continuous cognitive states of the players when they are involved in an episode-based puzzle game and how this phenomenon can contribute insights to the game designers to achieve a better QoE of the game. We selected a puzzle game called "Machinarium" as the experimental interface to experiment. We collected the gaze data of the players and inferred their cognitive states in each intersection of decision-making from a game level. The inferred cognitive states were compared to the ground-truth experiences from the players via questionnaire and the official visual guidance extracted from the walkthrough of the game level. The results showed that the implemented framework could infer the cognitive states of the players in a guaranteed accuracy. Besides, the similarities and differences between the players' actual performance and the game level's visual guidance could be the feedback to impact the further optimization of the game design.
References
[1]
Thomas Bader and Jürgen Beyerer. 2013. Natural gaze behavior as input modality for human-computer interaction. In Eye Gaze in Intelligent User Interfaces. Springer, 161--183.
[2]
Elgiz Bal, Emily Harden, Damon Lamb, Amy Vaughan Van Hecke, John W Denver, and Stephen W Porges. 2010. Emotion recognition in children with autism spectrum disorders: Relations to eye gaze and autonomic state. Journal of autism and developmental disorders 40, 3 (2010), 358--370.
[3]
Miguel P Eckstein. 2011. Visual search: A retrospective. Journal of vision 11, 5 (2011), 14--14.
[4]
Gabriela Goldschmidt. 1992. Serial sketching: visual problem solving in designing. Cybernetics and System 23, 2 (1992), 191--219.
[5]
Kai Keat Lim, Max Friedrich, Jenni Radun, and Kristiina Jokinen. 2013. Lying through the eyes: detecting lies through eye movements. In Proceedings of the 6th workshop on Eye gaze in intelligent human machine interaction: gaze in multimodal interaction. 51--56.
[6]
Hilary Putnam. 2013. 17. The Nature of Mental States. In Readings in Philosophy of Psychology, Volume I. Harvard University Press, 223--231.
[7]
Sheikh Rivu, Yasmeen Abdrabou, Thomas Mayer, Ken Pfeuffer, and Florian Alt. 2019. GazeButton: enhancing buttons with eye gaze interactions. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. 1--7.
[8]
Mazen Salous, Felix Putze, Tanja Schultz, Jutta Hild, and Jürgen Beyerer. 2018. Investigating static and sequential models for intervention-free selection using multimodal data of EEG and eye tracking. In Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data. 1--6.
[9]
Kei Shimonishi. 2016. Modeling user's decision process through gaze behavior. In Proceedings of the 18th ACM International Conference on Multimodal Interaction. 536--540.
[10]
Mikhail Startsev, Ioannis Agtzidis, and Michael Dorr. 2018. 1D CNN with BLSTM for automated classification of fixations, saccades, and smooth pursuits. Behavior Research Methods (08 Nov 2018).
[11]
Katie Salen Tekinbas and Eric Zimmerman. 2003. Rules of play: Game design fundamentals. MIT press.
Index Terms
- See through them: a framework for inferring the cognitive states of puzzle game players via eye gaze
Recommendations
Defining grief play in MMORPGs: player and developer perceptions
ACE '04: Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technologyIn current literature, grief play in Massively Multi-player Online Role-Playing Games (MMORPGs) refers to play styles where a player intentionally disrupts the gaming experience of other players. In our study, we have discovered that player experiences ...
iGAME: Cognitive Game Analysis Through Eye Movements of the Player
Pattern Recognition and Machine IntelligenceAbstractThe main goal of this work is to use eye movement tracking in classifying players based on their gameplay data and analyze their experiences while playing Tic Tac Toe. We collected data by tracking eye gaze and mouse movement of 20 participants ...
I-dentity: concealing movement representation associations in games
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing SystemsThis paper details the design of i-dentity, a collaborative movement-based game where the game design deliberately conceals the players' associations to a digital representation. While movement-based digital games typically make it clear whose movement ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2022
34 pages
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 June 2022
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- Shenzhen Science and Technology Program
Conference
MMSys '22
Sponsor:
Acceptance Rates
Overall Acceptance Rate 4 of 7 submissions, 57%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 117Total Downloads
- Downloads (Last 12 months)14
- Downloads (Last 6 weeks)1
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in