Abstract
A serious game is an educational digital game created to entertain and achieve characterizing goal to promote learning. However, a serious game’s major challenge is capturing and sustaining player attention and motivation, thus restricting learning abilities. Adaptive frameworks in serious games (Adaptive serious games) tackle the challenge by automatically assisting players in balancing boredom and frustration. The current state-of-the-art in Adaptive serious games targets modeling a player’s cognitive states by considering eye-tracking characteristics like gaze, fixation, pupil diameter, or mouse tracking characteristics such as mouse positions. However, a combination of eye and mouse tracking characteristics has seldom been used. Hence, we present I-Mouse, a framework for predicting the need for player assistance in educational serious games through a combination of eye and mouse-tracking data. I-Mouse framework comprises four steps: (a) Feature generation for identifying cognitive states, (b) Partition clustering for player state modeling, (c) Data balancing of the clustered data, and (d) Classification to predict the need for assistance. We evaluate the framework using a real game data set to predict the need for assistance, and Random Forest is the best performing model with an accuracy of 99% amongst the trained classification models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
References
Antunes, J., Santana, P.: A study on the use of eye tracking to adapt gameplay and procedural content generation in first-person shooter games. Multimodal Technol. Interact. 2(2), 23 (2018)
Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: Smote: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (2002)
Eckstein, M.K., Guerra-Carrillo, B., Singley, A.T.M., Bunge, S.A.: Beyond eye gaze: What else can eye tracking reveal about cognition and cognitive development? Dev. Cogn. Neurosci. 25, 69–91 (2017)
Grimes, M., Valacich, J.: Mind over mouse: the effect of cognitive load on mouse movement behavior. In: Proceedings of Thirty Sixth International Conference on Information Systems (2015)
Khedher, A.B., Jraidi, I., Frasson, C.: Exploring students’ eye movements to assess learning performance in a serious game. In: Proceedings of EdMedia+ Innovate Learning, pp. 394–401. Association for the Advancement of Computing in Education (AACE) (2018)
Prusa, J., Khoshgoftaar, T.M., Dittman, D.J., Napolitano, A.: Using random undersampling to alleviate class imbalance on tweet sentiment data. In: Proceedings of IEEE International Conference on Information Reuse and Integration. pp. 197–202. IEEE (2015)
Ramirez-Cano, D., Colton, S., Baumgarten, R.: Player classification using a meta-clustering approach. In: Proceedings of 3rd Annual International Conference Computer Games, Multimedia & Allied Technology, pp. 297–304 (2010)
Rodden, K., Fu, X., Aula, A., Spiro, I.: Eye-mouse coordination patterns on web search results pages. In: Proceedings of CHI 2008 Extended Abstracts on Human Factors in Computing Systems, pp. 2997–3002. ACM (2008)
Stone, M.: Cross-validation: A review. Stat.: J. Theor. Appl. Stat. 9(1), 127–139 (1978)
Streicher, A., Leidig, S., Roller, W.: Eye-tracking for user attention evaluation in adaptive serious games. In: Pammer-Schindler, V., Pérez-Sanagustín, M., Drachsler, H., Elferink, R., Scheffel, M. (eds.) EC-TEL 2018. LNCS, vol. 11082, pp. 583–586. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-98572-5_50
Streicher, A., Smeddinck, J.D.: Personalized and adaptive serious games. In: Dörner, R., Göbel, S., Kickmeier-Rust, M., Masuch, M., Zweig, K. (eds.) Entertainment Computing and Serious Games. LNCS, vol. 9970, pp. 332–377. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46152-6_14
Van der Wel, P., Van Steenbergen, H.: Pupil dilation as an index of effort in cognitive control tasks: A review. Psychon. Bull. Rev. 25(6), 2005–2015 (2018)
Zhonggen, Y.: A meta-analysis of use of serious games in education over a decade. Int. J. Comput. Game. Technol. 2019 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Lalwani, R. et al. (2021). I-Mouse: A Framework for Player Assistance in Adaptive Serious Games. In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2021. Lecture Notes in Computer Science(), vol 12749. Springer, Cham. https://doi.org/10.1007/978-3-030-78270-2_42
Download citation
DOI: https://doi.org/10.1007/978-3-030-78270-2_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78269-6
Online ISBN: 978-3-030-78270-2
eBook Packages: Computer ScienceComputer Science (R0)