Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3448018.3459654acmconferencesArticle/Chapter ViewAbstractPublication PagesetraConference Proceedingsconference-collections
short-paper

What the Eyes Can Tell: Analyzing Visual Attention with an Educational Video Game

Published: 25 May 2021 Publication History

Abstract

3D video games show potential as educational tools that improve learner engagement. Integrating 3D games into school curricula, however, faces various challenges. One challenge is providing visualizations on learning dashboards for instructors. Such dashboards provide needed information so that instructors may conduct timely and appropriate interventions when students need it. Another challenge is identifying contributive learning predictors for a computational model, which can be the core algorithm used to make games more intelligent for tutoring and assessment purposes. Previous studies have found that students' visual-attention is a vital aspect of engagement during gameplay. However, few studies have examined whether attention visualization patterns can distinguish students from different performance groups. Complicating this research is the relatively nascent investigation into gaze metrics for learning-prediction models. In this exploratory study, we used eye-tracking data from an educational game, Mission HydroSci, to examine visual-attention pattern differences between low and high performers and how their self-reported demographics affect such patterns. Results showed different visual-attention patterns between low and high performers. Additionally, self-reported science, gaming, and navigational expertise levels were significantly correlated to several gaze metric features.

References

[1]
Azita Iliya Abdul Jabbar and Patrick Felicia. 2015. Gameplay Engagement and Learning in Game-Based Learning: A Systematic Review. Review of Educational Research 85, 4 (December 2015), 740–779.
[2]
Samuel Almeida, Ana Veloso, Licínio Roque, and Óscar Mealha. 2011. The Eyes and Games: A Survey of Visual Attention and Eye Tracking Input in Video Games. (2011).
[3]
Michael Biggs, Ute Fischer, and Michael Nitsche. 2008. Supporting wayfinding through patterns within procedurally generated virtual environments. In Proceedings of the 2008 ACM SIGGRAPH symposium on Video games - Sandbox ’08, ACM Press, Los Angeles, California, 123.
[4]
Susan Bull, Neil Cooke, and Andrew Mabbott. 2007. Visual Attention in Open Learner Model Presentations: An Eye-Tracking Investigation. In User Modeling 2007, Cristina Conati, Kathleen McCoy and Georgios Paliouras (eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 177–186.
[5]
Cristina Conati, Natasha Jaques, and Mary Muir. 2013. Understanding Attention to Adaptive Hints in Educational Games: An Eye-Tracking Study. Int J Artif Intell Educ 23, 1–4 (November 2013), 136–161.
[6]
John R. Crawford, Paul H. Garthwaite, David C. Howell, and Colin D. Gray. 2004. Inferential methods for comparing a single case with a control sample: modified t‐tests versus mycroft ’s (2002) modified anova. Cognitive Neuropsychology 21, 7 (October 2004), 750–755.
[7]
Weihua Dong, Liangyu Zheng, Bing Liu, and Liqiu Meng. 2018. Using Eye Tracking to Explore Differences in Map-Based Spatial Ability between Geographers and Non-Geographers. IJGI 7, 9 (August 2018), 337.
[8]
Keri J. Duncan. 2020. Examining the Effects of Immersive Game-Based Learning on Student Engagement and the Development of Collaboration, Communication, Creativity and Critical Thinking. TechTrends 64, 3 (May 2020), 514–524.
[9]
C. W. Dunnett. 1964. New Tables for Multiple Comparisons with a Control. Biometrics 20, 3 (September 1964), 482.
[10]
Andrew Emerson, Elizabeth B. Cloude, Roger Azevedo, and James Lester. 2020. Multimodal learning analytics for game‐based learning. Br J Educ Technol 51, 5 (September 2020), 1505–1526.
[11]
Andy P. Field. 2005. Is the Meta-Analysis of Correlation Coefficients Accurate When Population Correlations Vary? Psychological Methods 10, 4 (December 2005), 444–467.
[12]
Andrew Gelman, Jennifer Hill, and Masanao Yajima. 2009. Why we (usually) don't have to worry about multiple comparisons. arXiv:0907.2478 [stat] (July 2009). Retrieved February 20, 2021 from http://arxiv.org/abs/0907.2478
[13]
Lisa R. Halverson and Charles R. Graham. 2019. Learner Engagement in Blended Learning Environments: A Conceptual Framework. OLJ 23, 2 (June 2019).
[14]
Michael D. Kickmeier-Rust, Eva Hillemann, and Dietrich Albert. 2011. Tracking the UFO's Paths: Using Eye-Tracking for the Evaluation of Serious Games. In Virtual and Mixed Reality - New Trends, Randall Shumaker (ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 315–324.
[15]
Tomasz D. Loboda and Peter Brusilovsky. 2010. User-adaptive explanatory program visualization: evaluation and insights from eye movements. User Model User-Adap Inter 20, 3 (August 2010), 191–226.
[16]
James M. Laffey, Troy D. Sadler, Sean P. Goggins, Joseph Griffin, and Ryan Nicholas Babiuch. 2016. Mission HydroSci: Distance Learning through Game-Based 3D Virtual Learning Environments. In Russell, D. & Laffey, J. (Eds.), Handbook of Research on Gaming Trends in P-12 Education. (2016), 421-441, Hershey, PA: IGI Global.
[17]
Moffat Mathews, Antonija Mitrovic, Bin Lin, Jay Holland, and Neville Churcher. 2012. Do Your Eyes Give It Away? Using Eye Tracking Data to Understand Students’ Attitudes towards Open Student Model Representations. In Intelligent Tutoring Systems, Stefano A. Cerri, William J. Clancey, Giorgos Papadourakis and Kitty Panourgia (eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 422–427.
[18]
Wookhee Min, Megan H. Frankosky, Bradford W. Mott, Jonathan P. Rowe, Andy Smith, Eric Wiebe, Kristy Elizabeth Boyer, and James C. Lester. 2020. DeepStealth: Game-Based Learning Stealth Assessment With Deep Neural Networks. IEEE Trans. Learning Technol. 13, 2 (April 2020), 312–325.
[19]
Dinna N. Mohd Nizam and Effie Lai-Chong Law. 2018. In the Eyes of Young Children: A Study on Focused Attention to Digital Educational Games.
[20]
Heather L. O'Brien and Elaine G. Toms. 2010. The development and evaluation of a survey to measure user engagement. J. Am. Soc. Inf. Sci. 61, 1 (January 2010), 50–69.
[21]
Thomas Reeves, William Romine, James Laffey, Troy Sadler, and Sean Goggins. 2020. Distance Learning Through Game-Based 3D Virtual Learning Environments: Mission HydroSci (External Evaluation Report 1). Athens, GA: University of Georgia. 
[22]
Beat A Schwendimann, Marıa Jesus Rodrıguez-Triana, Andrii Vozniuk, Luis P Prieto, Mina Shirvani Boroujeni, Adrian Holzer, Denis Gillet, and Pierre Dillenbourg. 2016. Understanding learning at a glance: An overview of learning dashboard studies. 2.
[23]
Gayane Sedrakyan, Erik Mannens, and Katrien Verbert. 2019. Guiding the choice of learning dashboard visualizations: Linking dashboard design and data visualization concepts. Journal of Computer Languages 50, (February 2019), 19–38.
[24]
Chen Si, Yusuf Pisan, Chek Tien Tan, and Songjia Shen. 2017. An initial understanding of how game users explore virtual environments. Entertainment Computing 19, (March 2017), 13–27.
[25]
Traci Sitzmann. 2011. A META-ANALYTIC EXAMINATION OF THE INSTRUCTIONAL EFFECTIVENESS OF COMPUTER-BASED SIMULATION GAMES. Personnel Psychology 64, 2 (June 2011), 489–528.
[26]
Alex Urban, Wenyi Lu, Hao He, and Joe Griffin. 2019. Education through navigation: Exploring wayfinding in Mission HydroSci. In Proceedings of CLS 2019. (2019) 172-179.
[27]
Jennifer J. Vogel, David S. Vogel, Jan Cannon-Bowers, Clint A. Bowers, Kathryn Muse, and Michelle Wright. 2006. Computer Gaming and Interactive Simulations for Learning: A Meta-Analysis. Journal of Educational Computing Research 34, 3 (April 2006), 229–243.
[28]
Eric N. Wiebe, Allison Lamb, Megan Hardy, and David Sharek. 2014. Measuring engagement in video game-based environments: Investigation of the User Engagement Scale. Computers in Human Behavior 32, (March 2014), 123–132.
[29]
National Research Council. 2013. Next Generation Science Standards: For states, by states. Washington, DC: The National Academies Press.

Cited By

View all
  • (2024)Towards Designing Digital Learning Tools for Students with Cortical/Cerebral Visual Impairments: Leveraging Insights from Teachers of the Visually ImpairedProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675636(1-18)Online publication date: 27-Oct-2024
  • (2024)Teaching Eye Tracking: Challenges and PerspectivesProceedings of the ACM on Human-Computer Interaction10.1145/36556118:ETRA(1-17)Online publication date: 28-May-2024
  • (2024)Effects of Gameplay Dynamics on Visual AttentionIEEE Access10.1109/ACCESS.2024.345475612(126961-126969)Online publication date: 2024

Index Terms

  1. What the Eyes Can Tell: Analyzing Visual Attention with an Educational Video Game
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ETRA '21 Short Papers: ACM Symposium on Eye Tracking Research and Applications
      May 2021
      232 pages
      ISBN:9781450383455
      DOI:10.1145/3448018
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 25 May 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Qualifiers

      • Short-paper
      • Research
      • Refereed limited

      Funding Sources

      • Investing in Innovation (i3) program (U411C140081)
      • the US Department of Education?s Institute of Education Sciences (R305A150364)

      Conference

      ETRA '21
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 69 of 137 submissions, 50%

      Upcoming Conference

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)35
      • Downloads (Last 6 weeks)10
      Reflects downloads up to 16 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Towards Designing Digital Learning Tools for Students with Cortical/Cerebral Visual Impairments: Leveraging Insights from Teachers of the Visually ImpairedProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675636(1-18)Online publication date: 27-Oct-2024
      • (2024)Teaching Eye Tracking: Challenges and PerspectivesProceedings of the ACM on Human-Computer Interaction10.1145/36556118:ETRA(1-17)Online publication date: 28-May-2024
      • (2024)Effects of Gameplay Dynamics on Visual AttentionIEEE Access10.1109/ACCESS.2024.345475612(126961-126969)Online publication date: 2024

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media