research-article

Doing While Thinking: Physical and Cognitive Engagement and Immersion in Mixed Reality Games

Authors:

Nabil Bin Hannan,

Derek ReillyAuthors Info & Claims

DIS '16: Proceedings of the 2016 ACM Conference on Designing Interactive Systems

Pages 947 - 958

https://doi.org/10.1145/2901790.2901864

Published: 04 June 2016 Publication History

Abstract

We present a study examining the impact of physical and cognitive challenge on reported immersion for a mixed reality game called Beach Pong. Contrary to prior findings for desktop games, we find significantly higher reported immersion among players who engage physically, regardless of their actual game performance. Building a mental map of the real, virtual, and sensed world is a cognitive challenge for novices, and this appears to influence immersion: in our study, participants who actively attended to both physical and virtual game elements reported higher immersion levels than those who attended mainly or exclusively to virtual elements. Without an integrated mental map, in-game cognitive challenges were ignored or offloaded to motor response when possible in order to achieve the minimum required goals of the game. From our results we propose a model of immersion in mixed reality gaming that is useful for designers and researchers in this space.

Supplementary Material

suppl.mov (pn0494-file3.mp4)

Supplemental video

Download
79.65 MB

References

[1]

Bruce H. Thomas. 2012. A survey of visual, mixed, and augmented reality gaming. Comput. Entertain. 10, 1, Article 3 (December 2012), 33 pages. http://doi.acm.org/10.1145/2381876.2381879

Digital Library

[2]

Craig, Alan B. 2013. Understanding augmented reality: Concepts and applications. Newnes.

Digital Library

[3]

Robb Lindgren and J. Michael Moshell. 2011. Supporting children's learning with body-based metaphors in a mixed reality environment. In Proceedings of the 10th International Conference on Interaction Design and Children (IDC'11), 177--180. http://doi.acm.org/10.1145/1999030.1999055.

Digital Library

[4]

Yinpeng Chen, Nicole Lehrer, Hari Sundaram, and Thanassis Rikakis. 2010. Adaptive mixed reality stroke rehabilitation: system architecture and evaluation metrics. In Proceedings of the first annual ACM SIGMM conference on Multimedia systems (MMSys'10), 293--304. http://doi.acm.org/10.1145/1730836.1730872

Digital Library

[5]

Csikszentmihalyi, M. 1990. Flow: The Psychology of Optimal Experience. New York: Harper and Row. ISBN 0-06-092043-2

[6]

McMahan. A. 2003. Immersion, engagement and presence, M. Wolf, B. Perron (Eds.), The Video Game Theory Reader, Routledge, 67--86.

[7]

Anna Cox, Paul Cairns, Pari Shah, and Michael Carroll. 2012. Not doing but thinking: the role of challenge in the gaming experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'12), 79--88. http://doi.acm.org/10.1145/2207676.2207689.

Digital Library

[8]

Young, J. A., & Pain, M. D. (1999). The zone: Evidence of a universal phenomenon for athletes across sports. Athletic Insight: the online journal of sport psychology, 1(3), 21--30.

[9]

Markus Montola. 2011. A ludological view on the pervasive mixed-reality game research paradigm. Personal Ubiquitous Comput. 15, 1 (January 2011), 312. http://dx.doi.org/10.1007/s00779-010-0307-7.

Digital Library

[10]

Ohshima, T., Satoh, K., Yamamoto, H., & Tamura, H. (1999). RV-Border Guards: A multi-player mixed reality entertainment. Trans. Virtual Reality Soc. Japan, 4(4), 699--705.

[11]

Adrian David Cheok, Kok Hwee Goh, Wei Liu, Farzam Farbiz, Siew Wan Fong, Sze Lee Teo, Yu Li, and Xubo Yang. 2004. Human Pacman: a mobile, wide-area entertainment system based on physical, social, and ubiquitous computing. Personal Ubiquitous Comput. 8, 2 (May 2004), 71--81. http://dx.doi.org/10.1007/s00779-004-0267-x.

Digital Library

[12]

Masayuki Takemura and Shungo Haraguchi. 2003. BLADESHIPS: An Interactive Attraction in Mixed Reality. In Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR'03), 356.

Digital Library

[13]

Pasch, M., Bianchi-Berthouze, N., van Dijk, B., & Nijholt, A. 2009. Movement-based sports video games: Investigating motivation and gaming experience. Entertainment Computing, 1(2), 49--61.

[14]

Yolanda Vazquez-Alvarez and Stephen A. Brewster. 2011. Eyes-free multitasking: the effect of cognitive load on mobile spatial audio interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11), 2173--2176. http://doi.acm.org/10.1145/1978942.1979258.

Digital Library

[15]

Bruce Thomas, Ben Close, John Donoghue, John Squires, Phillip De Bondi, and Wayne Piekarski. 2002. First Person Indoor/Outdoor Augmented Reality Application: ARQuake. Personal Ubiquitous Comput. 6, 1 (January 2002), 75--86. http://dx.doi.org/10.1007/s007790200007.

Digital Library

[16]

Benjamin Avery, Wayne Piekarski, James Warren, and Bruce H. Thomas. 2006. Evaluation of user satisfaction and learnability for outdoor augmented reality gaming. In Proceedings of the 7th Australasian User interface conference - Volume 50 (AUIC'06), Wayne Piekarski (Ed.), Vol. 50, 17--24.

Digital Library

[17]

Kreylos, O. 2014. Augmented Reality Sandbox. Retrieved from http://idav.ucdavis.edu/~okreylos/ResDev/SARndbox/

[18]

Endsley, M. R. (2000). Theoretical underpinnings of situation awareness: A critical review. Situation awareness analysis and measurement, 3--32.

[19]

Perry, Richard J., and John R. Hodges. 1999. Attention and executive deficits in Alzheimer's disease. 383--404

[20]

Eija Haapalainen, SeungJun Kim, Jodi F. Forlizzi, and Anind K. Dey. 2010. Psycho-physiological measures for assessing cognitive load. In Proceedings of the 12th ACM international conference on Ubiquitous computing (UbiComp'10), 301--310. http://doi.acm.org/10.1145/1864349.1864395

Digital Library

[21]

Roda, Claudia, ed. Human attention in digital environments. Cambridge University Press, 2011.

Digital Library

[22]

Can Liu, Stephane Huot, Jonathan Diehl, Wendy Mackay, and Michel Beaudouin-Lafon. 2012. Evaluating the benefits of real-time feedback in mobile augmented reality with hand-held devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'12), 2973--2976. http://doi.acm.org/10.1145/2207676.2208706.

Digital Library

[23]

Dix, A., Friday, A., Rodden, T., Koleva, B., Muller, H., Ranell, C. and Steed, A. Managing multiple spaces. In: Turner, Phil and Davenport, Elisabeth, (eds.) Spaces, Spatiality and Technology. Springer.

[24]

Chen, J. (2007). Flow in games (and everything else). Communications of the ACM, 50(4), 31--34.

Digital Library

[25]

Drpamelarutledge. "The Positive Side of Video Games: Part III". paper blog. Retrieved November 28, 2012 from http://www.pamelarutledge.com/2012/08/29/thepositive-side-of-video-games-part-iii/

[26]

Ravizza, Kenneth. 1984. Qualities of the peak experience in sport. Psychological foundations of sport. Champaign, IL: Human Kinetics, 452--462.

[27]

Loehr, James E. 1986. Mental toughness training for sports: Achieving athletic excellence. Penguin Books.

[28]

Garfield, Charles A., and Hal Zina Bennett. 1984. Peak performance: Mental training techniques of the world's greatest athletes. JP Tarcher, New York: Warner Bros.

[29]

Bianchi-Berthouze, N., Kim, W. and Patel D. 2007. "Does body movement engage you more in digital game play? And Why?." Affective Computing and Intelligent Interaction. Springer Berlin Heidelberg, 102--113.

Digital Library

[30]

Slater, M., McCarthy, J. and Maringelli, F. 1998. "The influence of body movement on subjective presence in virtual environments." Human Factors: The Journal of the Human Factors and Ergonomics Society 40.3: 469477.

[31]

Thin, A., Hansen L., and McEachen, D. 2011. "Flow experience and mood states while playing body movement-controlled video games." Games and culture 6,5: 414--42.

[32]

Pasch, M., Bianchi-Berthouze N., van Dikj B., and Nijholt A. 2009. "Immersion in movement-based interaction." Intelligent Technologies for Interactive Entertainment. Springer Berlin Heidelberg, 9:169--180.

[33]

Fox, Kenneth R. 1999. "The influence of physical activity on mental well-being." Public health nutrition 2.3: 411--418.

[34]

Kathrin Gerling, Ian Livingston, Lennart Nacke, and Regan Mandryk. 2012. Full-body motion-based game interaction for older adults. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'12), 1873--1882. http://doi.acm.org/10.1145/2207676.2208324.

Digital Library

[35]

Jennett, C., Cox, A., Cairns, P., Dhoparee, S., Epps, A., Tijs, T. and Walton, A. 2008. "Measuring and defining the experience of immersion in games." International journal of human-computer studies 66.9: 641--661.

Digital Library

[36]

Hu, G., Reilly, D., Gao, Q. and Bastos, A. 2015. "A Perceptual Depth Shape-based CRF Model for Deformable Surface Labeling." In Computer and Robot Vision (CRV), 184--191.

Digital Library

[37]

Chekhlov, D., Gee, A. P., Calway, A., Mayol-Cuevas, W. 2007. "Ninja on a plane: Automatic discovery of physical planes for augmented reality using visual slam". In Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, 1--4.

Digital Library

[38]

Brown, E., & Cairns, P. (2004, April). A grounded investigation of game immersion. In CHI'04 extended abstracts on Human factors in computing systems, 1297--1300.

Digital Library

[39]

Skalski, P., Tamborini, R, Shelton, A., Buncher, M, Lindmark, P. (2011) Mapping the road to fun: Natural video game controllers, presence, and game enjoyment. New Media & Society

[40]

Morrison, A., Mulloni, A., Lemmelä, S., Oulasvirta, A., Jacucci, G., Peltonen, P., Schmalstieg, D. and Regenbrecht, H., 2011. Collaborative use of mobile augmented reality with paper maps. Computers & Graphics, 35(4), pp.789--799.

Digital Library

[41]

Poels, K, deKort, Y, IJsselsteijn, W. (2007) "It is always a lot of fun!" - exploring dimensions of digital game experience using focus group methodology. FuturePlay 2007, 83--89.

Digital Library

Cited By

Somarathna RElvitigala DYan YQuigley AMohammadi G(2023)Exploring User Engagement in Immersive Virtual Reality Games through Multimodal Body MovementsProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615687(1-8)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615687
Peng XXie XHuang JJiang CWang HDenisova AChen HTian FWang H(2023)ChallengeDetect: Investigating the Potential of Detecting In-Game Challenge Experience from Physiological MeasuresProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581232(1-29)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581232
LaMont LFuller GParanthaman PPoteat TToprani DXu QBajaj N(2023)Towards Prototyping Single-modal and Multimodal Interactions in Mixed Reality GamesProceedings of Eighth International Congress on Information and Communication Technology10.1007/978-981-99-3091-3_54(655-666)Online publication date: 30-Jul-2023
https://doi.org/10.1007/978-981-99-3091-3_54
Show More Cited By

Index Terms

Doing While Thinking: Physical and Cognitive Engagement and Immersion in Mixed Reality Games
1. Human-centered computing

Recommendations

Save 'Em: physical gameplay using augmented reality techniques
Future Play '07: Proceedings of the 2007 conference on Future Play

We present Save 'Em, an augmented reality-based computer game designed to explore the challenge of making computer games more immersive and engaging by moving gameplay to the physical environment.

As in the classic computer game, Lemmings, Save 'Em is ...
Developing an augmented reality racing game
INTETAIN '08: Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINment

Augmented reality (AR) makes it possible to create games in which virtual objects are overlaid on the real world, and real objects are tracked and used to control virtual ones. We describe the development of an AR racing game created by modifying an ...
CarVR: Enabling In-Car Virtual Reality Entertainment
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Mobile virtual reality (VR) head-mounted displays (HMDs) allow users to experience highly immersive entertainment whilst being in a mobile scenario. Long commute times make casual gaming in public transports and cars a common occupation. However, VR ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '16: Proceedings of the 2016 ACM Conference on Designing Interactive Systems

June 2016

1374 pages

ISBN:9781450340311

DOI:10.1145/2901790

General Chair:
Marcus Foth
Queensland University of Technology
,
Program Chairs:
Wendy Ju
Stanford University
,
Ronald Schroeter
Queensland University of Technology
,
Stephen Viller
University of Queensland

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NCE GRAND

Conference

DIS '16

Sponsor:

SIGCHI

DIS '16: Designing Interactive Systems Conference 2016

June 4 - 8, 2016

QLD, Brisbane, Australia

Acceptance Rates

DIS '16 Paper Acceptance Rate 107 of 418 submissions, 26%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
552
Total Downloads

Downloads (Last 12 months)56
Downloads (Last 6 weeks)2

Reflects downloads up to 28 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Somarathna RElvitigala DYan YQuigley AMohammadi G(2023)Exploring User Engagement in Immersive Virtual Reality Games through Multimodal Body MovementsProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615687(1-8)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615687
Peng XXie XHuang JJiang CWang HDenisova AChen HTian FWang H(2023)ChallengeDetect: Investigating the Potential of Detecting In-Game Challenge Experience from Physiological MeasuresProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581232(1-29)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581232
LaMont LFuller GParanthaman PPoteat TToprani DXu QBajaj N(2023)Towards Prototyping Single-modal and Multimodal Interactions in Mixed Reality GamesProceedings of Eighth International Congress on Information and Communication Technology10.1007/978-981-99-3091-3_54(655-666)Online publication date: 30-Jul-2023
https://doi.org/10.1007/978-981-99-3091-3_54
Sinlapanuntakul WDerby JChaparro B(2022)Understanding the Effects of Mixed Reality on Video Game Satisfaction, Enjoyment, and PerformanceSimulation and Gaming10.1177/1046878122109447353:3(237-252)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1177/10468781221094473
Woźniak MSikorski PWróbel-Lachowska MBartłomiejczyk NDominiak JGrudzień KRomanowski A(2021)Enhancing In-game Immersion Using BCI-controlled MechanicsProceedings of the 27th ACM Symposium on Virtual Reality Software and Technology10.1145/3489849.3489862(1-6)Online publication date: 8-Dec-2021
https://dl.acm.org/doi/10.1145/3489849.3489862
Sung EBae SHan DKwon O(2021)Consumer engagement via interactive artificial intelligence and mixed realityInternational Journal of Information Management: The Journal for Information Professionals10.1016/j.ijinfomgt.2021.10238260:COnline publication date: 1-Oct-2021
https://dl.acm.org/doi/10.1016/j.ijinfomgt.2021.102382
Dolata MAgotai DSchubiger SSchwabe G(2020)Advisory Service Support that WorksProceedings of the ACM on Human-Computer Interaction10.1145/34151914:CSCW2(1-22)Online publication date: 15-Oct-2020
https://dl.acm.org/doi/10.1145/3415191
Franz JMalloch JReilly D(2020)Compensating for Perspective-based Distortion on Large Interactive Floor Displays: the SpaceHopper Field ExperimentProceedings of the 2020 ACM International Conference on Interactive Media Experiences10.1145/3391614.3393651(45-54)Online publication date: 17-Jun-2020
https://dl.acm.org/doi/10.1145/3391614.3393651
Peng XHuang JDenisova AChen HTian FWang HBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)A Palette of Deepened Emotions: Exploring Emotional Challenge in Virtual Reality GamesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376221(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376221
Coutu YChang YZhang WŞengün S(2020)The Relationship Between Cohesive Game Design and Player Immersion: A Case Study of Original Versus Reboot ThiefGame User Experience And Player-Centered Design10.1007/978-3-030-37643-7_15(349-359)Online publication date: 7-Apr-2020
https://doi.org/10.1007/978-3-030-37643-7_15
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents