Hand Me This: Exploring the Effects of Gaze-driven Animations and Hand Representations in Users’ Sense of Presence and Embodiment
Article No.: 59, Pages 1 - 7
Abstract
"What you see is what you get" is a concept in eye gaze interaction of selecting only with your eye. Technologies such as Virtual and Augmented Reality (VR/AR) often exclude people with limited mobility due to their dependence on controllers or hand movement. Meanwhile, embodiment focuses on a one-to-one mapping of the body & hands. However, previous work did not connect embodiment and accessibility with the aid of eye-gaze interaction. In this project, we explore how different gaze-controlled hand representations and animations affect users’ reported presence and embodiment that current technology lacks and can be crucially important, in virtual environments. Our data showed significant differences in presence and self-location(embodiment), especially when comparing Dwell and Snap animations.
References
[1]
Rawan Alghofaili, Yasuhito Sawahata, Haikun Huang, Hsueh-Cheng Wang, Takaaki Shiratori, and Lap-Fai Yu. 2019. Lost in Style: Gaze-driven Adaptive Aid for VR Navigation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300578
[2]
Ferran Argelaguet, Ludovic Hoyet, Michael Trico, and Anatole Lecuyer. 2016. The role of interaction in virtual embodiment: Effects of the virtual hand representation. In 2016 IEEE Virtual Reality (VR). 3–10. https://doi.org/10.1109/VR.2016.7504682
[3]
Frank Biocca. 1997. The Cyborg’s Dilemma: Progressive Embodiment in Virtual Environments [1]. Journal of Computer-Mediated Communication 3, 2 (09 1997), JCMC324. https://doi.org/10.1111/j.1083-6101.1997.tb00070.x
[4]
Olaf Blanke and Thomas Metzinger. 2009. Full-body illusions and minimal phenomenal selfhood. Trends in Cognitive Sciences 13, 1 (2009), 7–13. https://doi.org/10.1016/j.tics.2008.10.003
[5]
David Borland. 2013. Integrating head and full-body tracking for embodiment in virtual characters. In 2013 IEEE Virtual Reality (VR). 81–82. https://doi.org/10.1109/VR.2013.6549373
[6]
Matthew Botvinick and Jonathan Cohen. 1998. Rubber hands ‘feel’touch that eyes see. Nature 391, 6669 (1998), 756–756.
[7]
Frédérique de Vignemont. 2011. Embodiment, ownership and disownership. Consciousness and Cognition 20, 1 (2011), 82–93. https://doi.org/10.1016/j.concog.2010.09.004 Brain and Self: Bridging the Gap.
[8]
Heiko Drewes, Alexander De Luca, and Albrecht Schmidt. 2007. Eye-gaze interaction for mobile phones. In Proceedings of the 4th International Conference on Mobile Technology, Applications, and Systems and the 1st International Symposium on Computer Human Interaction in Mobile Technology (Singapore) (Mobility ’07). Association for Computing Machinery, New York, NY, USA, 364–371. https://doi.org/10.1145/1378063.1378122
[9]
Augusto Esteves, Eduardo Velloso, Andreas Bulling, and Hans Gellersen. 2015. Orbits: Gaze Interaction for Smart Watches using Smooth Pursuit Eye Movements. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 457–466. https://doi.org/10.1145/2807442.2807499
[10]
Augusto Esteves, David Verweij, Liza Suraiya, Rasel Islam, Youryang Lee, and Ian Oakley. 2017. SmoothMoves: Smooth Pursuits Head Movements for Augmented Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 167–178. https://doi.org/10.1145/3126594.3126616
[11]
Chris Heinrich, Matthew Cook, Tobias Langlotz, and Holger Regenbrecht. 2021. My hands? Importance of personalised virtual hands in a neurorehabilitation scenario. Virtual Reality 25 (2021), 313–330. https://doi.org/10.1007/s10055-020-00456-4
[12]
Seung-A Annie Jin and Namkee Park. 2009. Parasocial Interaction with My Avatar: Effects of Interdependent Self-Construal and the Mediating Role of Self-Presence in an Avatar-Based Console Game, Wii. CyberPsychology & Behavior 12, 6 (2009), 723–727. https://doi.org/10.1089/cpb.2008.0289 19522682.
[13]
Sungchul Jung, Gerd Bruder, Pamela J. Wisniewski, Christian Sandor, and Charles E. Hughes. 2018. Over My Hand: Using a Personalized Hand in VR to Improve Object Size Estimation, Body Ownership, and Presence. In Proceedings of the 2018 ACM Symposium on Spatial User Interaction (Berlin, Germany) (SUI ’18). Association for Computing Machinery, New York, NY, USA, 60–68. https://doi.org/10.1145/3267782.3267920
[14]
Andreas Kalckert and H. Henrik Ehrsson. 2014. The moving rubber hand illusion revisited: Comparing movements and visuotactile stimulation to induce illusory ownership. Consciousness and Cognition 26 (2014), 117–132. https://doi.org/10.1016/j.concog.2014.02.003
[15]
Konstantina Kilteni, Raphaela Groten, and Mel Slater. 2012. The Sense of Embodiment in Virtual Reality. Presence: Teleoperators and Virtual Environments 21, 4 (11 2012), 373–387. https://doi.org/10.1162/PRES_a_00124 arXiv:https://direct.mit.edu/pvar/article-pdf/21/4/373/1625283/pres_a_00124.pdf
[16]
Claudia Krogmeier and Christos Mousas. 2020. Eye fixations and electrodermal activity during low-budget virtual reality embodiment. Computer Animation and Virtual Worlds 31, 4-5 (2020), e1941. https://doi.org/10.1002/cav.1941
[17]
Claudia Krogmeier and Christos Mousas. 2021. Evidence for a Relationship Between Self-Avatar Fixations and Perceived Avatar Similarity within Low-Cost Virtual Reality Embodiment. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 127–134. https://doi.org/10.1109/VRW52623.2021.00031
[18]
Kwan Min Lee. 2006. Presence, Explicated. Communication Theory 14, 1 (01 2006), 27–50. https://doi.org/10.1111/j.1468-2885.2004.tb00302.x arXiv:https://academic.oup.com/ct/article-pdf/14/1/27/22294490/jcomthe0027.pdf
[19]
Michael Meehan, Brent Insko, Mary Whitton, and Frederick P Brooks Jr. 2002. Physiological measures of presence in stressful virtual environments. Acm transactions on graphics (tog) 21, 3 (2002), 645–652.
[20]
Martez Mott, John Tang, Shaun Kane, Edward Cutrell, and Meredith Ringel Morris. 2020. “I just went into it assuming that I wouldn’t be able to have the full experience”: Understanding the Accessibility of Virtual Reality for People with Limited Mobility. In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (, Virtual Event, Greece, ) (ASSETS ’20). Association for Computing Machinery, New York, NY, USA, Article 43, 13 pages. https://doi.org/10.1145/3373625.3416998
[21]
Nami Ogawa, Takuji Narumi, and Michitaka Hirose. 2019. Virtual Hand Realism Affects Object Size Perception in Body-Based Scaling. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 519–528. https://doi.org/10.1109/VR.2019.8798040
[22]
Valeria I Petkova and H Henrik Ehrsson. 2008. If I were you: perceptual illusion of body swapping. PloS one 3, 12 (2008), e3832.
[23]
Valeria I Petkova and H Henrik Ehrsson. 2009. When right feels left: referral of touch and ownership between the hands. PloS one 4, 9 (2009), e6933. https://doi.org/10.1371/journal.pone.0006933
[24]
Ken Pfeuffer, Benedikt Mayer, Diako Mardanbegi, and Hans Gellersen. 2017. Gaze + pinch interaction in virtual reality. In Proceedings of the 5th Symposium on Spatial User Interaction (Brighton, United Kingdom) (SUI ’17). Association for Computing Machinery, New York, NY, USA, 99–108. https://doi.org/10.1145/3131277.3132180
[25]
Aniruddha Prithul, Jiwan Bhandari, Walker Spurgeon, and Eelke Folmer. 2022. Evaluation of Hands-free Teleportation in VR. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction(SUI ’22). Association for Computing Machinery, New York, NY, USA, Article 5, 6 pages. https://doi.org/10.1145/3565970.3567683
[26]
Yuan Yuan Qian and Robert J. Teather. 2017. The eyes don’t have it: an empirical comparison of head-based and eye-based selection in virtual reality. In Proceedings of the 5th Symposium on Spatial User Interaction (Brighton, United Kingdom) (SUI ’17). Association for Computing Machinery, New York, NY, USA, 91–98. https://doi.org/10.1145/3131277.3132182
[27]
Christoph Rasche and Karl R. Gegenfurtner. 2009. Precision of speed discrimination and smooth pursuit eye movements. Vision Research 49, 5 (2009), 514–523. https://doi.org/10.1016/j.visres.2008.12.003
[28]
Rabindra Ratan, Michael Santa Cruz, and Peter Vorderer. 2007. Multitasking, presence, and self-presence on the Wii. In Presence 2007 : the 10th Annual International Workshop on Presence ; [annual conference proceedings] ; October 25 - 27, Barcelona, Spain, Laura Moreno (Ed.). Starlab, Barcelona, 167–177. https://madoc.bib.uni-mannheim.de/50108/
[29]
Maria V Sanchez-Vives and Mel Slater. 2005. From presence to consciousness through virtual reality. Nature reviews neuroscience 6, 4 (2005), 332–339.
[30]
Mel Slater. 2009. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 1535 (2009), 3549–3557. https://doi.org/10.1098/rstb.2009.0138
[31]
Mel Slater, Bernhard Spanlang, Maria V Sanchez-Vives, and Olaf Blanke. 2010. First person experience of body transfer in virtual reality. PloS one 5, 5 (2010), 10564. https://doi.org/10.1371/journal.pone.0010564
[32]
Mel Slater, Anthony Steed, and Martin Usoh. 2013. Being there together: Experiments on presence in virtual environments (1990s). London: University College London (2013).
[33]
M. Tsakiris and P. Haggard. 2005. The rubber hand illusion revisited: visuotactile integration and self-attribution.Journal of Experimental Psychology: Human Perception and Performance 31 (2005), 80–91. Issue 1. https://doi.org/10.1037/0096-1523.31.1.80
[34]
Manos Tsakiris, Gita Prabhu, and Patrick Haggard. 2006. Having a body versus moving your body: How agency structures body-ownership. Consciousness and Cognition 15, 2 (2006), 423–432. https://doi.org/10.1016/j.concog.2005.09.004
[35]
Eduardo Velloso, Markus Wirth, Christian Weichel, Augusto Esteves, and Hans Gellersen. 2016. AmbiGaze: Direct Control of Ambient Devices by Gaze. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (Brisbane, QLD, Australia) (DIS ’16). Association for Computing Machinery, New York, NY, USA, 812–817. https://doi.org/10.1145/2901790.2901867
[36]
Erik Wolf, Nathalie Merdan, Nina Dölinger, David Mal, Carolin Wienrich, Mario Botsch, and Marc Erich Latoschik. 2021. The Embodiment of Photorealistic Avatars Influences Female Body Weight Perception in Virtual Reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 65–74. https://doi.org/10.1109/VR50410.2021.00027
[37]
Momona Yamagami, Sasa Junuzovic, Mar Gonzalez-Franco, Eyal Ofek, Edward Cutrell, John R. Porter, Andrew D. Wilson, and Martez E. Mott. 2022. Two-In-One: A Design Space for Mapping Unimanual Input into Bimanual Interactions in VR for Users with Limited Movement. ACM Trans. Access. Comput. 15, 3, Article 23 (jul 2022), 25 pages. https://doi.org/10.1145/3510463
[38]
Jingjing Zhang, Mengjie Huang, Kai-Lun Liao, and Rui Yang. 2022a. Exploring the Effect of Virtual Hand Realism on Embodiment by Subjective Ratings and Eye Tracking. In 2022 1st IEEE International Conference on Cognitive Aspects of Virtual Reality (CVR). 000017–000020. https://doi.org/10.1109/CVR55417.2022.9967571
[39]
Jingjing Zhang, Mengjie Huang, Xiaohang Tang, Yiqi Wang, and Rui Yang. 2022b. How Virtual Body Continuity with Different Hand Representations Influence on User Perceptions and Task Performance. In 2022 15th International Conference on Human System Interaction (HSI). 1–5. https://doi.org/10.1109/HSI55341.2022.9869486
[40]
Jingjing Zhang, Mengjie Huang, Rui Yang, Yiqi Wang, Xiaohang Tang, Ji Han, and Hai-Ning Liang. 2023. Understanding the effects of hand design on embodiment in virtual reality. Artificial Intelligence for Engineering Design, Analysis and Manufacturing 37 (2023), e10. https://doi.org/10.1017/S0890060423000045
[41]
Jingjing Zhang, Mengjie Huang, Lixiang Zhao, Rui Yang, Hai-Ning Liang, Ji Han, Liu Wang, and Wenxin Sun. 2020. Influence of Hand Representation Design on Presence and Embodiment in Virtual Environment. In 2020 13th International Symposium on Computational Intelligence and Design (ISCID). 364–367. https://doi.org/10.1109/ISCID51228.2020.00088
Index Terms
- Hand Me This: Exploring the Effects of Gaze-driven Animations and Hand Representations in Users’ Sense of Presence and Embodiment
Recommendations
The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended Reality
With innovations in the field of gaze and eye tracking, a new concentration of research in the area of gaze-tracked systems and user interfaces has formed in the field of Extended Reality (XR). Eye trackers are being used to explore novel forms of spatial ...
Evaluation of the impact of different levels of self-representation and body tracking on the sense of presence and embodiment in immersive VR
AbstractThe main goal of this paper is to investigate the effect of different types of self-representations through floating members (hands vs. hands + feet), virtual full body (hands + feet vs. full-body avatar), walking fidelity (static feet, simulated ...
Over My Hand: Using a Personalized Hand in VR to Improve Object Size Estimation, Body Ownership, and Presence
SUI '18: Proceedings of the 2018 ACM Symposium on Spatial User InteractionWhen estimating the distance or size of an object in the real world, we often use our own body as a metric; this strategy is called body-based scaling. However, object size estimation in a virtual environment presented via a head-mounted display differs ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2024
525 pages
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- he Portuguese Recovery and Re- silience Program (PRR), IAPMEI/ANI/FCT
- Fundação para a Ciência e a Tecnologia and LARSyS
Conference
ETRA '24: The 2024 Symposium on Eye Tracking Research and Applications
June 4 - 7, 2024
Glasgow, United Kingdom
Acceptance Rates
Overall Acceptance Rate 69 of 137 submissions, 50%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 154Total Downloads
- Downloads (Last 12 months)154
- Downloads (Last 6 weeks)48
Reflects downloads up to 19 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in