Quantifying the 'Gorilla Arm' Effect in a Virtual Reality Text Entry Task via Ray-Casting: A Preliminary Single-Subject Study
Authors: 
Eduardo G. Q. Palmeira, 
Alexandre Campos, Ígor A. Moraes, Alexandre G. de Siqueira, Marcelo G. G. FerreiraAuthors Info & Claims
Pages 274 - 278
Abstract
Inputting text is a fundamental task users perform in immersive virtual reality (VR) environments. This preliminary study quantifies the ‘gorilla arm’ effect regarding the required torque in the upper limb joints of an individual during a VR text entry task via ray-casting. This type of fatigue can be caused by the weight of the users’ arms, depending on the arm pose maintained during a task. We used motion capture technology to compare the required arm joints’ torque in two typical arm poses during VR text entry tasks. The results suggest that extending the arm higher and in front of the body towards the virtual keyboard causes about 3.77 times more net torque on the shoulder joint and 2.00 times more on the elbow joint, compared to when the arm is in a more relaxed and lowered position. These findings can support future VR text entry studies concerned with physical ergonomics.
References
[1]
Jiban Adhikary and Keith Vertanen. 2021. Text Entry in Virtual Environments using Speech and a Midair Keyboard. IEEE Transactions on Visualization and Computer Graphics 27, 5 (2021), 2648–2658. https://doi.org/10.1109/TVCG.2021.3067776
[2]
Meta Quest Blog. 2023. Meta Quest v50 Update: ‘Tap’ and ‘Swipe’ Through the Home UI With New Direct Touch Feature, Plus In-Game Multitasking and More. Retrieved Jun 16, 2023 from https://www.meta.com/blog/quest/meta-quest-v50-direct-touch-in-game-multitasking/
[3]
Sebastian Boring, Marko Jurmu, and Andreas Butz. 2009. Scroll, Tilt or Move It: Using Mobile Phones to Continuously Control Pointers on Large Public Displays. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (Melbourne, Australia) (OZCHI ’09). Association for Computing Machinery, New York, NY, USA, 161–168. https://doi.org/10.1145/1738826.1738853
[4]
Douglas A. Bowman. 1999. Interaction Techniques for Common Tasks in Immersive Virtual Environments: Design, Evaluation, and Application. Ph. D. Dissertation. Georgia Institute of Technology, Atlanta, GA, USA.
[5]
Don B. Chaffin, Gunnar B. J. Andersson, and Bernard J. Martin. 2006. Occupational Biomechanics (4 ed.). John Wiley & Sons, New Jersey. 376 pages.
[6]
A. Cockburn, P. Quinn, C. Gutwin, G. Ramos, and J. Looser. 2011. Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback. International Journal of Human-Computer Studies 69, 6 (2011), 401–414. https://doi.org/10.1016/j.ijhcs.2011.02.005
[7]
Jessyca L. Derby, Emily A. Rickel, Kelly J. Harris, Jade A. Lovell, and Barbara S. Chaparro. 2020. “We Didn’t Catch That!” Using Voice Text Input on a Mixed Reality Headset in Noisy Environments. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 64, 1 (2020), 2102–2106. https://doi.org/10.1177/1071181320641509
[8]
Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text Entry in Virtual Reality: A Comprehensive Review of the Literature. In Human-Computer Interaction. Recognition and Interaction Technologies, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 419–437. https://doi.org/10.1007/978-3-030-22643-5_33
[9]
Jens Grubert, Lukas Witzani, Eyal Ofek, Michel Pahud, Matthias Kranz, and Per Ola Kristensson. 2018. Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 159–166. https://doi.org/10.1109/VR.2018.8446059
[10]
Joseph Hamill, Kathleen M. Knutzen, and Timothy R. Derrick. 2015. Biomechanical Basis of Human Movement (4 ed.). Wolters Kluwer Health, Philadelphia. 484 pages.
[11]
Chris Harrison, Shilpa Ramamurthy, and Scott E. Hudson. 2012. On-Body Interaction: Armed and Dangerous. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (Kingston, Ontario, Canada) (TEI ’12). Association for Computing Machinery, New York, NY, USA, 69–76. https://doi.org/10.1145/2148131.2148148
[12]
Robert H. Horner, Edward G. Carr, James Halle, Gail McGee, Samuel Odom, and Mark Wolery. 2005. The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education. Exceptional Children 71, 2 (2005), 165–179. https://doi.org/10.1177/001440290507100203
[13]
Shigeru Iwakabe and Nicola Gazzola. 2009. From single-case studies to practice-based knowledge: Aggregating and synthesizing case studies. Psychotherapy Research 19, 4-5 (2009), 601–611. https://doi.org/10.1080/10503300802688494
[14]
Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2017. Modeling Cumulative Arm Fatigue in Mid-Air Interaction Based on Perceived Exertion and Kinetics of Arm Motion. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3328–3339. https://doi.org/10.1145/3025453.3025523
[15]
Jason Jerald. 2015. The VR Book: Human-Centered Design for Virtual Reality. Association for Computing Machinery and Morgan & Claypool Publishers. 635 pages. https://doi.org/10.1145/2792790
[16]
Joseph J. LaViola Jr., Ernst Kruijff, Ryan P. McMahan, Doug A. Bowman, and Ivan Poupyrev. 2017. 3D User Interfaces: Theory and Practice (2 ed.). Addison-Wesley Professional, Boston. 624 pages.
[17]
I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase Sets for Evaluating Text Entry Techniques. Association for Computing Machinery, New York, NY, USA, 754–755. https://doi.org/10.1145/765891.765971
[18]
Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2143–2152. https://doi.org/10.1145/2702123.2702382
[19]
D. Mendes, F. M. Caputo, A. Giachetti, A. Ferreira, and J. Jorge. 2019. A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments. Computer Graphics Forum 38, 1 (2019), 21–45. https://doi.org/10.1111/cgf.13390
[20]
Aarthi Easwara Moorthy and Kim-Phuong L. Vu. 2015. Privacy Concerns for Use of Voice Activated Personal Assistant in the Public Space. International Journal of Human–Computer Interaction 31, 4 (2015), 307–335. https://doi.org/10.1080/10447318.2014.986642
[21]
Vijayakumar Nanjappan, Hai-Ning Liang, Feiyu Lu, Konstantinos Papangelis, Yong Yue, and Ka Lok Man. 2018. User-Elicited Dual-Hand Interactions for Manipulating 3D Objects in Virtual Reality Environments. Human-centric Computing and Information Sciences 8, 1, Article 154 (2018), 16 pages. https://doi.org/10.1186/s13673-018-0154-5
[22]
Krzysztof Pietroszek. 2018. Raycasting in Virtual Reality. In Encyclopedia of Computer Graphics and Games, Newton Lee (Ed.). Springer International Publishing, Cham, 1–3. https://doi.org/10.1007/978-3-319-08234-9_180-1
[23]
Stanley Plagenhoef, F. Gaynor Evans, and Thomas Abdelnour. 1983. Anatomical Data for Analyzing Human Motion. Research Quarterly for Exercise and Sport 54, 2 (1983), 169–178. https://doi.org/10.1080/02701367.1983.10605290
[24]
Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-Based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174221
[25]
Keith Vertanen. 2009. Efficient Correction Interfaces for Speech Recognition. Ph. D. Dissertation. University of Cambridge, Cambridge, UK. https://www.keithv.com/pub/phd/efficient_correction_speech.pdf
[26]
Ana Villanueva, Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2023. Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction. International Journal of Human-Computer Studies 169 (2023), 102931. https://doi.org/10.1016/j.ijhcs.2022.102931
[27]
Oculus VR. 2020. Introducing Oculus Quest 2, the Next Generation of All-in-One VR. Retrieved Nov 25, 2022 from https://developer.oculus.com/blog/introducing-oculus-quest-2-the-next-generation-of-all-in-one-vr/
[28]
James Walker, Bochao Li, Keith Vertanen, and Scott Kuhl. 2017. Efficient Typing on a Visually Occluded Physical Keyboard. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5457–5461. https://doi.org/10.1145/3025453.3025783
Index Terms
- Quantifying the 'Gorilla Arm' Effect in a Virtual Reality Text Entry Task via Ray-Casting: A Preliminary Single-Subject Study
Recommendations
Walking in Virtual Reality: Effects of Manipulated Visual Self-Motion on Walking Biomechanics
Walking constitutes the predominant form of self-propelled movement from one geographic location to another in our real world. Likewise, walking in virtual environments (VEs) is an essential part of a users experience in many application domains ...
ErgoPulse: Electrifying Your Lower Body With Biomechanical Simulation-based Electrical Muscle Stimulation Haptic System in Virtual Reality
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing SystemsThis study presents ErgoPulse, a system that integrates biomechanical simulation with electrical muscle stimulation (EMS) to provide kinesthetic force feedback to the lower-body in virtual reality (VR). ErgoPulse features two main parts: a biomechanical ...
Investigating the Effects of Position and Angle of Virtual Keyboard on Text Entry Performance and Workload
Asian CHI '21: Proceedings of the Asian CHI Symposium 2021The Virtual Reality (VR) users suffer from neck and arm fatigue. This is because the VR users are required to wear the heavy head–mounted display (HMD) and keep raising the arms. In particular, the virtual keyboards are frequently used and they are time–...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2023
315 pages
ISBN:9798400709432
DOI:10.1145/3625008
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 06 January 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Funding Sources
- FAPESC
Conference
SVR '23
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 84Total Downloads
- Downloads (Last 12 months)84
- Downloads (Last 6 weeks)15
Reflects downloads up to 17 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format