Evaluation of Retrieval Techniques for Out-of-Range VR Objects, Contrasting Controller-Based and Free-Hand Interaction
Article No.: 28, Pages 1 - 11
Abstract
In VR environments like “sandbox” applications or interactive molecule simulators for education, physics-based objects can move beyond a user’s natural reach. We evaluate four interaction methods to support efficient and intuitive retrieval of objects for such events, including one that has not been evaluated previously and three others derived from well-known techniques. Considering the proliferation of camera-based hand tracking in VR headsets, there is a large interest in contrasting controller-based and free-hand interaction methods, so our evaluation considers both input types to further understand tradeoffs. We gathered performance data and subjective impressions from 52 subjects in a representative game-like puzzle task. A hand-extension (“go-go”-type) technique was least promising, with image-plane and pointing-based techniques being more promising. The recent tether-handle technique was roughly on-par with others for controller input (details vary by metric); it simply uses the same underlying grab metaphor as the main interaction. For free-hand interaction, its performance is reduced in a way that reflects broader problems of grab detection and manipulation methods for whole-hand interaction in VR.
Supplemental Material
MP4 File
Summary video
- Download
- 43.32 MB
PDF File
Statistical tables
- Download
- 240.98 KB
References
[1]
Anil Ufuk Batmaz, Mayra Donaji Barrera Machuca, Junwei Sun, and Wolfgang Stuerzlinger. 2022. The effect of the vergence-accommodation conflict on virtual hand pointing in immersive displays. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–15.
[2]
Anil Ufuk Batmaz, Moaaz Hudhud Mughrabi, Mayra Donaji Barrera Machuca, and Wolfgang Stuerzlinger. 2022. Effect of stereo deficiencies on virtual distal pointing. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology. 1–8.
[3]
Doug A Bowman and Larry F Hodges. 1997. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In Proceedings of the 1997 symposium on Interactive 3D graphics. 35–ff.
[4]
Doug A Bowman and Larry F Hodges. 1999. Formalizing the design, evaluation, and application of interaction techniques for immersive virtual environments. Journal of Visual Languages & Computing 10, 1 (1999), 37–53.
[5]
David Broussard and Christoph W. Borst. 2024. Optimization of a Tether-Handle Object Retrieval Technique for VR. In 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 36–41. https://doi.org/10.1109/VRW62533.2024.00013
[6]
Di Laura Chen, Marcello Giordano, Hrvoje Benko, Tovi Grossman, and Stephanie Santosa. 2023. GazeRayCursor: Facilitating Virtual Reality Target Selection by Blending Gaze and Controller Raycasting. In Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology. 1–11.
[7]
Lisa A. Elkin, Matthew Kay, James J. Higgins, and Jacob O. Wobbrock. 2021. An Aligned Rank Transform Procedure for Multifactor Contrast Tests. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 754–768. https://doi.org/10.1145/3472749.3474784
[8]
Asim Hameed, Sebastian Möller, and Andrew Perkis. 2023. How good are virtual hands? Influences of input modality on motor tasks in virtual reality. Journal of Environmental Psychology 92 (2023), 102137. https://doi.org/10.1016/j.jenvp.2023.102137
[9]
Asim Hameed, Andrew Perkis, and Sebastian Möller. 2021. Evaluating hand-tracking interaction for performing motor-tasks in vr learning environments. In 2021 13th International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 219–224.
[10]
Riccardo Jota, Miguel Nacenta, Joaquim Jorge, Sheelagh Carpendale, and Saul Greenberg. 2009. A comparison of ray pointing techniques for very large displays. Technical Report. University of Calgary.
[11]
Chaowanan Khundam, Varunyu Vorachart, Patibut Preeyawongsakul, Witthaya Hosap, and Frédéric Noël. 2021. A comparative study of interaction time and usability of using controllers and hand tracking in virtual reality training. In Informatics, Vol. 8. MDPI, 60.
[12]
Woojoo Kim and Shuping Xiong. 2022. ViewfinderVR: configurable viewfinder for selection of distant objects in VR. Virtual Reality (2022), 1–20.
[13]
Sangyoon Lee, Jinseok Seo, Gerard Jounghyun Kim, and Chan-Mo Park. 2003. Evaluation of pointing techniques for ray casting selection in virtual environments. In Third international conference on virtual reality and its application in industry, Vol. 4756. SPIE, 38–44.
[14]
Jiandong Liang and Mark Green. 1994. JDCAD: A highly interactive 3D modeling system. Computers & graphics 18, 4 (1994), 499–506.
[15]
Tiffany Luong, Yi Fei Cheng, Max Möbus, Andreas Fender, and Christian Holz. 2023. Controllers or Bare Hands? A Controlled Evaluation of Input Techniques on Interaction Performance and Exertion in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics (2023).
[16]
Mykola Maslych, Yahya Hmaiti, Ryan Ghamandi, Paige Leber, Ravi Kiran Kattoju, Jacob Belga, and Joseph J LaViola. 2023. Toward Intuitive Acquisition of Occluded VR Objects Through an Interactive Disocclusion Mini-map. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). IEEE, 460–470.
[17]
Ken Pfeuffer, Benedikt Mayer, Diako Mardanbegi, and Hans Gellersen. 2017. Gaze+ pinch interaction in virtual reality. In Proceedings of the 5th symposium on spatial user interaction. 99–108.
[18]
Jeffrey S Pierce, Andrew S Forsberg, Matthew J Conway, Seung Hong, Robert C Zeleznik, and Mark R Mine. 1997. Image plane interaction techniques in 3D immersive environments. In Proceedings of the 1997 symposium on Interactive 3D graphics. 39–ff.
[19]
Jeffrey S Pierce and Randy Pausch. 2002. Comparing voodoo dolls and HOMER: exploring the importance of feedback in virtual environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 105–112.
[20]
Jeffrey S Pierce, Brian C Stearns, and Randy Pausch. 1999. Voodoo dolls: seamless interaction at multiple scales in virtual environments. In Proceedings of the 1999 symposium on Interactive 3D graphics. 141–145.
[21]
Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proceedings of the 9th annual ACM symposium on User interface software and technology. 79–80.
[22]
Ivan Poupyrev, Tadao Ichikawa, Suzanne Weghorst, and Mark Billinghurst. 1998. Egocentric object manipulation in virtual environments: empirical evaluation of interaction techniques. In Computer graphics forum, Vol. 17. Wiley Online Library, 41–52.
[23]
Yuan Yuan Qian and Robert J Teather. 2017. The eyes don’t have it: an empirical comparison of head-based and eye-based selection in virtual reality. In Proceedings of the 5th Symposium on Spatial User Interaction. 91–98.
[24]
Jonas Schjerlund, Kasper Hornbæk, and Joanna Bergström. 2021. Ninja hands: Using many hands to improve target selection in vr. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1–14.
[25]
Frank Steinicke, Timo Ropinski, and Klaus Hinrichs. 2006. Object selection in virtual environments using an improved virtual pointer metaphor. In Computer vision and graphics. Springer, 320–326.
[26]
Richard Stoakley, Matthew J Conway, and Randy Pausch. 1995. Virtual reality on a WIM: interactive worlds in miniature. In Proceedings of the SIGCHI conference on Human factors in computing systems. 265–272.
[27]
Stanislav L Stoev, Dieter Schmalstieg, and Wolfgang Straßer. 2002. The through-the-lens metaphor: taxonomy and application. In Proceedings IEEE Virtual Reality 2002. IEEE, 285–286.
[28]
Robert J Teather and Wolfgang Stuerzlinger. 2013. Pointing at 3d target projections with one-eyed and stereo cursors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 159–168.
[29]
Lode Vanacken, Tovi Grossman, and Karin Coninx. 2007. Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In 2007 IEEE symposium on 3D user interfaces. IEEE.
[30]
Lode Vanacken, Tovi Grossman, and Karin Coninx. 2009. Multimodal selection techniques for dense and occluded 3D virtual environments. International Journal of Human-Computer Studies 67, 3 (2009), 237–255.
[31]
Jan-Niklas Voigt-Antons, Tanja Kojic, Danish Ali, and Sebastian Möller. 2020. Influence of hand tracking as a way of interaction in virtual reality on user experience. In 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 1–4.
[32]
Colin Ware and Kathy Lowther. 1997. Selection using a one-eyed cursor in a fish tank VR environment. ACM Transactions on Computer-Human Interaction (TOCHI) 4, 4 (1997), 309–322.
[33]
Chadwick A Wingrave, Yonca Haciahmetoglu, and Doug A Bowman. 2006. Overcoming world in miniature limitations by a scaled and scrolling WIM. In 3D User Interfaces (3DUI’06). IEEE, 11–16.
[34]
Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963
Index Terms
- Evaluation of Retrieval Techniques for Out-of-Range VR Objects, Contrasting Controller-Based and Free-Hand Interaction
Recommendations
Move'n'Hold Pro: Consistent Spatial Interaction Techniques for Object Manipulation with Handheld and Head-mounted Displays in Extended Reality
ECCE '24: Proceedings of the European Conference on Cognitive Ergonomics 2024Extended Reality (XR) technologies are still lacking appropriate interaction methods that enable users to seamlessly switch between different XR devices and degrees of virtuality. Addressing this gap, we present Move’n’Hold Pro – a set of consistent ...
Grasping 3D Objects With Virtual Hand in VR Environment
VRCAI '22: Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in IndustryVirtual hands are typically hidden after grasping an object in Virtual Reality (VR) environments in existing virtual hand grasping works, which significantly impact user experience. In this paper, we build a real-time, flexible, robust and natural ...
Navigating in VR using free-hand gestures and embodied controllers: A comparative evaluation
VRST '23: Proceedings of the 29th ACM Symposium on Virtual Reality Software and TechnologyWhile natural body-based movements are essential features for immersive VR (Virtual Reality) experiences, most of the available input techniques for navigation in VR involve the use of hand-held controllers. Alternatively, while body-based input for VR ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2024
396 pages
ISBN:9798400710889
DOI:10.1145/3677386
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate 86 of 279 submissions, 31%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 52Total Downloads
- Downloads (Last 12 months)52
- Downloads (Last 6 weeks)39
Reflects downloads up to 26 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format