A study of button size for virtual hand interaction in virtual environments based on clicking performance
Pages 15903 - 15918
Abstract
In virtual environments (VEs), virtual hand interaction is one of the most common and natural interaction methods. To improve the usability of hand interaction, it is necessary to determine the design requirements of buttons for virtual hand clicks. In this paper, a virtual hand clicking experiment in virtual reality (VR) was conducted to test the click performance under different width and spacing conditions of controls. The experiment set three independent variables, including five width levels (1.6°, 2.0°, 2.4°, 2.8°, 3.2°), six spacing levels (0.2°, 0.6°, 1.0°, 1.4°, 1.8°, 2.2°), and four clicking directions of the consecutive clicking buttons. According to the experimental results, under a clicking distance of 45 cm, the spacing of adjacent buttons should be more than 1.4°, and the width of buttons should be more than 2.4°. Based on the experimental results, the information throughput (TP) of the virtual hand clicking in VEs is between the TP of the mouse and the handheld touch screen. The button design suggestions obtained in this paper are of guiding significance to the interface design for virtual hand clicking interactions in virtual environments.
References
[1]
Alice CGI, Gabriella P, Lucia SMD, Elena P, and Raya MA A novel integrating virtual reality approach for the assessment of the attachment behavioral system Front Psychol 2017 8 959-966
[2]
Aloraini SM, Glazebrook CM, Sibley KM, Singer J, Passmore S (2019) Anticipatory postural adjustments during a Fitts’ task: comparing young versus older adults and the effects of different foci of attention. Hum Mov Sci 64:366–377.
[3]
Argelaguet F and Andujar C Efficient 3D pointing selection in cluttered virtual environments IEEE Comput Graph Appl 2009 29 6 34-43
[4]
Argelaguet F and Andujar C A survey of 3D object selection techniques for virtual environments Comput Graph 2013 37 121-136
[5]
Aslandere T, Dreyer D, Pankratz F (2015) Virtual hand-button interaction in a generic virtual reality flight simulator. Aerospace conference. IEEE, pp 1–8.
[6]
Borrego A, Latorre J, Alcañiz M, and Llorens R Comparison of oculus rift and HTC Vive: feasibility for virtual reality-based exploration, navigation, exergaming, and rehabilitation Games Health J 2018 7 3 151-156
[7]
Bowman DA, Johnson DB, and Hodges LF Testbed evaluation of virtual environment interaction techniques Presence 2001 10 1 75-95
[8]
Cha Y and Myung R Extended Fitts’ law for 3D pointing tasks using 3D target arrangements Int J Ind Ergon 2013 43 4 350-355
[9]
Clark LD, Bhagat AB, and Riggs SL Extending Fitts’ law in three-dimensional virtual environments with current low-cost virtual reality technology Int J Hum Comput Stud 2020 139 102413
[10]
Cockburn A, Masson D, Gutwin C, Palanque P, Goguey A, Yung M, Gris C, and Catherine MT Design and evaluation of braced touch for touchscreen input stabilisation Int J Hum Comput Stud 2018 122 21-37
[11]
Fitts PM The information capacity of the human motor system in controlling the amplitude of movement J Experimental Psychol Gen 1954 47 381-391
[12]
Fitts PM The information capacity of the human motor system in controlling the amplitude of movement J Experimental Psychol Gen 1992 121 262-269
[13]
Guo L, Lu Z, Yao L (2021) Human-machine interaction sensing technology based on hand gesture recognition: a review. IEEE Tans Hum-Mach Syst 51:300–309.
[14]
Hansberger J, Peng C, Mathis SL, Shanthakumar VA, Meacham S, Cao L, Blakely V (2017) Dispelling the gorilla arm syndrome: the viability of prolonged gesture interactions. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), pp 505–520.
[15]
Hirota M, Tsuboi A, Yokoyama M, Yanagisawa M (2018) Gesture recognition of air-tapping and its application to character input in VR space.
[16]
Hu X, Song A, and Li H Dexterous robot hand control system based on surface electromyography image Control Theory Appl 2018 35 12 1707-1714
[17]
Im Y, Kim T, and Jung ES Investigation of icon design and touchable area for effective smart phone controls Hum Factors Ergon Manuf Serv Ind 2014 25 2 251-267
[18]
Jost TA, Drewelow G, Koziol S, and Rylander J A quantitative method for evaluation of 6 degree of freedom virtual reality systems J Biomech 2019 97 109-379
[19]
Jung ES, Im Y (2015) Touchable area: an empirical study on design approach considering perception size and touch input behavior. Int J Ind Ergon 49:21–30.
[20]
Jung S, Park J, Park J, Choe M, Kim T, Lee S, and Choi M Effect of touch button interface on in-vehicle information systems usability Int J Hum Comput Interact 2021 37 6 1-19
[21]
Katzakis N, Chen L, Teather RJ, Ariza O, and Steinicke F Evaluation of 3D pointing accuracy in the fovea and periphery in immersive head-mounted display environments IEEE Trans Vis Comput Graph 2019 99 1-1
[22]
Kim T, Jung ES, and Im Y Optimal control location for the customer-oriented design of smart phones Inf Sci 2014 257 264-275
[23]
Kim J, Cha J, Lee H, Kim S (2017) Hand-free natural user interface for VR HMD with IR based facial gesture tracking sensor. The 23rd ACM symposium. ACM.
[24]
Kopper R, Bowman DA, Silva MG, and Mcmahan RP A human motor behavior model for distal pointing tasks Int J Hum - Comput Stud 2010 68 10 603-615
[25]
Liang Z, Xu X, Zhou S (2017) The smallest target size for a comfortable pointing in freehand space: human pointing precision of freehand interaction. Univ Access Inf Soc 16(2):381–393.
[26]
Lin J, Harris-Adamson C, and Rempel D The eesign of hand gestures for selecting virtual objects Int J Human–Computer Interact 2019 35 1729-1735
[27]
Livinston MA (2003) Resolving multiple occluded layers in augmented reality. Proc Ismar 56–67.
[28]
Looker J (2015) Reaching for holograms: assessing the ergonomics of the Microsoft™ Hololens™ 3D gesture known as the “Air Tap”. Eeum Design Connects. https://www.researchgate.net/publication/284283876
[29]
Lubos P, Bruder G, Steinicke F (2014) Analysis of direct selection in head-mounted display environments. 3D user interfaces.
[30]
Lubos P, Bruder G, Ariza O, Steinicke F (2016) Touching the sphere: leveraging joint-centered kinespheres for spatial user interaction. Symposium on spatial user interaction. ACM.
[31]
Machuca MDB, Stuerzlinger W (2019) The effect of stereo display deficiencies on virtual hand pointing. CHI conference on human factors in computing systems proceedings.
[32]
Mackenzie IS (2015) Fitts’ throughput and the remarkable case of touch-based target selection. International conference on human-computer interaction. Springer International Publishing, pp 238–249.
[33]
Mackenzie CL, Graham ED (1997) Separating A and W effects: pointing to targets on computer displays. Behav Brain Sci 20(2):316–318.
[34]
Mackenzie IS, Isokoski P (2008) Fitts’ throughput and the speed-accuracy tradeoff. Proceedings of the 2008 conference on human factors in computing systems. Association for computing machinery, New York, pp 1633–1636.
[35]
Mackinlay JD, Card SK, and Robertson GG A semantic analysis of the design space of input devices ACM Trans Inf Syst 1991 9 2 99-122
[36]
Mine MR, Brooks FP, Sequin CH (1997) Moving objects in space: exploiting proprioception in virtual-environment interaction. ACM Press/Addison-Wesley Publishing Co, pp 19–20.
[37]
Morales JM, Moreno CT, Provinciale JG, and Millan CL Methodological bases for a new platform for the measurement of human behaviour in virtual environment DYNA 2017 92 34-38
[38]
Murata A and Iwase H Extending Fitts’ law to a three-dimensional pointing task Hum Mov Sci 2002 20 6 791-805
[39]
Murthy LRD (2020) Multimodal interaction for real and virtual environments. In: Proceedings of the 25th international conference on intelligent user interfaces companion (IUI ‘20). Association for Computing Machinery, New York, pp 29–30.
[40]
Park YS, Han SH (2010) Touch key design for one-handed thumb interaction with a mobile phone: effects of touch key size and touch key location. Int J Ind Ergon 40(1):68–76.
[41]
Park K, Kim D, and Han SH Usability of the size, spacing, and operation method of virtual buttons with virtual hand on head-mounted displays Int J Ind Ergon 2020 76 102939
[42]
Poupyrev I, Weghorst S, Billinghurst M, Ichikawa T (1996) The Go-Go interaction techniques: non-linear mapping for direct manipulation in VR. Proceedings of the ACM symposium on user interface software and technology, pp 79–80.
[43]
Poupyrev I, Weghorst S, Billinghurst M, Ichikawa T (1997) A framework and testbed for studying manipulation techniques for immersive VR. Proceedings of the ACM symposium on virtual reality software and technology, pp 1379–1389.
[44]
Rizzuto MA, Sonne MWL, Vignais N, and Keir PJ Evaluation of a virtual reality head mounted display as a tool forposture assessment in digital human modelling software Appl Ergon 2019 79 1-8
[45]
Sagayam KM, Hemanth DJ (2017) Hand posture and gesture recognition techniques for virtual reality applications: a survey. Virtual Reality 21:91–107.
[46]
Shneiderman B (1983) Direct manipulation: a step beyond programming languages. IEEE Comput 16(8):57–69.
[47]
Sidenmark L, Lundstrm A (2019) Gaze behaviour on interacted objects during hand interaction in virtual reality for eye tracking calibration. The 11th ACM symposium, ACM, pp 1–9.
[48]
Tao D, Yuan J, Liu S, and Qu X Effects of button design characteristics on performance and perceptions of touchscreen use Int J Ind Ergon 2018 64 59-68
[49]
Teather RJ, Stuerzlinger W (2011) Pointing at 3D targets in a stereo head-tracked virtual environment. IEEE Symposium on 3D User Interfaces (3DUI), IEEE, pp 87–94.
[50]
William S and Scott MK Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI Int J Hum Comput Stud 2004 61 6 751-789
[51]
Wingrave CA, Bowman DA (2005) Baseline factors for raycasting selection. Proceedings of virtual reality international, pp 1–10
[52]
Yang X, Sun X, Zhou D, Li YF, and Liu H Towards wearable A-mode ultrasound sensing for real-time finger motion recognition IEEE Trans Neural Syst Rehabil Eng 2018 26 6 1199-1208
[53]
Yashas J, Shivakumar G (2019) Hand gesture recognition: a survey. International conference on applied machine learning (ICAML), 2019, pp 3–8.
[54]
Yu D, Liang H, Lu X, and Fan K Modeling endpoint distribution of pointing selection tasks in virtual reality environments ACM Trans Graph 2019 38 6 1-13
[55]
Yu H, Nam K, Shin S, Choi M, Son Y, and Chang J Repetitive patterns in the locations of touch errors for two-thumb text entry on a smartphone Appl Ergon 2021 97 2 103541
[56]
Zholshiyeva LZ, Zhukabayeva TK, Turaev S, Berdiyeva MA, Jambulova DT (2021) Hand gesture recognition methods and applications: a literature survey. Association for computing machinery, New York, Article 11, pp 1–8.
[57]
Zhou X, Qin H, Xiao W, and Jia L A comparative usability study of bare hand three-dimensional object selection techniques in virtual environment Symmetry 2020 10 1-20
Recommendations
Virtual Hand Position Correction Algorithm Based on Virtual Hand Interaction
ICCDE '20: Proceedings of 2020 6th International Conference on Computing and Data EngineeringThe interaction based on virtual hand is the main way of interaction in virtual reality. However, the three-dimensional visual angle of the virtual scene makes the objects in the interactive scene appear near large and far small. The objects near the ...
Virtual Grasping Feedback and Virtual Hand Ownership
SAP '19: ACM Symposium on Applied Perception 2019In this work, we investigate the influence of different visualizations on a manipulation task in virtual reality (VR). Without the haptic feedback of the real world, grasping in VR might result in intersections with virtual objects. As people are highly ...
Effective manipulation of virtual objects within arm's reach
VR '11: Proceedings of the 2011 IEEE Virtual Reality ConferenceWe present a study that compares finger-based direct interaction to controller-based ray interaction in a CAVE as well as in head-mounted displays. We focus on interaction tasks within reach of the users' arms and hands and explore various feedback ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022. Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 15 October 2022
Accepted: 06 October 2022
Revision received: 12 September 2022
Received: 04 May 2022
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 24 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in