Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

A Fitts’ Law Evaluation of Visuo-haptic Fidelity and Sensory Mismatch on User Performance in a Near-field Disc Transfer Task in Virtual Reality

Published: 14 December 2020 Publication History

Editorial Notes

A corrigendum was issued for this paper on February 2, 2021. You can download the corrigendum from the supplemental material section of this citation page.

Abstract

The trade-off between speed and accuracy in precision tasks is important to evaluate during user interaction with input devices. When different sensory cues are added or altered in such interactions, those cues have an effect on this trade-off, and thus, they affect overall user performance. For instance, adding cues like haptic feedback and stereoscopic viewing will result in more realistic user interaction, thus improving performance in these tasks. Also, adding a noticeable disparity between physical and virtual movements creates a mismatch between visual and proprioceptive systems, which generally has a negative effect on performance. In this study, we investigate the effects of haptic feedback, stereoscopic viewing, and visuo-proprioceptive mismatch on how quickly and accurately users complete a virtual pick-and-place task using the PHANToM OMNI. Through this experiment, we find that in the movement phase of a ring transfer, movement time and user performance are affected by haptic feedback and visuo-proprioceptive mismatch, and the main effects of stereoscopic viewing appears to be limited to the more precise step when the ring is around the target peg.

Supplementary Material

3419986-corrigendum (3419986-corrigendum.pdf)
Corrigendum to "A Fitts' Law Evaluation of Visuo-haptic Fidelity and Sensory Mismatch on User Performance in a Near-field Disc Transfer Task in Virtual Reality" by Brickler et al., ACM Transactions on Applied Perception, Volume 17, Issue 4 (TAP 17:4).

References

[1]
Anil Ufuk Batmaz and Wolfgang Stuerzlinger. 2019. The effect of rotational jitter on 3D pointing tasks. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, LBW2112.
[2]
Christopher C. Berger, Mar Gonzalez-Franco, Eyal Ofek, and Ken Hinckley. 2018. The uncanny valley of haptics. Sci. Robot. 3, 17 (2018), Art--No.
[3]
Darrell S. Best and Andrew T. Duchowski. 2016. A rotary dial for gaze-based PIN entry. In Proceedings of the 9th Biennial ACM Symposium on Eye Tracking Research and Applications (ETRA’16). ACM, New York, NY, 69--76.
[4]
Ayush Bhargava, Jeffrey W. Bertrand, Anand K. Gramopadhye, Kapil C. Madathil, and Sabarish V. Babu. 2018. Evaluating multiple levels of an interaction fidelity continuum on performance and learning in near-field training simulations. IEEE Trans. Visual. Comput. Graph. 24, 4 (2018), 1418--1427.
[5]
David Brickler, Matias Volonte, Jeffrey W. Bertrand, Andrew T. Duchowski, and Sabarish V. Babu. 2019. Effects of stereoscopic viewing and haptic feedback, sensory-motor congruence and calibration on near-field fine motor perception-action coordination in virtual reality. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR’19). IEEE, 28--37.
[6]
Gerd Bruder, Fernando Argelaguet Sanz, Anne-Hélène Olivier, and Anatole Lécuyer. 2015. Distance estimation in large immersive projection systems, revisited. In Proceedings of the IEEE Virtual Reality (VR’15). IEEE, 27--32.
[7]
Stuart K. Card, William K. English, and Betty J. Burr. 1978. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics 21, 8 (1978), 601--613.
[8]
Kwonsoo Chun, B. Verplank, F. Barbagli, and K. Salisbury. 2004. Evaluating haptics and 3D stereo displays using Fitts’ law. In Proceedings of the 2nd International Conference on Creating, Connecting and Collaborating through Computing. IEEE, 53--58.
[9]
Heather Culbertson and Katherine J. Kuchenbecker. 2016. Importance of matching physical friction, hardness, and texture in creating realistic haptic virtual surfaces. IEEE Trans. Haptics. 10, 1 (2016), 63--74.
[10]
Heather Culbertson, Samuel B. Schorr, and Allison M. Okamura. 2018. Haptics: The present and future of artificial touch sensation. Annu. Rev. Control Robot. Auton. Syst. 1, 1 (2018), 385--409.
[11]
Sarah A. Douglas, Arthur E. Kirkpatrick, and I. Scott MacKenzie. 1999. Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 215--222.
[12]
Elham Ebrahimi, Bliss Altenhoff, Leah Hartman, J. Adam Jones, Sabarish V. Babu, Christopher C. Pagano, and Timothy A. Davis. 2014. Effects of visual and proprioceptive information in visuo-motor calibration during a closed-loop physical reach task in immersive virtual environments. In Proceedings of the ACM Symposium on Applied Perception. ACM, 103--110.
[13]
Shaghayegh Esmaeili, Brett Benda, and Eric D. Ragan. 2020. Detection of scaled hand interactions in virtual reality: The effects of motion direction and task complexity. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR’20). 453--462.
[14]
Lucas S. Figueiredo, Edvar Vilar Neto, Ermano Arruda, João Marcelo Teixeira, and Veronica Teichrieb. 2014. Fishtank everywhere: Improving viewing experience over 3D content. In Proceedings of the International Conference of Design, User Experience, and Usability. Springer, 560--571.
[15]
Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exper. Psychol. 47, 6 (1954), 381.
[16]
Gerald M. Fried. 2008. FLS assessment of competency using simulated laparoscopic tasks. J. Gastro. Surg. 12, 2 (2008), 210--212.
[17]
Michael J. Fu, Andrew D. Hershberger, Kumiko Sano, and M. Cenk Çavuşoğlu. 2011. Effect of visuo-haptic co-location on 3D Fitts’ task performance. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 3460--3467.
[18]
Jens Garstka and Gabriele Peters. 2011. View-dependent 3D projection using depth-image-based head tracking. In Proceedings of the 8th IEEE International Workshop on Projector Camera Systems (PROCAMS’11). 52--57.
[19]
Tovi Grossman and Ravin Balakrishnan. 2005. The bubble cursor: Enhancing target acquisition by dynamic resizing of the cursor’s activation area. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 281--290.
[20]
Joy Paul Guilford and Wayne S. Zimmerman. 1948. The Guilford-Zimmerman aptitude survey. J. Appl. Psychol. 32, 1 (1948), 24.
[21]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in Psychology. Vol. 52. Elsevier, 139--183.
[22]
Nigel W. John, Nicholas I. Phillips, Llyr Ap Cenydd, Serban R. Pop, David Coope, Ian Kamaly-Asl, Christopher de Souza, and Simon J. Watt. 2016. The use of stereoscopy in a neurosurgery training virtual environment. Presence: Teleop. Virtual Environ. 24, 4 (2016), 289--298.
[23]
Todd Johnsgard. 1994. Fitts’ Law with a virtual reality glove and a mouse: Effects of gain. In Graphics Interface. Canadian Information Processing Society, 8--8.
[24]
J. Adam Jones, Darlene Edewaard, Richard A. Tyrrell, and Larry F. Hodges. 2016. A schematic eye for virtual environments. In Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI’16). IEEE, 221--230.
[25]
Paul Kabbash and William A. S. Buxton. 1995. The “prince” technique: Fitts’ law and selection using area cursors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press/Addison-Wesley Publishing, 273--279.
[26]
David B. Kaber, Yingjie Li, Michael Clamann, and Yuan-Shin Lee. 2012. Investigating human performance in a virtual reality haptic simulator as influenced by fidelity and system latency. IEEE Trans. Syst. Man Cybernet.-Part A: Syst. Hum. 42, 6 (2012), 1562--1566.
[27]
Alaa Khalifa, Ahmed Ramadan, Khalil Ibrahim, Mohamed Fanni, Samy Assal, and Ahmed Abo-Ismail. 2014. Workspace mapping and control of a teleoperated endoscopic surgical robot. In Proceedings of the 19th International Conference on Methods and Models in Automation and Robotics (MMAR’14). IEEE, 675--680.
[28]
Luv Kohli, Mary C. Whitton, and Frederick P. Brooks. 2012. Redirected touching: The effect of warping space on task performance. In Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI’12). IEEE, 105--112.
[29]
Tarald O. Kvålseth. 1980. An alternative to Fitts’ law. Bulletin of the Psychonomic Society 16, 5 (1980), 371--373.
[30]
James R. Lewis. 1995. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum.-Comput. Interact. 7, 1 (1995), 57--78.
[31]
Jialei Li, Isaac Cho, and Zachary Wartell. 2018. Evaluation of cursor offset on 3D selection in VR. In Proceedings of the Symposium on Spatial User Interaction. ACM, 120--129.
[32]
Paul Lubos, Gerd Bruder, and Frank Steinicke. 2014. Analysis of direct selection in head-mounted display environments. In Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI’14). IEEE, 11--18.
[33]
Barrera Mayra Donaji Machuca and Wolfgang Stuerzlinger. 2018. Do stereo display deficiencies affect 3D pointing? In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, LBW126.
[34]
I. Scott MacKenzie. 1989. A note on the information-theoretic basis for Fitts’ law. J. Motor Behav. 21, 3 (1989), 323--330.
[35]
I. Scott MacKenzie and William Buxton. 1992. Extending Fitts’ law to two-dimensional tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 219--226.
[36]
I. Scott MacKenzie and Poika Isokoski. 2008. Fitts’ throughput and the speed-accuracy tradeoff. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1633--1636.
[37]
I. Scott MacKenzie and Robert J. Teather. 2012. FittsTilt: The application of Fitts’ law to tilt-based interaction. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design. ACM, 568--577.
[38]
Thomas H. Massie, J. Kenneth Salisbury, et al. 1994. The phantom haptic interface: A device for probing virtual objects. In Proceedings of the ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Vol. 55. Citeseer, 295--300.
[39]
Michael McGuffin and Ravin Balakrishnan. 2002. Acquisition of expanding targets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 57--64.
[40]
John P. McIntire, Paul R. Havig, and Eric E. Geiselman. 2014. Stereoscopic 3D displays and human performance: A comprehensive review. Displays 35, 1 (2014), 18--26.
[41]
Ryan Patrick McMahan. 2011. Exploring the Effects of Higher-fidelity Display and Interaction for Virtual Reality Games. Ph.D. Dissertation. Virginia Tech.
[42]
Kouta Minamizawa, Domenico Prattichizzo, and Susumu Tachi. 2010. Simplified design of haptic display by extending one-point kinesthetic feedback to multipoint tactile feedback. In Proceedings of the IEEE Haptics Symposium. IEEE, 257--260.
[43]
Dan Morris, Hong Tan, Federico Barbagli, Timothy Chang, and Kenneth Salisbury. 2007. Haptic feedback enhances force skill learning. In Proceedings of the 2nd Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC’07). IEEE, 21--26.
[44]
Atsuo Murata and Hirokazu Iwase. 2001. Extending Fitts’ law to a three-dimensional pointing task. Hum. Move. Sci. 20, 6 (2001), 791--805.
[45]
Daniel Natapov, Steven J. Castellucci, and I. Scott MacKenzie. 2009. ISO 9241-9 evaluation of video game controllers. In Proceedings of Graphics Interface. Canadian Information Processing Society, 223--230.
[46]
Karin Nieuwenhuizen, Lei Liu, Robert van Liere, and Jean-Bernard Martens. 2009. Insights from dividing 3D goal-directed movements into meaningful phases. IEEE Comput. Graph. Appl. 29, 6 (2009), 44--53.
[47]
Ilana Nisky, Assaf Pressman, Carla M. Pugh, Ferdinando A. Mussa-Ivaldi, and Amir Karniel. 2011. Perception and action in teleoperated needle insertion. IEEE Trans. Haptics 4, 3 (2011), 155--166.
[48]
Allison M. Okamura, Jack T. Dennerlein, and Robert D. Howe. 1998. Vibration feedback models for virtual environments. In Proceedings of the IEEE International Conference on Robotics and Automation, Vol. 1. 674--6791.
[49]
Christopher C. Pagano and Geoffrey P. Bingham. 1998. Comparing measures of monocular distance perception: Verbal and reaching errors are not correlated. J. Exper. Psychol.: Hum. Percept. Perform. 24, 4 (1998), 1037.
[50]
Márcio S. Pinho, Doug A. Bowman, and Carla M. D. S. Freitas. 2002. Cooperative object manipulation in immersive virtual environments: framework and techniques. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology. ACM, 171--178.
[51]
Matthieu Poyade, Michael Kargas, and Victor Portela. 2014. Haptic Plug-In For Unity3D. Digital Design Studio/Glasgow School of Art.
[52]
M. Poyade, L. Molina-Tanco, A. Reyes-Lecuona, A. Langley, M. D’Cruz, E. Frutos, and S. Flores. 2012. Validation of a haptic virtual reality simulation in the context of industrial maintenance. In Proceedings of the Joint Virtual Reality Conference of ICAT, EGVE, and EuroVR. 85.
[53]
Yuan Yuan Qian and Robert J. Teather. 2017. The eyes don’t have it: an empirical comparison of head-based and eye-based selection in virtual reality. In Proceedings of the 5th Symposium on Spatial User Interaction. ACM, 91--98.
[54]
Adrian Ramcharitar and Robert John Teather. 2018. EZCursorVR: 2D selection with virtual reality head-mounted displays. In Proceedings of Graphics Interface. CIPS, 114--121.
[55]
Robin Schlünsen, Oscar Ariza, and Frank Steinicke. 2019. A VR study on freehand vs. widgets for 3D manipulation tasks. In Proceedings of Mensch und Computer. ACM, 223--233.
[56]
Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip tactile devices for virtual object manipulation and exploration. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI’17). Association for Computing Machinery, New York, NY, 3115--3119.
[57]
R. William Soukoreff and I. Scott MacKenzie. 2004. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI. Int. J. Hum.-comput. Studies 61, 6 (2004), 751--789.
[58]
Gideon Sroka, Liane S. Feldman, Melina C. Vassiliou, Pepa A. Kaneva, Raad Fayez, and Gerald M. Fried. 2010. Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room—A randomized controlled trial. Amer. J. Surg. 199, 1 (2010), 115--120.
[59]
Robert J. Teather, Daniel Natapov, and Michael Jenkin. 2010. Evaluating haptic feedback in virtual environments using ISO 9241--9. In Proceedings of the IEEE Virtual Reality Conference (VR’10). IEEE, 307--308.
[60]
Robert J. Teather and Wolfgang Stuerzlinger. 2011. Pointing at 3D targets in a stereo head-tracked virtual environment. In Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI’11). IEEE, 87--94.
[61]
Robert J. Teather and Wolfgang Stuerzlinger. 2013. Pointing at 3d target projections with one-eyed and stereo cursors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 159--168.
[62]
Colin Ware and Ravin Balakrishnan. 1994. Target acquisition in fish tank VR: The effects of lag and frame rate. In Graphics Interface. Canadian Information Processing Society, 1--1.
[63]
Robert Sessions Woodworth. 1899. Accuracy of voluntary movement. Psychol. Rev.: Monogr. Suppl. 3, 3 (1899), i.
[64]
Aileen Worden, Nef Walker, Krishna Bharat, and Scott Hudson. 1997. Making computers easier for older adults to use: Area cursors and sticky icons. In Proceedings of the CHI Conference on Human Factors in Computing Systems, Vol. 97. 266--271.
[65]
André Zenner and Antonio Krüqer. 2019. Estimating detection thresholds for desktop-scale hand redirection in virtual reality. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR’19). IEEE, 47--55.
[66]
Tian Zhou, Jackie S. Cha, Glebys T. Gonzalez, Juan P. Wachs, Chandru Sundaram, and Denny Yu. 2018. Joint surgeon attributes estimation in robot-assisted surgery. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction (HRI’18). Association for Computing Machinery, New York, NY, 285--286.

Cited By

View all
  • (2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
  • (2024)The Benefits of Near-field Manipulation and Viewing to Distant Object Manipulation in VR2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00062(408-417)Online publication date: 16-Mar-2024
  • (2024)Investigating the Effects of Avatarization and Interaction Techniques on Near-field Mixed Reality Interactions with Physical ComponentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337205030:5(2756-2766)Online publication date: 4-Mar-2024
  • Show More Cited By

Index Terms

  1. A Fitts’ Law Evaluation of Visuo-haptic Fidelity and Sensory Mismatch on User Performance in a Near-field Disc Transfer Task in Virtual Reality

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Transactions on Applied Perception
        ACM Transactions on Applied Perception  Volume 17, Issue 4
        Special Issue on SAP 2020
        October 2020
        65 pages
        ISSN:1544-3558
        EISSN:1544-3965
        DOI:10.1145/3434049
        Issue’s Table of Contents
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 14 December 2020
        Accepted: 01 August 2020
        Received: 01 July 2020
        Published in TAP Volume 17, Issue 4

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Fitts' law
        2. haptics
        3. near-field virtual reality
        4. stereo

        Qualifiers

        • Research-article
        • Research
        • Refereed

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)128
        • Downloads (Last 6 weeks)4
        Reflects downloads up to 22 Nov 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
        • (2024)The Benefits of Near-field Manipulation and Viewing to Distant Object Manipulation in VR2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00062(408-417)Online publication date: 16-Mar-2024
        • (2024)Investigating the Effects of Avatarization and Interaction Techniques on Near-field Mixed Reality Interactions with Physical ComponentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337205030:5(2756-2766)Online publication date: 4-Mar-2024
        • (2023)Stereoscopic Visual Effect Simulation of Film and Television Works Based on 3D TechnologyProceedings of the 4th International Conference on Big Data Analytics for Cyber-Physical System in Smart City - Volume 110.1007/978-981-99-0880-6_35(319-327)Online publication date: 3-Jun-2023
        • (2023)Role of Human-Centered Design in Haptic-Enabled Virtual Reality Environments’ Research and DevelopmentDesign in the Era of Industry 4.0, Volume 110.1007/978-981-99-0293-4_84(1043-1053)Online publication date: 25-Jul-2023
        • (2022)Effective Throughput Analysis of Different Task Execution Strategies for Mid-Air Fitts' Tasks in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320310528:11(3939-3947)Online publication date: Nov-2022
        • (2022)Action-Specific Perception & Performance on a Fitts's Law Task in Virtual Reality: The Role of Haptic FeedbackIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320300328:11(3715-3726)Online publication date: Nov-2022
        • (2022)Comparing the Fidelity of Contemporary Pointing with Controller Interactions on Performance of Personal Space Target Selection2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00056(404-413)Online publication date: Oct-2022
        • (2021)An Evaluation of Screen Parallax, Haptic Feedback, and Sensory-Motor Mismatch on Near-Field Perception-Action Coordination in VRACM Transactions on Applied Perception10.1145/348658318:4(1-16)Online publication date: 28-Oct-2021
        • (2021)Selection Performance Using a Smartphone in VR with Redirected InputProceedings of the 2021 ACM Symposium on Spatial User Interaction10.1145/3485279.3485292(1-12)Online publication date: 9-Nov-2021

        View Options

        Login options

        Full Access

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media