research-article

Erg-O: Ergonomic Optimization of Immersive Virtual Environments

Authors:

Roberto A. Montano Murillo,

Sriram Subramanian,

Diego Martinez PlasenciaAuthors Info & Claims

UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Pages 759 - 771

https://doi.org/10.1145/3126594.3126605

Published: 20 October 2017 Publication History

Abstract

Interaction in VR involves large body movements, easily inducing fatigue and discomfort. We propose Erg-O, a manipulation technique that leverages visual dominance to maintain the visual location of the elements in VR, while making them accessible from more comfortable locations. Our solution works in an open-ended fashion (no prior knowledge of the object the user wants to touch), can be used with multiple objects, and still allows interaction with any other point within user's reach. We use optimization approaches to compute the best physical location to interact with each visual element, and space partitioning techniques to distort the visual and physical spaces based on those mappings and allow multi-object retargeting. In this paper we describe the Erg-O technique, propose two retargeting strategies and report the results from a user study on 3D selection under different conditions, elaborating on their potential and application to specific usage scenarios.

Supplementary Material

suppl.mov (uistf1663-file3.mp4)

Supplemental video

Download
33.10 MB

References

[1]

Azmandian, Mahdi, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D Wilson. Haptic retargeting: Dynamic repurposing of passive haptics for enhanced virtual reality experiences. in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2016. ACM.

Digital Library

[2]

Bachynskyi, Myroslav, Gregorio Palmas, Antti Oulasvirta, and Tino Weinkauf, Informing the design of novel input methods with muscle coactivation clustering. ACM Transactions on Computer-Human Interaction (TOCHI), 2015. 21(6): p. 30.

Digital Library

[3]

Badler, Norman I, Cary B Phillips, and Bonnie Lynn Webber, Simulating humans: computer graphics animation and control. 1993: Oxford University Press,

Digital Library

[4]

Ban, Yuki, Takashi Kajinami, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. Modifying an identified curved surface shape using pseudo-haptic effect. in Haptics Symposium (HAPTICS), 2012 IEEE. 2012. IEEE.

Digital Library

[5]

Banakou, Domna, Raphaela Groten, and Mel Slater, Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. Proceedings of the National Academy of Sciences, 2013. 110(31): p. 12846--12851.

[6]

Banakou, Domna and Mel Slater, Body ownership causes illusory self-attribution of speaking and influences subsequent real speaking. Proceedings of the National Academy of Sciences, 2014. 111(49): p. 17678--17683.

[7]

Barbagli, Federico, Ken Salisbury, Cristy Ho, Charles Spence, and Hong Z Tan, Haptic discrimination of force direction and the influence of visual information. ACM Transactions on Applied Perception (TAP), 2006. 3(2): p. 125--135.

Digital Library

[8]

Bertsimas, Dimitris and John Tsitsiklis, Simulated annealing. Statistical science, 1993. 8(1): p. 10--15.

[9]

Borg, Gunnar, Borg's perceived exertion and pain scales. 1998: Human kinetics,

[10]

Boring, Sebastian, Marko Jurmu, and Andreas Butz. Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. in Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7. 2009. ACM.

Digital Library

[11]

Bowman, Doug A and Larry F Hodges. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. in Proceedings of the 1997 symposium on Interactive 3D graphics. 1997. ACM.

Digital Library

[12]

Bricken, Meredith, Virtual reality learning environments: potentials and challenges. ACM SIGGRAPH Computer Graphics, 1991. 25(3): p. 178184.

Digital Library

[13]

Burdorf, Alex and Judith Laan, Comparison of methods for the assessment of postural load on the back. Scandinavian journal of work, environment & health, 1991: p. 425--429, URL: http://www.jstor.org/stable/40965930

[14]

Burns, Eric, Sharif Razzaque, Abigail T Panter, Mary C Whitton, Matthew R McCallus, and Frederick P Brooks. The hand is slower than the eye: A quantitative exploration of visual dominance over proprioception. in Virtual Reality, 2005. Proceedings. VR 2005. IEEE. 2005. IEEE.

Digital Library

[15]

Bustamante, Ernesto A and Randall D Spain. Measurement invariance of the Nasa TLX. in Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 2008. SAGE Publications Sage CA: Los Angeles, CA.

[16]

Cerný, Vladimír, Thermodynamical approach to the traveling salesman problem: An efficient simulation algorithm. Journal of optimization theory and applications, 1985. 45(1): p. 41--51.

[17]

Cheng, Lung-Pan, Eyal Ofek, Christian Holz, Hrvoje Benko, and Andrew D Wilson. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2017. ACM.

Digital Library

[18]

Cheng, Yi-Ling and Kelly S Mix, Spatial training improves children's mathematics ability. Journal of Cognition and Development, 2014. 15(1): p. 2--11.

[19]

Colman, Andrew M, A dictionary of psychology. 2015: Oxford University Press, USA,

[20]

Dunne, Alan, Son Do-Lenh, Gearóid Ó'Laighin, Chia Shen, and Paolo Bonato. Upper extremity rehabilitation of children with cerebral palsy using accelerometer feedback on a multitouch display. in Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE. 2010. IEEE.

[21]

Dünser, Andreas, Karin Steinbügl, Hannes Kaufmann, and Judith Glück. Virtual and augmented reality as spatial ability training tools. in Proceedings of the 7th ACM SIGCHI New Zealand chapter's international conference on Computer-human interaction: design centered HCI. 2006. ACM.

Digital Library

[22]

Flasar, Jan. Interaction Techniques for Object Selection/Manipulation in Non-Immersive Virtual Environments with Force Feedback. 2001. Eurohaptics, URL:http://www.eurohaptics.vision.ee.ethz.ch/2001/flas ar.pdf

[23]

Hincapié-Ramos, Juan David, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. in Proceedings of the 32nd annual ACM conference on Human factors in computing systems. 2014. ACM.

Digital Library

[24]

Kilteni, Konstantina, Jean-Marie Normand, Maria V Sanchez-Vives, and Mel Slater, Extending body space in immersive virtual reality: a very long arm illusion. PloS one, 2012. 7(7): p. e40867.

[25]

Kirkpatrick, Scott, C Daniel Gelatt, and Mario P Vecchi, Optimization by simulated annealing. science, 1983. 220(4598): p. 671--680, URL: http://www.jstor.org/stable/1690046

[26]

Kohli, Luv, Mary C Whitton, and Frederick P Brooks. Redirected touching: The effect of warping space on task performance. in 3D User Interfaces (3DUI), 2012 IEEE Symposium on. 2012. IEEE.

[27]

Kohli, Luv. Redirected touching: Warping space to remap passive haptics. in 3D User Interfaces (3DUI), 2010 IEEE Symposium on. 2010. IEEE.

Digital Library

[28]

Kokkinara, Elena, Konstantina Kilteni, Kristopher J Blom, and Mel Slater, First Person Perspective of Seated Participants Over a Walking Virtual Body Leads to Illusory Agency Over the Walking. Scientific Reports, 2016. 6.

[29]

Lee, Yongseok, Inyoung Jang, and Dongjun Lee. Enlarging just noticeable differences of visualproprioceptive conflict in VR using haptic feedback. in World Haptics Conference (WHC), 2015 IEEE. 2015. IEEE.

[30]

Lopez, Christopher, Pär Halje, and Olaf Blanke, Body ownership and embodiment: vestibular and multisensory mechanisms. Neurophysiologie Clinique/Clinical Neurophysiology, 2008. 38(3): p. 149161.

[31]

Matsuoka, Yoky, Sonya J Allin, and Roberta L Klatzky, The tolerance for visual feedback distortions in a virtual environment. Physiology & behavior, 2002. 77(4): p. 651--655.

[32]

McAtamney, Lynn and E Nigel Corlett, RULA: a survey method for the investigation of work-related upper limb disorders. Applied ergonomics, 1993. 24(2): p. 91--99.

[33]

Normand, Jean-Marie, Elias Giannopoulos, Bernhard Spanlang, and Mel Slater, Multisensory stimulation can induce an illusion of larger belly size in immersive virtual reality. PloS one, 2011. 6(1): p. e16128.

[34]

Ott, Michela and Laura FREINA. A literature review on immersive virtual reality in education: state of the art and perspectives. in Conference proceedings of eLearning and Software for Education (eLSE). 2015. Universitatea Nationala de Aparare Carol I, URL: https://www.ceeol.com/search/article-detail?id=289829

[35]

Plantard, Pierre, Edouard Auvinet, Anne-Sophie Le Pierres, and Franck Multon, Pose estimation with a kinect for ergonomic studies: Evaluation of the accuracy using a virtual mannequin. Sensors, 2015. 15(1): p. 1785--1803.

[36]

Poupyrev, Ivan, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. The go-go interaction technique: non-linear mapping for direct manipulation in VR. in Proceedings of the 9th annual ACM symposium on User interface software and technology. 1996. ACM.

Digital Library

[37]

Richardson, Anthony E, Daniel R Montello, and Mary Hegarty, Spatial knowledge acquisition from maps and from navigation in real and virtual environments. Memory & cognition, 1999. 27(4): p. 741--750.

[38]

Robles-De-La-Torre, Gabriel and Vincent Hayward, Force can overcome object geometry in the perception of shape through active touch. Nature, 2001. 412(6845): p. 445--448.

[39]

Sanchez-Vives, Maria V and Mel Slater, From presence to consciousness through virtual reality. Nature Reviews Neuroscience, 2005. 6(4): p. 332--339.

[40]

Satava, Richard M, Virtual reality surgical simulator. Surgical endoscopy, 1993. 7(3): p. 203--205.

[41]

Seymour, Neal E, Anthony G Gallagher, Sanziana A Roman, Michael K O'brien, Vipin K Bansal, Dana K Andersen, and Richard M Satava, Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Annals of surgery, 2002. 236(4): p. 458--464, URL: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC142260 0/

[42]

Spillmann, Jonas, Stefan Tuchschmid, and Matthias Harders, Adaptive space warping to enhance passive haptics in an arthroscopy surgical simulator. IEEE transactions on visualization and computer graphics, 2013. 19(4): p. 626--633.

Digital Library

[43]

Steuer, Jonathan, Defining virtual reality: Dimensions determining telepresence. Journal of communication, 1992. 42(4): p. 73--93.

[44]

Tolani, Deepak, Ambarish Goswami, and Norman I Badler, Real-time inverse kinematics techniques for anthropomorphic limbs. Graphical models, 2000. 62(5): p. 353--388.

Digital Library

[45]

Valkov, Dimitar, Alexander Giesler, and Klaus H Hinrichs. Imperceptible depth shifts for touch interaction with stereoscopic objects. in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2014. ACM.

Digital Library

[46]

Wachs, Juan Pablo, Mathias Kölsch, Helman Stern, and Yael Edan, Vision-based hand-gesture applications. Communications of the ACM, 2011. 54(2): p. 60--71.

Digital Library

[47]

Wiktorin, Christina, Lena Karlqvist, and Jörgen Winkel, Validity of self-reported exposures to work postures and manual materials handling. Scandinavian journal of work, environment & health, 1993: p. 208--214, URL: http://www.jstor.org/stable/40966137

[48]

Zhai, Shumin and Paul Milgram. Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices. in Proceedings of the SIGCHI conference on Human factors in computing systems. 1998. ACM Press/Addison-Wesley Publishing Co.

Digital Library

Cited By

He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Li YXu HKitamura YTag BFujita KKostakos VKay JHoang T(2024)Towards using Eye Gaze Redirection in Immersive Reading Tasks for Visual Fatigue ReductionCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678474(607-611)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678474
Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Show More Cited By

Index Terms

Erg-O: Ergonomic Optimization of Immersive Virtual Environments
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Virtual Reality and Ergonomics: Making the Immersive Experience
Design, User Experience, and Usability: Design for Contemporary Technological Environments
Abstract
The hardware requirements of Virtual Reality (VR) environments are more affordable each day. Users can be immersed in virtual environments by different technologies but the most affordable immersive technology with enough feature is Head-mounted ...
iTeach: ergonomic evaluation using avatars in immersive environments
UAHCI'07: Proceedings of the 4th international conference on Universal access in human computer interaction: coping with diversity

This paper describes an approach to use virtual reality technology and motion capturing for the immersive teaching of virtual humans. A combination of direct and indirect interaction as well as 2D list style menus and 3D dialogs has been realized to ...
Virtual Reality and Artificial Intelligence in Mobile Computing and Applied Ergonomics: A Bibliometric and Content Analysis
Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Human Communication, Organization and Work
Abstract
Virtual Reality (VR) is a budding field in the realm of technology, and it also happens to be one of the main sub-topics entwined with the field of Artificial Intelligence (AI). The main idea of VR also revolves around Virtual Environments. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

October 2017

870 pages

ISBN:9781450349819

DOI:10.1145/3126594

General Chair:
Krzysztof Gajos
Harvard University
,
Program Chairs:
Jennifer Mankoff
Carnegie Mellon University
,
Chris Harrison
Carnegie Mellon University

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Mexican National Council of Science and Technology (CONACyT)

Conference

UIST '17

Sponsor:

UIST '17: The 30th Annual ACM Symposium on User Interface Software and Technology

October 22 - 25, 2017

QC, Québec City, Canada

Acceptance Rates

UIST '17 Paper Acceptance Rate 73 of 324 submissions, 23%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

62
Total Citations
View Citations
1,171
Total Downloads

Downloads (Last 12 months)150
Downloads (Last 6 weeks)15

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Li YXu HKitamura YTag BFujita KKostakos VKay JHoang T(2024)Towards using Eye Gaze Redirection in Immersive Reading Tasks for Visual Fatigue ReductionCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678474(607-611)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678474
Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Li ZGebhardt CInglin YSteck NStreli PHolz C(2024)SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM ReasoningProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676470(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676470
Ponton JKeshavarz RBeacco APelechano N(2024)Stretch your reach: Studying Self-Avatar and Controller Misalignment in Virtual Reality InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642268(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642268
Zenner AKarr CFeick MAriza OKrüger A(2024)Beyond the Blink: Investigating Combined Saccadic & Blink-Suppressed Hand Redirection in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642073(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642073
Benda BRheault BLin YRagan E(2024)Examining Effects of Technique Awareness on the Detection of Remapped Hands in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337205430:5(2651-2661)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372054
Wu JWang LIm SLam C(2024)EEBA: Efficient and ergonomic Big-Arm for distant object manipulation in VRInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103273188(103273)Online publication date: Aug-2024
https://doi.org/10.1016/j.ijhcs.2024.103273
Kartick PUribe-Quevedo ARojas D(2023)Piecewise: A Non-Isomorphic 3D Manipulation Technique That Factors Upper-Limb ErgonomicsVirtual Worlds10.3390/virtualworlds20200092:2(144-161)Online publication date: 17-May-2023
https://doi.org/10.3390/virtualworlds2020009
Groth CScholz TCastillo STauscher JMagnor M(2023)Instant Hand Redirection in Virtual Reality Through Electrical Muscle Stimulation-Triggered Eye BlinksProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615717(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615717
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents