Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Development of a speed protector to optimize user experience in 3D virtual environments

Published: 25 June 2024 Publication History

Highlights

A minimum-jerk speed profile is applied to virtual locomotion.
The embedded speed protector helps reducing cybersickness while maintaining the same mental workload level.
Not only acceleration, but also jerk affect user experience during locomotion.

Abstract

Virtual walking in virtual environments (VEs) requires locomotion interfaces, especially when the available physical environment is smaller than the virtual space due to virtual reality facilities limitations; many navigation approaches have been proposed according to different input conditions, target selection and speed selection. With current technologies, the virtual locomotion speed for most VR systems relies primarily on rate-control devices (e.g., joystick). The user has to manage manual adaptation of the speed, based on the size of the VE and personal preferences. However, this method cannot provide optimal speeds for locomotion as the user tends to change the speed involuntarily due to non-desired issues including collisions or simulator sickness; in this case, the user may have to adjust the speed frequently and unsmoothly, worsening the situation. Therefore, we designed a motion protector that can be embedded into the locomotion system to provide optimal speed profiles. The optimization process aims at minimizing the total jerk when the user translates from an initial position to a target, which is a common rule of the human motion model. In addition to minimization, we put constraints on speed, acceleration and jerk so that they do not exceed specific thresholds. The speed protector is formulated mathematically and solved analytically in order to provide a smooth navigation experience with a minimum jerk of trajectory. The assessment of the speed protector was conducted in a user study measuring user experience with a simulator sickness questionnaire, event-related skin conductance responses (ER-SCR), and a NASA-TLX questionnaire, showing that the designed speed protector can provide more natural and comfortable user experience with appropriate acceleration and jerk as it avoids abrupt speed profiles.

References

[1]
J. Akyeampong, S. Udoka, G. Caruso, M. Bordegoni, Evaluation of hydraulic excavator humanmachine interface concepts using nasa tlx, Int. J. Ind. Ergon. 44 (3) (2014) 374–382,.
[2]
F. Argelaguet, Adaptive navigation for virtual environments, 2014 IEEE Symposium on 3D User Interfaces (3DUI), IEEE, 2014, pp. 123–126,.
[3]
F. Argelaguet, C. Andujar, Automatic speed graph generation for predefined camera paths, in: Taylor R., Boulanger P., Krüger A., Olivier P. (Eds.), Smart Graphics, Springer Berlin Heidelberg, Berlin, Heidelberg, 2010, pp. 115–126,.
[4]
J.E. Bos, W. Bles, E.L. Groen, A theory on visually induced motion sickness, Displays 29 (2) (2008) 47–57,.
[5]
J.-R. Chardonnet, M.A. Mirzaei, F. Mérienne, Features of the postural sway signal as indicators to estimate and predict visually induced motion sickness in virtual reality, International Journal of HumanComputer Interaction 33 (10) (2017) 771–785,.
[6]
G. Cirio, M. Marchal, A.-H. Olivier, J. Pettre, Kinematic evaluation of virtual walking trajectories, IEEE Trans. Vis. Comput. Graph. 19 (4) (2013) 671–680,.
[7]
G. Clément, O. Deguine, M. Bourg, A.P.-L. Traon, Effects of vestibular training on motion sickness, nystagmus, and subjective vertical, J. Vestibular Res. 17 (5, 6) (2007) 227–237.
[8]
M. Cordeil, T. Dwyer, K. Klein, B. Laha, K. Marriott, B.H. Thomas, Immersive collaborative analysis of network connectivity: cave-style or head-mounted display?, IEEE Trans. Vis. Comput. Graph. 23 (1) (2016) 441–450,.
[9]
P. Crossland, K. Rich, Validating a model of the effects of ship motion on postural stability, International Conference of Environmental Ergonomics, 77, 1998, pp. 385–388.
[10]
S. Davis, K. Nesbitt, E. Nalivaiko, A systematic review of cybersickness, Proceedings of the 2014 Conference on Interactive Entertainment, ACM, New York, NY, USA, 2014, pp. 8:1–8:9,.
[11]
M.S. Dennison, A.Z. Wisti, M. D’Zmura, Use of physiological signals to predict cybersickness, Displays 44 (2016) 42–52,.
[12]
S.M. Ebenholtz, Motion sickness and oculomotor systems in virtual environments, Presence: Teleoperators & Virtual Environments 1 (3) (1992) 302–305,.
[13]
N. Elmqvist, P. Tsigas, A taxonomy of 3d occlusion management techniques, 2007 IEEE Virtual Reality Conference, IEEE, 2007, pp. 51–58,.
[14]
J. Eriksson, L. Svensson, Tuning for Ride Quality in Autonomous Vehicle Application to Linear Quadratic Path Planning Algorithm, Uppsala University, 2015.
[15]
T. Flash, N. Hogan, The coordination of arm movements: an experimentally confirmed mathematical model, J. Neurosci. 5 (7) (1985) 1688–1703,.
[16]
J. Förstberg, Ride Comfort and Motion Sickness in Tilting Trains, KTH Royal Institute of Technology, 2000.
[17]
Frey, D., 1998. 16.881 Robust System Design. Massachusetts Institute of Technology: MIT OpenCourseWare. License: Creative Commons BY-NC-SA.
[18]
A. Galecki, T. Burzykowski, Linear mixed effects models using r. : A Step-by-Step approach, 2013,.
[19]
J. Gao, K. Chen, Frequency-Domain simulation and analysis of vehicle ride comfort based on virtual proving ground, International Journal of Intelligent Engineering and Systems 4 (3) (2011) 1–8,.
[20]
Guennebaud, G., Jacob, B., et al., 2010. Eigen v3.
[21]
C.M. Harris, D.M. Wolpert, Signal-dependent noise determines motor planning, Nature 394 (6695) (1998) 780–784,.
[22]
S.G. Hart, Nasa-task load index (nasa-tlx); 20 years later, Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50 (9) (2006) 904–908,.
[23]
H. Hicheur, Q.-C. Pham, G. Arechavaleta, J.-P. Laumond, A. Berthoz, The formation of trajectories during goal-oriented locomotion in humans. i. a stereotyped behaviour, European Journal of Neuroscience 26 (8) (2007) 2376–2390,.
[24]
N. Hogan, An organizing principle for a class of voluntary movements, J. Neurosci. 4 (11) (1984) 2745–2754,.
[25]
T. Igarashi, R. Kadobayashi, K. Mase, H. Tanaka, Path drawing for 3d walkthrough, Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, 1998, pp. 173–174,.
[26]
ISO, Mechanical Vibration and shock- Evaluation of human exposure to whole-body vibration- Part 1- General Requirements, International Organization for Standardization, Geneva, Switzerland, 1997.
[27]
ISO 9241-210, 2019. Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems. International Organization for Standardization. Geneva, Switzerland.
[28]
A. Kemeny, P. George, F. Mérienne, F. Colombet, New vr navigation techniques to reduce cybersickness, Electronic Imaging 2017 (3) (2017) 48–53,.
[29]
R.S. Kennedy, N.E. Lane, K.S. Berbaum, M.G. Lilienthal, Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness, Int. J. Aviat. Psychol. 3 (3) (1993) 203–220,.
[30]
A.S. Kilinç, T. Baybura, Determination of minimum horizontal curve radius used in the design of transportation structures, depending on the limit value of comfort criterion lateral jerk, TS06G-Engineering Surveying, Machine Control and Guidance (2012).
[31]
A. Kulik, Building on realism and magic for designing 3d interaction techniques, IEEE Comput. Graph. Appl. 29 (6) (2009) 22–33,.
[32]
J.J. LaViola Jr, E. Kruijff, R.P. McMahan, D. Bowman, I.P. Poupyrev, 3D user interfaces: theory and practice, 2, Addison-Wesley Professional, 2017.
[33]
T. Magaki, M. Vallance, Developing an accessible evaluation method of vr cybersickness, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019, pp. 1072–1073,.
[34]
Makowski, D., Pham, T., Lau, Z. J., Brammer, J.C., Lespinasse, F., Pham, H., Schlzel, C., S H Chen, A., 2020. Neurokit2: A python toolbox for neurophysiological signal processing. 10.5281/ZENODO.3597887.
[35]
W.E. Marsh, M. Putnam, J.W. Kelly, V.J. Dark, J.H. Oliver, The cognitive implications of semi-natural virtual locomotion, 2012 IEEE Virtual Reality Workshops (VRW), IEEE, 2012, pp. 47–50,.
[36]
F. Merienne, Virtual Reality: Principles and Applications, Encyclopedia of Computer Science and Technology, Second Edition, 2017, CRC Press, 2016, pp. 1–11,.
[37]
I. Milleville-Pennel, C. Charron, Do mental workload and presence experienced when driving a real car predispose drivers to simulator sickness? an exploratory study, Accid. Anal. Prev. 74 (2015) 192–202,.
[38]
K. Mombaur, J.-P. Laumond, E. Yoshida, An optimal control model unifying holonomic and nonholonomic walking, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots, IEEE, Daejeon, South Korea, 2008, pp. 646–653,.
[39]
S.A.E. Nooij, P. Pretto, D. Oberfeld, H. Hecht, H.H. Blthoff, Vection is the main contributor to motion sickness induced by visual yaw rotation: implications for conflict and eye movement theories, PLoS ONE 12 (4) (2017) 1–19,.
[40]
C.M. Oman, Motion sickness: a synthesis and evaluation of the sensory conflict theory, Can. J. Physiol. Pharmacol. 68 (2) (1990) 294–303,.
[41]
C.M. Oman, Sensory conflict theory and space sickness: our changing perspective, J. Vestibular Res. 8 (1) (1998) 51–56,.
[42]
C. Papaxanthis, V. Dubost, T. Pozzo, Similar planning strategies for whole-body and arm movements performed in the sagittal plane, Neuroscience 117 (4) (2003) 779–783,.
[43]
T.D. Parsons, L. Cosand, C. Courtney, A. Iyer, A.A. Rizzo, Neurocognitive workload assessment using the virtual reality cognitive performance assessment test, International Conference on Engineering Psychology and Cognitive Ergonomics, Springer, 2009, pp. 243–252,.
[44]
E. Paschalidis, C.F. Choudhury, S. Hess, Combining driving simulator and physiological sensor data in a latent variable model to incorporate the effect of stress in car-following behaviour, Analytic Methods in Accident Research 22 (2019) 100089,.
[45]
Q.-C. Pham, H. Hicheur, G. Arechavaleta, J.-P. Laumond, A. Berthoz, The formation of trajectories during goal-oriented locomotion in humans. II. a maximum smoothness model, European Journal of Neuroscience 26 (8) (2007) 2391–2403,.
[46]
J. Plouzeau, J.-R. Chardonnet, F. Merienne, Using cybersickness indicators to adapt navigation in virtual reality: a pre-study, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, 2018, pp. 661–662,.
[47]
R Core Team, 2020. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. Vienna, Austria.
[48]
S. Razzaque, Redirected Walking, University of North Carolina at Chapel Hill, USA, 2005.
[49]
F. Rebelo, P. Noriega, E. Duarte, M. Soares, Using virtual reality to assess user experience, Human Factors: The Journal of the Human Factors and Ergonomics Society 54 (6) (2012) 964–982,.
[50]
B. Reimer, B. Mehler, The impact of cognitive workload on physiological arousal in young adult drivers: a field study and simulation validation, Ergonomics 54 (10) (2011) 932–942,.
[51]
P. Renner, T. Dankert, D. Schneider, N. Mattar, T. Pfeiffer, Navigating and Selecting in the Virtual Supermarket: Review and Update of Classic Interaction Techniques, Virtuelle und Erweiterte Realität 7 Workshop der GIFachgruppe VRAR, Stuttgart, 2010, pp. 71–82.
[52]
G.E. Riccio, T.A. Stoffregen, An ecological theory of motion sickness and postural instability, Ecological psychology 3 (3) (1991) 195–240,.
[53]
M.J.E. Richardson, T. Flash, Comparing smooth arm movements with the two-thirds power law and the related segmented-control hypothesis, J. Neurosci. 22 (18) (2002) 8201–8211,.
[54]
J.M. Riley, D.B. Kaber, The effects of visual display type and navigational aid on performance, presence, and workload in virtual reality training of telerover navigation, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 43, SAGE Publications Sage CA: Los Angeles, CA, 1999, pp. 1251–1255,.
[55]
A. Rolnick, R.E. Lubow, Why is the driver rarely motion sick? the role of controllability in motion sickness, Ergonomics 34 (7) (1991) 867–879,.
[56]
E.P. Shaw, J.C. Rietschel, B.D. Hendershot, A.L. Pruziner, M.W. Miller, B.D. Hatfield, R.J. Gentili, Measurement of attentional reserve and mental effort for cognitive workload assessment under various task demands during dual-task walking, Biol. Psychol. 134 (2018) 39–51,.
[57]
M. Sheik-Nainar, D. Kaber, S. Hsiang, C. Pankok Jr, M. Zahabi, Influence of cognitive and perceptual processing on multitask performance with locomotion, Theoretical Issues in Ergonomics Science 16 (3) (2015) 273–298,.
[58]
D. Sidobre, K. Desormeaux, Smooth cubic polynomial trajectories for human-Robot interactions, Journal of Intelligent & Robotic Systems 95 (3–4) (2019) 851–869,.
[59]
R.H.Y. So, The search for a cybersickness dose value, Proceedings of HCI International (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Ergonomics and User Interfaces-Volume I - Volume I, L. Erlbaum Associates Inc., Hillsdale, NJ,USA, 1999, pp. 152–156.
[60]
A. Somrak, I. Humar, M.S. Hossain, M.F. Alhamid, M.A. Hossain, J. Guna, Estimating VR sickness and user experience using different HMD technologies: an evaluation study, Future Generation Computer Systems 94 (2019) 302–316,.
[61]
J.L. Souman, P.R. Giordano, M. Schwaiger, I. Frissen, T. Thümmel, H. Ulbrich, A.D. Luca, H.H. Bülthoff, M.O. Ernst, Cyberwalk: enabling unconstrained omnidirectional walking through virtual environments, ACM Trans. Appl. Percept. 8 (4) (2008) 25:1–25:22,.
[62]
K.M. Stanney, R.R. Mourant, R.S. Kennedy, Human factors issues in virtual environments: areview of the literature, Presence 7 (4) (1998) 327–351,.
[63]
T.A. Stoffregen, L. Smart, Postural instability precedes motion sickness, Brain Res. Bull. 47 (5) (1998) 437–448,.
[64]
C. Su, Chapter 4: Utilization of Orthogonal Arrays, Quality Engineering: Off-Line Methods and Applications, CRC Press, USA, Florida, 2013, pp. 57–77,.
[65]
J. Takatalo, T. Kawai, J. Kaistinen, G. Nyman, J. Häkkinen, User experience in 3d stereoscopic games, Media Psychol. 14 (4) (2011) 387–414,.
[66]
A. Tamura, T. Iwamoto, H. Ozaki, M. Kimura, Y. Tsujimoto, Y. Wada, Wrist-Worn electrodermal activity as a novel neurophysiological biomarker of autonomic symptoms in spatial disorientation, Front. Neurol. 9 (December) (2018) 1–11,.
[67]
Y. Uno, M. Kawato, R. Suzuki, Formation and control of optimal trajectory in human multijoint arm movement, Biol. Cybern. 61 (2) (1989) 89–101,.
[68]
Y. Wang, J.-R. Chardonnet, F. Merienne, VR Sickness Prediction for Navigation in Immersive Virtual Environments using a Deep Long Short Term Memory Model, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE, Osaka, Japan, 2019, pp. 1874–1881,.
[69]
N.A. Webb, M.J. Griffin, Eye movement, vection, and motion sickness with foveal and peripheral vision, Aviation Space and Environmental Medicine 74 (6) (2003) 622–625.
[70]
C. Wienrich, C.K. Weidner, C. Schatto, D. Obremski, J.H. Israel, A virtual nose as a rest-frame-the impact on simulator sickness and game experience, 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), IEEE, 2018, pp. 1–8,.
[71]
C.A. Zanbaka, B.C. Lok, S.V. Babu, A.C. Ulinski, L.F. Hodges, Comparison of path visualizations and cognitive measures relative to travel technique in a virtual environment, IEEE Trans. Vis. Comput. Graph. 11 (6) (2005) 694–705,.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image International Journal of Human-Computer Studies
International Journal of Human-Computer Studies  Volume 147, Issue C
Mar 2021
151 pages

Publisher

Academic Press, Inc.

United States

Publication History

Published: 25 June 2024

Author Tags

  1. Virtual reality
  2. Navigation
  3. Virtual walking
  4. Minimum jerk
  5. User experience

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Nov 2024

Other Metrics

Citations

View Options

View options

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media