Adaptive Virtual Reality Solutions: A Literature Review
Pages 1 - 10
Abstract
Virtual Reality technology emerges as a versatile tool with applications ranging from gaming to therapy. Particularly, Adaptive Virtual Reality (AVR) stands out as a promising field, employing adaptive mechanisms to automatically customize the user experience according to individual preferences and needs. The use cases for this technology are broad, and so is the technical landscape. AVR technology enables, for instance, educational platforms that adapt to the user’s learning style, upper limb rehabilitation with auto-adjustable difficulty, and horror games that detect and incorporate the user’s most feared elements. Implementation-wise, some studies utilize Neural Networks and Support Vector Machines to adapt the system’s logic, while others use Fuzzy Logic Systems, for example. Additionally, some works integrate physiological sensors to estimate user stress, cognitive workload, or cybersickness. This technological and practical diversity poses a challenge for researchers and developers seeking to build AVR-based applications. To assist these professionals, this work reviews 30 studies that propose, develop, and assess AVR-based solutions. It provides a technological overview of these systems and classifies them into four domain groups: healthcare, learning/training, entertainment, and cybersickness mitigation. This work also presents key considerations and guidelines for designing and assessing AVR-based systems.
References
[1]
César Iván Aguilar Reyes, David Wozniak, Angel Ham, and Maryam Zahabi. 2023. Design and evaluation of an adaptive virtual reality training system. Virtual Reality 27, 3 (2023), 2509–2528. https://doi.org/10.1007/s10055-023-00827-7
[2]
Belén Rubio Ballester, Martina Maier, Daniel Alfayate Domingo, Angel Aguilar, Anna Mura, Laura Tobella Pareja, Ma Francisca Gimeno Esteve, and Paul F. M. J. Verschure. 2019. Adaptive VR-based rehabilitation to prevent deterioration in adults with cerebral palsy. International Conference on Virtual Rehabilitation, ICVR 2019-July (2019). https://doi.org/10.1109/ICVR46560.2019.8994754
[3]
Esubalew Bekele, Joshua W. Wade, Dayi Bian, Lian Zhang, Zhi Zheng, Amy Swanson, Medha Sarkar, Zachary Warren, and Nilanjan Sarkar. 2014. Multimodal interfaces and sensory fusion in VR for social interactions. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 8525, 1 (2014), 14–24. https://doi.org/10.1007/978-3-319-07458-0_2
[4]
Esubalew Bekele, Mary Young, Zhi Zheng, Lian Zhang, Amy Swanson, Rebecca Johnston, Julie Davidson, Zachary Warren, and Nilanjan Sarkar. 2013. A step towards adaptive multimodal virtual social interaction platform for children with autism. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 8010, 2 (2013), 464–473. https://doi.org/10.1007/978-3-642-39191-0_51
[5]
Kamilla Bergsnev and Ana Luisa Sánchez Laws. 2022. Personalizing virtual reality for the research and treatment of fear-related disorders: A mini review. Frontiers in Virtual Reality 3 (2022), 834004. https://doi.org/10.3389/frvir.2022.834004
[6]
Tibor Bosse, Charlotte Gerritsen, Jeroen de Man, and Suzanne Tolmeijer. 2015. Adaptive training for aggression de-escalation. In Artificial Life and Intelligent Agents: First International Symposium, ALIA 2014, Revised Selected Papers 1. Springer, 80–93. https://doi.org/10.1007/978-3-319-18084-7_7
[7]
Amal Bouatrous, Abdelkrim Meziane, Nadia Zenati, and Chafiaa Hamitouche. 2023. A new adaptive VR-based exergame for hand rehabilitation after stroke. Multimedia Systems 29, 6 (2023), 3385–3402. https://doi.org/10.1007/s00530-023-01180-0
[8]
John Brooke 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.
[9]
Francesco Chiossi, Yagiz Turgut, Robin Welsch, and Sven Mayer. 2022. Virtual Reality Adaptation Using Electrodermal Activity to Support the User Experience. Big Data and Cognitive Computing 6, 2 (2022). https://doi.org/10.3390/bdcc6020055
[10]
Edirlei Soares de Lima, Bruno M. C. Silva, and Gabriel Teixeira Galam. 2022. Adaptive virtual reality horror games based on machine learning and player modeling. Entertainment Computing 43 (2022). https://doi.org/10.1016/j.entcom.2022.100515
[11]
Tor Finseth, Michael C. Dorneich, Nir Keren, Warren D. Franke, and Stephen Vardeman. 2024. Virtual reality adaptive training for personalized stress inoculation. Human Factors (2024). https://doi.org/10.1177/00187208241241968
[12]
Loïc Fricoteaux, Indira Thouvenin, and Daniel Mestre. 2014. Gulliver: a decision-making system based on user observation for an adaptive training in informed virtual environments. Engineering Applications of Artificial Intelligence 33 (2014), 47–57. https://doi.org/10.1016/j.engappai.2014.03.005
[13]
Sylvain Le Groux, Jônatas Manzolli, and Paul F. M. J. Verschure. 2007. Vr-roboser: real-time adaptive sonification of virtual environments based on avatar behavior. In Proceedings of the 7th international conference on New interfaces for musical expression. 371–374. https://doi.org/10.1145/1279740.1279822
[14]
Guoxin Gu and Claude Frasson. 2017. Virtual sophrologist: a virtual reality neurofeedback relaxation training system. In Brain Function Assessment in Learning: First International Conference, BFAL 2017, Proceedings 1. 176–185. https://doi.org/10.1007/978-3-319-67615-9_16
[15]
Yecheng Gu, Sergey Sosnovsky, and Carsten Ullrich. 2015. Safechild: An intelligent virtual reality environment for training pedestrian safety skills. Lecture Notes in Computer Science 9307 (2015), 141–154. https://doi.org/10.1007/978-3-319-24258-3_11
[16]
David Harris, Ross Donaldson, Max Bray, Tom Arthur, Mark Wilson, and Sam Vine. 2024. Attention computing for enhanced visuomotor skill performance: Testing the effectiveness of gaze-adaptive cues in virtual reality golf putting. Multimedia Tools and Applications (2024). https://doi.org/10.1007/s11042-023-17973-4
[17]
Sergi Bermudez i Badia, Luis Velez Quintero, Monica S. Cameirao, Alice Chirico, Stefano Triberti, Pietro Cipresso, and Andrea Gaggioli. 2019. Toward emotionally adaptive virtual reality for mental health applications. IEEE journal of biomedical and health informatics 23, 5 (2019), 1877–1887. https://doi.org/10.1109/JBHI.2018.2878846
[18]
Rifatul Islam, Samuel Ang, and John Quarles. 2021. Cybersense: A closed-loop framework to detect cybersickness severity and adaptively apply reduction techniques. In 2021 IEEE Conference on virtual reality and 3d user interfaces abstracts and workshops (VRW). 148–155. https://doi.org/10.1109/VRW52623.2021.00035
[19]
Idris Jeelani, Kevin Han, and Alex Albert. 2017. Development of immersive personalized training environment for construction workers. In Computing in civil engineering 2017. 407–415. https://doi.org/10.1061/9780784480830.050
[20]
Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203–220.
[21]
Barbara Kitchenham. 2004. Procedures for performing systematic reviews. Keele, UK, Keele University 33, 2004 (2004), 1–26.
[22]
Jacob Kritikos, Georgios Alevizopoulos, and Dimitris Koutsouris. 2021. Personalized virtual reality human-computer interaction for psychiatric and neurological illnesses: A dynamically adaptive virtual reality environment that changes according to real-time feedback from electrophysiological signal responses. Frontiers in Human Neuroscience 15 (2021). https://doi.org/10.3389/fnhum.2021.596980
[23]
Carla R. Landsberg, Wendi L. Van Buskirk, Randolph S. Astwood Jr., Alyssa D. Mercado, and Anthony J. Aakre. 2010. Adaptive training considerations for use in simulation-based systems. Naval Air Warfare Center Training Systems Division: Special Report (2010), 9. https://doi.org/10.21236/ADA535421
[24]
Yining Lang, Liang Wei, Fang Xu, Yibiao Zhao, and Lap-Fai Yu. 2018. Synthesizing personalized training programs for improving driving habits via virtual reality. In 2018 IEEE conference on virtual reality and 3D user interfaces (VR). IEEE, 297–304. https://doi.org/10.1109/VR.2018.8448290
[25]
Ben Lawson. 2014. Motion sickness symptomatology and origins. In Handbook of Virtual Environment: Design, implementation, and applications (2nd ed.). Boca Raton, 532–587. https://doi.org/10.1201/b17360-29
[26]
Wanwan Li, Haikun Huang, Tomay Solomon, Behzad Esmaeili, and Lap-Fai Yu. 2022. Synthesizing personalized construction safety training scenarios for VR training. IEEE Transactions on Visualization and Computer Graphics 28, 5 (2022), 1993–2002. https://doi.org/10.1109/TVCG.2022.3150510
[27]
Hui Liang, ShiQing Liu, Yi Wang, Junjun Pan, Jialin Fu, and Yingkai Yuan. 2023. EEG-Based VR Scene Adaptive Generation System for Regulating Emotion. In 2023 9th International Conference on Virtual Reality (ICVR). 361–368. https://doi.org/10.1109/ICVR57957.2023.10169325
[28]
Yi Lin and Shunbo Wang. 2019. The study and application of adaptive learning method based on virtual reality for engineering education. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11903 LNCS (2019), 372–383. https://doi.org/10.1007/978-3-030-34113-8_31
[29]
Salvatore Livatino and Christina Hochleitner. 2008. Simple Guidelines for Testing VR Applications. https://doi.org/10.5772/5925
[30]
Andrea Mariani, Edoardo Pellegrini, Nima Enayati, Peter Kazanzides, Marco Vidotto, and Elena de Momi. 2018. Design and evaluation of a performance-based adaptive curriculum for robotic surgical training: a pilot study. In 2018 40th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, 2162–2165. https://doi.org/10.1109/EMBC.2018.8512728
[31]
Robert Mourning and Ying Tang. 2016. Virtual reality social training for adolescents with high-functioning autism. In 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 004848–004853. https://doi.org/10.1109/SMC.2016.7844996
[32]
Seyed Muhammad Hossein Mousavi, Bulat Khaertdinov, Pedro Jeuris, Enrique Hortal, Davide Andreoletti, and Silvia Giordano. 2023. Emotion recognition in adaptive virtual reality settings: Challenges and opportunities. In CEUR Workshop Proceedings, Vol. 3517. 1–20.
[33]
Ananta Ojha, Shefalika Narain, Akshay Raj, Trapty Agrawal, Bhawna Wadhwa, and Manish Joshi. 2024. Dynamic virtual reality horror sports enhanced by artificial intelligence and player modeling. Multimedia Tools and Applications (2024). https://doi.org/10.1007/s11042-024-18414-6
[34]
Thomas D. Parsons. 2021. Ethical challenges of using virtual environments in the assessment and treatment of psychopathological disorders. Journal of Clinical Medicine 10, 3 (2021), 378. https://doi.org/10.3390%2Fjcm10030378
[35]
Thomas D. Parsons, Timothy McMahan, and Justin Asbee. 2024. Feasibility study to identify machine learning predictors for a Virtual Environment Grocery Store. Virtual Reality 28, 1 (2024). https://doi.org/10.1007/s10055-023-00927-4
[36]
PEDro. 2024. PEDro scale. https://pedro.org.au/english/resources/pedro-scale/
[37]
Thiago Porcino, Erick O. Rodrigues, Flavia Bernardini, Daniela Trevisan, and Esteban Clua. 2022. Identifying cybersickness causes in virtual reality games using symbolic machine learning algorithms. Entertainment Computing 41 (2022), 100473. https://doi.org/10.1016/j.entcom.2021.100473
[38]
Lorcan Reidy, Dennis Chan, Charles Nduka, and Hatice Gunes. 2020. Facial electromyography-based adaptive virtual reality gaming for cognitive training. ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction (2020), 174–183. https://doi.org/10.1145/3382507.3418845
[39]
Aitor Rovira and Mel Slater. 2022. Encouraging bystander helping behaviour in a violent incident: a virtual reality study using reinforcement learning. Scientific Reports 12, 1 (2022). https://doi.org/10.1038/s41598-022-07872-3
[40]
Ezequiel Scott, Alvaro Soria, and Marcelo Campo. 2016. Adaptive 3D virtual learning environments—A review of the literature. IEEE Transactions on Learning technologies 10, 3 (2016), 262–276. https://doi.org/10.1109/TLT.2016.2609910
[41]
Bachar Senno and Pedro Barcha. 2018. Customizing user experience with adaptive virtual reality. In Companion Proceedings of the 23rd International Conference on Intelligent User Interfaces. Article 42. https://doi.org/10.1145/3180308.3180351
[42]
Ka-Chun Siu, Bradley J Best, Jong Wook Kim, Dmitry Oleynikov, and Frank E Ritter. 2016. Adaptive virtual reality training to optimize military medical skills acquisition and retention. Military Medicine 181, 5 (2016), 214–220. https://doi.org/10.7205/MILMED-D-15-00164
[43]
Thomas Stranick and Christian Lopez. 2022. Adaptive virtual reality exergame: Promoting physical activity among workers. Journal of Computing and Information Science in Engineering 22, 3 (2022). https://doi.org/10.1115/1.4053002
[44]
Ufuk Uyan and Ufuk Celikcan. 2024. CDMS: A real-time system for EEG-guided cybersickness mitigation through adaptive adjustment of VR content factors. Displays 83 (2024), 102704. https://doi.org/10.1016/j.displa.2024.102704
[45]
Kody Wood, Alvaro Joffre Uribe Quevedo, Lina Penuela, Sharman Perera, and Bill Kapralos. 2021. Virtual reality assessment and customization using physiological measures: A literature analysis. In Proceedings of the 23rd Symposium on Virtual and Augmented Reality. 64–73. https://doi.org/10.1145/3488162.3488228
[46]
Fei Wu and Evan Suma Rosenberg. 2022. Adaptive field-of-view restriction: Limiting optical flow to mitigate cybersickness in virtual reality. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology. 1–11. https://doi.org/10.1145/3562939.3565611
[47]
Xiaoxiao Yang, Dangxiao Wang, and Yuru Zhang. 2016. An adaptive strategy for an immersive visuo-haptic attention training game. In Haptics: Perception, Devices, Control, and Applications: 10th International Conference, EuroHaptics 2016, Proceedings, Part I 10. Springer, 441–451. https://doi.org/10.1007/978-3-319-42321-0_41
[48]
Shih-Jou Yu, Yu-Ling Hsueh, Jerry Chih-Yuan Sun, and Hao-Ze Liu. 2021. Developing an intelligent virtual reality interactive system based on the ADDIE model for learning pour-over coffee brewing. Computers and Education: Artificial Intelligence 2 (2021). https://doi.org/10.1016/j.caeai.2021.100030
[49]
Maryam Zahabi and Ashiq Mohammed Abdul Razak. 2020. Adaptive virtual reality-based training: a systematic literature review and framework. Virtual Reality 24, 4 (2020), 725–752. https://doi.org/10.1007/s10055-020-00434-w
Index Terms
- Adaptive Virtual Reality Solutions: A Literature Review
Recommendations
A Systematic literature review on implementation of virtual reality for learning
AbstractLearning in this modern era can use various kinds of technology. One of them is virtual reality. Virtual Reality is an environment generated by a computer that makes the user feel immersed with the object that is generated in their surroundings. ...
Adaptive Virtual Reality Design Methodology: In Terms of Information Transfer
The article provides an integrated analysis of practical application of virtual reality (VR) in healthcare. Modern VR products have been created for the diagnosis and treatment of post-traumatic syndrome, Alzheimer's disease, alcohol dependence, ...
Indoor skydiving in immersive virtual reality with embedded storytelling
VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and TechnologyWe describe the Virtual Jump Simulator, which allows subjects to perform an indoor parachute jump in a virtual environment. The necessity to jump physically off a platform combined with immersive virtual reality and tactile feedback creates an ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2024
346 pages
ISBN:9798400709791
DOI:10.1145/3691573
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 30 September 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
SVR 2024
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 59Total Downloads
- Downloads (Last 12 months)59
- Downloads (Last 6 weeks)54
Reflects downloads up to 20 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format