Abstract
The evolving complexity of Virtual Reality (VR) technologies necessitates an in-depth investigation of the VR features and their specific utility. Although VR is utilized across various skill-training applications, its successful deployment depends on both technical maturity and context-specific suitability. A comprehensive understanding of advanced VR features, both technical and experiential, their prospective impact on designated learning outcomes, and the application of appropriate assessment methodologies is essential for the effective utilization of VR technologies. This systematic literature review explored the inherent associations between various VR features employed in professional training environments and their impact on learning outcomes. Furthermore, this review scrutinizes the assessment techniques employed to gauge the effects of VR applications in various learning scenarios. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method was used to systematically select 50 empirical VR studies sourced from three (03) academic databases. The analysis of these articles revealed complex, context-dependent relationships between VR features and their impact on professional training, with a pronounced emphasis on skill-based learning outcomes over cognitive and affective ones. This review also highlights the predominantly subjective nature of the assessment methods used to measure the effects of VR training. Additionally, the findings call for further empirical exploration in novel skill training contexts encompassing cognitive and affective learning outcomes, as well as other potential external factors that may influence learning outcomes in VR.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Virtual Reality (VR) is a computer-generated simulation technology that combines computer graphics, artificial intelligence (AI), sensor technology, and parallel processing technology (Chavez & Bayona, 2018). First emerging in the 1960s, VR has evolved into a wide range of modalities such as Head Mounted Displays (HMDs), creating a more immersive experience in comparison to Cave Automatic Virtual Environment (CAVE VR) systems because of the higher sensory stimuli it offers (Slater & Sanchez-Vives, 2016). Other non-immersive VR systems facilitate user interaction in traditional interfaces by allowing the user to look into the virtual environment from outside instead of being surrounded by it; for example, in desktop screens and web-based environments with mice and keyboards (Zeng & Richardson, 2016).
VR has evolved from its origins in entertainment to serving many innovative purposes including education and training. Its use in professional training, which emphasizes mastering the complex skills essential for applying learned principles in real-world vocational and professional contexts, stands out as a notable application (Renganayagalu et al., 2021). Various industries, including aviation, processing, healthcare, energy, space, industrial robotics programming, and seafarer training, have enthusiastically adopted VR for professional training (Kaplan et al., 2021; Mallam et al., 2019; Moglia et al., 2016; Nathanael et al., 2016; Nazir et al., 2015). This shift has prompted research to explore new VR technologies and features to enhance their efficiency in various professional training contexts. For example, a literature review by Jensen and Konradsen (2018) identified a few cognitive and motor skill training situations where using HMD VRs would be beneficial over other alternatives. Suh and Prophet (2018) proposed a framework that examined the interplay among technological stimuli, cognitive and affective reactions, and individual differences in VR applications within the domains of business, marketing, and education. Chavez and Bayona (2018) conducted a systematic literature review to identify various VR features and their impacts on the learning process. Radianti et al. (2020) explored immersive VR platforms in the context of professional training largely focusing on a range of learning theories, as well as design elements of VR applications and learning contents. In recent systematic reviews, Matovu et al. (2022) examined the impact of various sensory and actional design features of VR on science teaching and learning, while Gu et al. (2023) explored the influence of different technical features of VR on autonomy, human-computer interaction, and presence during training.
However, existing research on VR features and their application in professional training has not thoroughly explored the specific effects of VR features on different types of professional skill training and their corresponding learning outcomes, indicating a gap in the literature in this area. The absence of insight into whether different VR features positively or negatively affect specific types of skill training served as the motivation for this review. Understanding the specific effects of VR features on diverse skill training and associated learning outcomes, along with knowledge of suitable methods for evaluating these effects, would enhance the applicability of VR for more targeted learning strategies. Therefore, the results of this systematic literature review could inform future VR hardware and software development to cater more effectively to specific educational and training requirements.
1.1 Theoretical Background
A thorough comprehension of VR’s foundational influence on learning processes is required to understand its effect on training. This encompasses recognizing pertinent learning theories, pinpointing which learning types excel with VR, and selecting the best-suited VR technologies. While research has delved into VR’s multifaceted role in training, the findings are often disparate and tailored to specific contexts (Baceviciute et al., 2022; Dalgarno & Lee, 2010; Makransky & Lilleholt, 2018; Makransky & Petersen, 2019).
In order to elucidate the mechanism behind learning in VR, Loke (2015) unveiled 11 theories in a comprehensive review of 80 studies. These theories include experiential learning, situated learning and self-efficacy, along with constructivist learning theories. While constructivism is often the primary theoretical foundation for learning in virtual environments (Mikropoulos & Natsis, 2011), other learning mechanisms, such as reflection, verbal interactions, mental operations and vicarious experiences, are equally relevant within VR training. However, there is no “one theory fits all” due to their reliance on specific technical and experiential VR features, such as avatars, interactivity, presence, immersivity, fidelity, and user embodiment to explain the learning process in VR. Makransky and Lilleholt (2018) also demonstrated how VR features play a mediating role between technology and essential cognitive-affective factors germane to learning in an empirical context.
Similarly, in an effort to analyse learning outcomes from a pedagogical perspective, Kraiger et al. (1993) delineated a framework that categorizes the outcomes into three distinct types: cognitive, skill-based, and affective. This framework is grounded in the earlier works of Bloom et al.’s (1956) taxonomy of cognitive learning and Gagne’s (1984) theories of affective learning. Studies focusing on VR training have sporadically addressed these learning outcomes, taking advantage of VR’s ability to facilitate 3D spatial representation, immersive experiences, real-time and intuitive manipulation of virtual worlds within a single multisensory visual interaction system (Mikropoulos & Natsis, 2011).
These learning theories and associated constructs, outdated by advances in learning technologies, often require revisits to consider emerging educational methods and technologies (Hammad et al., 2020). In exploring the effect of VR technology on learning, Makransky and Petersen (2019) identified two learning paths, affective and cognitive learning, where the learning process is more closely linked with VR features than their usability. In empirical studies, the 3D features of VR have been found to be beneficial for higher-level cognitive learning outcomes, whereas interactivity and haptic feedback are considered beneficial for active skill-based learning (Allcoat & von Mühlenen, 2018). Hoffmann et al. (2014) noted that the use of avatars in virtual environments can enhance affective learning outcomes such as goal setting. Furthermore, experiential VR features that induce subjective psychological responses, including presence and immersion, are intrinsically linked to the overall learning process (Shin, 2017). Dalgarno and Lee (2010) proposed an expanded learning model for interactive 3D virtual environments. This model indicates how VR technologies featuring representational fidelity and learner interaction facilitate the construction of identity and a sense of presence for learners, which results in different learning benefits, including spatial knowledge representation, experiential learning, engagement, contextual learning and collaborative learning. Extant literature also emphasizes the need to effectively evaluate the impact of VR on learning to gauge its effectiveness (Kaplan et al., 2021; Merchant et al., 2014), allocate resources properly (Sitzmann, 2011), evaluate learners’ experiences (Radianti et al., 2020), and understand the broader applicability of VR-based training (Slater & Wilbur, 1997).
However, despite the potential benefits of VR in enhancing learning outcomes (e.g., cognitive, skill-based, or affective), there remains a significant gap in empirical research and a lack of understanding about how specific VR features, both technical and experiential, affect the different types of skill training (e.g., procedural skills, spatial skills etc.) and associated learning outcomes. Therefore, a systematic analysis of VR features’ utility relative to diverse learning outcomes is crucial for optimizing VR training interventions.
1.2 The Aim of this Study
Considering the existing theoretical gap and absence of a comprehensive framework delineating the relationship between the varied technical and experiential features of VR and their respective impacts on different skills training in a professional context, this systematic literature review sought to aggregate empirical evidence. Specifically, it aimed to elucidate how distinct VR features influence diverse learning outcomes and skill training within professional domains. In addition, this review examined diverse assessment methods in VR-based training to discern the influence of specific features within these training scenarios.
Therefore, the following research questions were formulated:
- RQ1::
-
How are technical and experiential VR features operationalized and their effects assessed within professional training contexts?
- RQ2::
-
How do these VR features influence different skill training and associated learning outcomes across diverse professional training scenarios?
2 Methods
This systematic review included primary sources related to the use of VR in professional training. The review followed The Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) protocol (Moher et al., 2009). Several inclusion and exclusion criteria were determined during the document screening process, as listed below (see Table 1).
2.1 Search Methods
The PRISMA framework is used to reduce bias with predefined approaches that enhance clarity and transparency while ensuring the replicability of data collection (Booth et al., 2016). Three (03) academic databases, Web of Science, Scopus, and Education Resources Information Center (ERIC), were used to operationalize the search using a search string (see Table 2).
The search was performed on the 5th of June 2023 in the databases without defining any time limit. All abstracts of the documents were screened based on the predefined inclusion and exclusion criteria. Qualitative synthesis of the documents followed the PICOC criteria during data extraction, as mentioned in Table 3.
2.2 Data Extraction
The document search returned 1673 records, of which 348 were identified as duplicates through conditional formatting in Excel, following Kwon et al. (2015). The abstracts of the remaining 1325 records were screened based on the inclusion and exclusion criteria. Consequently, 183 full-text records remained for further screening. The first author performed a full-text review of all the 183 studies. An inter-rater reliability check was performed while each author reviewed the dataset and articles independently. Subsequently, a crosscheck was performed to verify whether the results conformed to each other. After completing the process, a final set of 50 articles was selected for further analysis. The document selection process is depicted in the PRISMA flow diagram (see Fig. 1).
All 50 studies were qualitatively synthesized corresponding to the research questions, categorizing professional domains and identifying common VR features across diverse training contexts. We extracted the emphasis on specific VR features from each study. Qualitative synthesis was used to reveal the learning outcomes in these studies, which encompassed skill-based, cognitive, and affective domains. Our analysis also explored how VR features influence specific types of skill training in each study’s experimental context. We also examined the methods used to evaluate and measure the outcomes of various VR features in each experiment, resulting in a comprehensive understanding of their operationalization and effects in professional training scenarios, allowing for a nuanced and detailed analysis.
3 Results
3.1 VR Features
The examination of 50 studies revealed a myriad of VR features and their effects in a range of professional training contexts. In this review, healthcare-specific VR studies were the most prevalent (60%), followed by education-related studies (26%). A miscellaneous category, comprising a diverse range of VR applications, accounted for the remainder. This included police, forestry, sports, process industry, driving, language, and organizational training, each at 2% (see Fig. 2).
The technological features of VR, as identified, primarily pertain to hardware-oriented aspects, such as stereoscopic display, haptic feedback, 3D visuals, user interaction, immersivity, high-fidelity environments, multisensory integration, computer-generated real-time feedback, wider field of view, and avatars. Conversely, the experiential features identified were user-perceived and distinct from VR hardware-oriented features. These encompassed user autonomy, an enhanced sense of presence, user embodiment, exercise repeatability, and a safe environment.
It was found that not all features are concurrently used in a single VR system; instead, a common practice is to employ a mixture of different VR features in context-dependent applications. The results indicate that haptic feedback and stereoscopic displays are the most utilized VR features followed by interaction capabilities and 3D visuals as portrayed in the identified studies (see Fig. 3).
3D visuals, interactivity and haptic feedback remain the most common technical features of VR whereas stereoscopic displays, wider field of view, and multi-sensory integration appears to be the differentiating factors between HMD and non-HMD VR systems (see Table 4).
3.2 VR for Skill Training with Various Learning Outcomes
The domain-specific professional training studies identified in this review largely utilized VR for motor skill training (45%), followed by Non-Technical Skills (NTS) (15%), spatial skills (6%), problem-solving skills (2%), technical skills (8%) and procedural skills (8%), recognition and identification skills (6%), teaching skills (4%), perceptual cognitive skills (2%), and language learning skills (4%) (see Fig. 4).
This literature review identified a spectrum of VR effects on different skill training, such as positive, negative, neutral, or mixed, depending on the specific VR features employed. Here, we define the terms as follows: a ‘positive effect’ denotes an increase in learning outcomes from VR training; a ‘negative effect’ implies a reduction in learning outcomes; a ‘neutral effect’ signifies no observable difference between VR and other learning methods. Finally, a ‘mixed effect’ represents a situation where multiple VR features act together, with some being beneficial and others being non-beneficial for the learning outcome. A detailed account of the feature-specific effects of VR on various skill trainings across different domains is provided in Table 4.
By categorizing learning outcomes into skill-based (encompassing technical, procedural, motor, recognition, and identification tasks), cognitive (including spatial, problem-solving, teaching, language, and other perceptual skills), and affective (e.g., NTS) categories, it can be observed that VR training prioritizes skill-based outcomes, yielding largely positive results. Cognitive outcomes were associated with less frequent VR applications, while affective outcomes were least associated with VR training (see Fig. 5).
3.3 Assessing the Effects of VR Training
Measuring the effects of VR training has been a widely discussed topic in the literature, where the challenges of providing an objective and unbiased assessment of these effects have been highlighted (Chou & Handa, 2006; Topalli & Cagiltay, 2019). However, in the analysed studies, the assessment techniques identified were predominantly subjective, relying on methods such as self-rated scores, open-ended questions, Likert-scale surveys, and various types of psychological measures. In contrast, measuring activity or response time, movement data (e.g., eye-tracking), rate of task completion, etc. are some of the under-utilized objective assessment methods that have been employed in VR training (see Table 4).
*Positive (+), negative (−), neutral (=) and mixed effect () of different VR features in comparison to the alternative training methods.
4 Discussion
This systematic literature review delved into the operationalization of technical and experiential VR features within professional training contexts. Specifically, it examined how various skill trainings are influenced by these VR features and their associated learning outcomes across diverse professional training scenarios. This section is structured into distinct subsections, each addressing specific aspects of the research. Sections 4.1, 4.2, and 4.3 include discussions related to diverse technical and experiential VR features, as well as a comparison of the review’s findings with existing literature. Section 4.4 highlights several implications in the areas of theory, methodology, and pedagogical practice related to the findings of this study. Finally, Sect. 4.5 and 4.6 discuss potential future research directions and the inherent limitations of this literature review, respectively.
4.1 Technological Features of VR and Their Effect on Skill Training
This study identified several major technological features of VR that are widely used in professional training contexts, including stereoscopic displays, haptic feedback, 3D visuals, interactive interfaces, immersivity, high fidelity, multisensory integration, real-time feedback, and avatar representation. The split in technological characteristics between HMD and non-HMD VR manifests a clear distinction in their respective capabilities. For example, stereoscopic display and wider field of view characterise the significance of visual experience in HMD VRs, whereas interactivity and haptic feedback distinguish non-HMD VRs for their suitability for enhanced motor experiences (see Fig. 3). However, the presence of any specific VR feature can affect skill training in multiple ways, as observed in this literature review. In other words, certain technical and experiential features appear to support specific types of skill training more effectively than others. The intricate nature of these relationships can also be highly contextual (see Table 5).
First, Stereoscopic Displays significantly increase immersion in a simulated environment, providing depth perception of objects to users (Collaço et al., 2021; Colombo et al., 2014). However, perceptual irregularities in VR users may result from conflicts in depth perception among different types of screens (Hoffman et al., 2008; Wood et al., 2021). Stereoscopic displays combined with haptic force-feedback could also make VR systems particularly suitable for motor skill training (Kaber et al., 2014), although individual differences in depth perception capabilities may affect training performance in stereoscopic VR simulators (Hattori et al., 2022).
Haptic Feedback activation mechanisms have been probed in various ways in the context of human performance testing. For example, it guides and reduces the information processing load of users and avoids unnecessary actions (Rosenberg, 1993). The advantages of haptic feedback in VR are realized in different contexts, such as increasing the fidelity of synthetic bone simulation (Stirling et al., 2014), assisting psychomotor skill training in endoscopic skull-based surgery (Won et al., 2018), and hip fracture surgery simulation (Rölfing et al., 2020), thereby becoming an indispensable part of laparoscopic surgical training (Liu et al., 2018). Haptic feedback is also presumed to increase the sense of presence and the consequent task performance in VR (Kaber & Zhang, 2011). In addition, haptic feedback is considered one of the defining features of VR that facilitates user embodiment during a reading task (Baceviciute et al., 2021). The coupling of accurate visual and haptic feedback has been realized to improve human performance in VR (Arsenault & Ware, 2000; Richard et al., 1996), especially for novice trainees (Collaço et al., 2021). The increased latency between visuals and haptics may reduce performance in VR (Kaber & Zhang, 2011). Therefore, an instantaneous link between the two is warranted for an enhanced outcome. In contrast, haptic features coupled with other visual features, such as stereoscopic displays and 3D visuals, have been found to have less significance (Reymus et al., 2020) to negative effects (Liebermann et al., 2021) on recognition and identification skills.
3D Visual Representations aid in building a more complete mental model than 2D environments (Dede et al., 1999). In addition, it induces empathy among users in real-world environments (Mallam et al., 2017). In the reviewed articles, 3D visuals coupled with other VR features have been reported to have positive effects on procedural (Lohre et al., 2020b), motor (Lohre et al., 2020b), problem-solving skills (Wu et al., 2020), and teaching skills (Ke et al., 2016) in HMD environments, and basic to advanced motor skills (Casso et al., 2019; Pagnussat et al., 2020; Pahuta et al., 2012; Rölfing et al., 2020; Serrano et al., 2020; Won et al., 2018), procedural skills (Rölfing et al., 2020), technical skills (Casso et al., 2019) and visuospatial skills (Pahuta et al., 2012) in non-HMD environments. In rare contexts, 3D visual features coupled with real-time feedback negatively affect motor skill training (Stefanidis et al., 2007) in non-HMD environments. However, the effects on recognition and identification skills can be both positive (Liebermann et al., 2021) and neutral (Reymus et al., 2020) in HMD environments. Interestingly, in terms of NTS training, the effects of 3D representations coupled with real-time haptic feedback and multisensory integration in VR did not differ from those of traditional training methods (Khanal et al., 2014).
Interactive Features are more prevalent in non-HMD studies than in HMD studies (see Fig. 3). User interaction in virtual environments is beneficial for motor skill development. The presence of interactive features has been reported to account for a larger increase in motor performance than other features in small VR environments (Arsenault & Ware, 2000). The necessity of interactive features has also been highlighted for technical, procedural, and management skills training (Lonn et al., 2012a) as well as for enhanced embodied representation in VR during language training (Legault et al., 2019) and teacher training (Ke & Xu, 2020). The observed divergence in the applicability of VR interactive features beyond motor skill training may be due to rapid technological developments in the areas of haptics, motion sensing, and tracking. With regard to achieving specific training goals, multisensory integration in interactive virtual environments has a positive influence (Makransky & Petersen, 2019; Mikropoulos & Natsis, 2011). In addition, Shin (2017) highlighted the emotional component of interactivity by discussing the association between users’ attitudes and interactive experiences in VR environments, which might have a bearing on learning outcomes.
Immersivity is exclusive to HMD environments and positively influences all skill training types identified in this review. The level of immersion in VR is correlated with the “sense of presence” (North, 2014; Witmer & Singer, 1998), which in turn mediates learning outcomes (Bulu, 2012). However, highly immersive environments may increase presence but may not always have positive learning outcomes owing to increased demands on working memory, as observed in the study by Makransky et al. (2019).
High-Fidelity VR environments have shown positive effects on all types of cognitive and motor skill training, as observed in this study. In addition, technical, non-technical, procedural, and management skill training recognize the importance of high-fidelity VR environments (Hoffmann et al., 2014; Lonn et al., 2012a). However, high-fidelity realism is not an exclusive requirement for higher learning outcomes because low-cost low-fidelity simulators are as effective as expensive high-fidelity simulators at times (Matsumoto et al., 2002). Inexpensive portable VR simulators show at least a similar or higher learning outcome than other available alternatives in different educational and training contexts (Bing et al., 2019; Chien et al., 2013; Lohre et al., 2020b).
The importance of Multisensory Integration in VR is recognized in instructional design and pedagogy, along with other technological features (Baceviciute et al., 2022; Klingenberg et al., 2020). It forms a critical aspect of learning within VR environments by providing opportunities to interact with otherwise intangible and inaccessible objects in a safe environment while still being able to perceive it as if the learner is in a real environment (Klingenberg et al., 2020; Mikropoulos & Natsis, 2011).
A Wider Field of View is recognized as a unique feature of HMD VR environments, which affects NTS (Lugrin et al., 2016), problem-solving skills (Wu et al., 2020) and language training (Legault et al., 2019) positively. However, its effect on object identification using cheaper cardboard HMDs (Giordano et al., 2020) or on perceptual cognitive skills using high-end HMDs (Harris et al., 2021) did not make any difference.
4.2 Experiential Features of VR and Their Effect on Skill Training
The effects of VR technical features on learning outputs are often mediated by other experiential features. For example, technical features such as immersion, the presence of avatars, and six degrees of freedom correspond to the sense of presence (North, 2014), embodied experience (Ke et al., 2016; Ke & Xu, 2020), and user autonomy (Wu et al., 2020) respectively; all of which positively influence the overall learning outcome, as reported in the literature (Bulu, 2012; Lindgren & Johnson-Glenberg, 2013; Wu et al., 2021). In addition, the flexibility of VR simulators facilitates repeated exercises, which in turn benefits motor skill training and associated learning activities (Köyağasıoğlu & Özgürbüz, 2022), as well as other NTS, such as teamwork training (Abelson et al., 2015). Presence is considered one of the main experiential features and a prime psychological factor in VR learning environments (Mikropoulos & Strouboulis, 2004; Winn & Windschitl, 2000). In this literature review, the effect of sense of presence on different types of behaviour, perceptual, conceptual, and procedural skills training was identified. Simultaneously, the positive effect of presence on driving behaviour, hazard perception skills (Malone & Brünken, 2021), and the potential disassociation between presence and learning outcomes in immersive environments (Makransky et al., 2019) are also depicted in the literature.
4.3 Measuring the VR Effects
Although VR learning environments are being explored as alternative solutions across a plethora of learning contexts, the lack of appropriate metrics for evaluating learning outcomes poses a challenge for VR educators (dos Santos Nunes et al., 2016; Ralph et al., 2017). Janßen et al. (2016) exposed the complex nature of measuring performance in VR which is related to the complexity in measuring individual differences of users and other associated variables such as immersion, presence, flow, gaming experience etc. Qualitative measures of performance assessment are prevalent in the literature, as identified in this review. Hybrid methods have also been proposed; for example, Ralph et al. (2017) developed an assessment rubric combining presence, immersion, and flow questionnaires. Dos Santos Nunes et al. (2016) proposed a model to automatically predict learning outcome by monitoring the participants behaviour in VR and the difference in the types of interaction among the participants. The different objective measurement techniques cited in this study include measuring task completion time, movement, success rate, physiological measures (e.g., EEG), and the specific output of actions performed in VR. Suh and Prophet (2018) proposed the need for method-triangulation, including qualitative, quantitative, and neuropsychological (e.g., ECG) measures, by citing the limitations for each when applied individually to evaluate VR experiences. Novel measurement techniques include utilizing AI and machine learning in healthcare VR simulators (Mirchi et al., 2020; Yilmaz et al., 2022), which require further empirical investigation before they can be employed in other domain-specific contexts.
4.4 Implications of this Review
The findings of this systematic literature review reveal an intricate relationship between VR features and training contexts, bearing substantial theoretical, methodological, and pedagogical implications.
4.4.1 Theoretical Implications
Extant literature highlights the association of specific VR features with diverse learning outcomes: 3D representation with higher-order learning and haptic and interactive elements with active skill-based learning (Allcoat & von Mühlenen, 2018; Van der Meijden & Schijven, 2009). Additionally, avatars contribute to affective outcomes, while experiential attributes such as presence and immersion are foundational to the learning process (Shin, 2017). Understanding these intricate relationships between VR features and varied learning outcomes is essential for enhancing training efficiency. Furthermore, knowledge of the distinct influences of VR features on learning processes can inform the design of VR applications, thereby optimizing them for educational effectiveness (Radianti et al., 2020). This review addresses this need by aggregating empirical evidence to develop a comprehensive framework for VR features and skill training within a given context.
The perceived effects of a few selected VR features (e.g., immersion, interaction, and presence) on learning outcomes in different educational contexts and controlled environments have been conceptually investigated in literature (Ai-Lim Lee et al., 2010; Barrett et al., 2021; Makransky & Lilleholt, 2018). The results of these investigations predominantly showed a linear relationship, suggesting a positive perceived effect, ranging from low to high. However, this literature review revealed the intricate nature of the interrelationships between these VR features and targeted skill acquisition, showcasing a range of effects—positive, negative, neutral, and mixed—in the context of professional training. These findings underscore the nuanced impact of individual VR features across different contexts.
Furthermore, literature underscores the significance of multiple external factors in VR learning environments. These factors include personal differences, age, gender (Salzman et al., 1999), prior knowledge, experience, and motivation (Dengel & Mägdefrau, 2020) as well as learners’ spatial abilities and learning styles (Ai-Lim Lee et al., 2010). Simultaneously, instructional design principles such as guidance, feedback, control, and pre-training are emphasized as essential mediators for effective VR training (Moreno & Mayer, 2007). This literature review revealed that the effects of VR on different types of skill training differ based on the hardware used, specifically HMD and non-HMD devices. Such findings may explain the nonlinear impact of distinct VR features on skill training and could serve as a guide to anticipate VR outcomes in specific contexts.
It is important to recognize that a specific VR feature’s absence of association with a skill does not necessarily imply a lack of correlation. Instead, it may reflect a lack of evidence from the studies identified in this review.
4.4.2 Methodological Implications
One of the primary objectives of VR training is to provide precise sensory stimuli that mimics an authentic work environment. This aims to expose trainees to life-like experience (Bowman & McMahan, 2007; Lonn et al., 2012b). Consequently, it is crucial to identify the VR features that elicit responses aligned with the realism needed for specific skill training, thereby promoting optimal training transfer. In essence, the effectiveness of VR training is anchored in immersion benefits, which are intrinsically linked to immersion elements, namely the specific features of VR (Makransky & Petersen, 2021). The mapping of VR features to specific skill training in this review could assist in identifying the immersion elements, potentially enhancing learning outcomes in these contexts.
Assessing the effects of VR training is challenging, largely because of reliance on subjective measures (Cummings & Bailenson, 2016; Slater, 2004). Despite these challenges, subjective measures remain prevalent, as is highlighted in this review. This underscores the importance of devising standardized, objective approaches to evaluate VR training efficiency across various learning outcomes. In addition, understanding the requisite immersion levels in VR through proper assessment of specific outcomes can not only enhance training effectiveness, but also reduce learners’ mental workload (Chao et al., 2017).
4.4.3 Pedagogical Implications
The findings highlight the pronounced efficacy of VR in skill-based learning outcomes, in contrast to its limited impact on cognitive and affective learning (see Fig. 5). Such insights can guide VR training design in professional contexts, indicating a potential preference for using VR in skill and competency training rather than conceptual instruction.
An important aspect of VR training is that sometimes it does not support actual learning as much as it induces enjoyment, motivation, or engagement (Makransky et al., 2019; Parong & Mayer, 2018; Zhao et al., 2022). As a reason for this, researchers point towards the “novelty effect” where students may find VR interesting at first but long-term learning retention remains questionable (Allcoat & von Mühlenen, 2018; Mikropoulos & Natsis, 2011). However, by tailoring VR environments and associated features to match the cognitive and perceptual demands of the intended learning outcomes, the “novelty effect” can be harnessed to promote sustained deep learning rather than superficial engagement (Dalgarno & Lee, 2010). In addition, learner characteristics have an underlying link with learning experiences in VR. For example, spatially adept individuals may acquire greater benefits from VR’s 3D visual features (Lee & Wong, 2014), while those inclined towards experiential learning styles could find the immersive, interactive elements of high-fidelity VR particularly advantageous (Dalgarno & Lee, 2010; Mikropoulos & Natsis, 2011). Age and development level are also crucial factors in VR training, as younger learners may be enticed by VR’s game-like immersion compared to adult learners (Parong & Mayer, 2018). Incorporating this knowledge with the review findings can refine strategies for adaptive VR learning environments in professional training, allowing educators to customize VR experiences according to learners’ needs and optimize outcomes.
Empirical research suggests that overloading VR environments with features can detract from the optimal learning outcomes. Parong and Mayer (2018, 2020, 2021) emphasized the need to mitigate non-essential VR features that introduce extraneous cognitive load, thereby enhancing the focus on actual learning goals. This review can facilitate strategic resource allocation to prioritize essential VR features by elucidating the impact of specific VR features on different learning outcomes. For instance, in spatial skill training, stereoscopic display may be more critical than haptic feedback. Likewise, less immersive non-HMD VR might not be as suitable for spatial skill training, yet it can effectively address motor skill training. Such mapping of VR features detailed in this review (see Tables 4 and 5) offers pivotal insights for trainers and VR system designers, guiding hardware selection—be it HMD or non-HMD—aligned with specific skill training contexts.
4.5 Future Research Directions
Advances in VR technology have reshaped education and training, underscoring the need to study the intersection of learner characteristics, VR features, and learning outcomes in various theoretical contexts. VR exhibits a significant potential for enhancing skill-based learning outcomes across a range of domains. However, a notable gap persists in the empirical validation concerning the effectiveness of VR for cognitive and affective learning outcomes across all domains. Future studies should strive to uncover innovative, widely deployable features and pedagogically apt VR training solutions that address all types of learning outcomes (cognitive, skill-based, and affective) while also mitigating negative physiological impacts (e.g., cybersickness or eyesight problems). Moreover, refining assessment techniques, possibly through hybrid methods that blend subjective and objective assessments or advanced solutions, such as AI, is crucial for accurately measuring the learning impact of VR. Comprehensive empirical studies are necessary to elucidate the interplay among the factors that mediate learning outcomes in VR environments as technology progresses.
Future research in VR training should examine both practical and technologically relevant concerns with a pedagogical focus, addressing, but not limited to, the following key questions (see Table 6):
4.6 Limitations of this Study
Given the exclusive focus of the selected studies in this review on professional training, the complexity depicted in the relationship between VR features and learning outcomes remains highly contextual, excluding other educational scenarios such as non-professional or child education. In addition, the study did not account for potential mediators, such as learners’ age, their technological literacy (Van Laar et al., 2017), and the novelty effect of VR (Makransky et al., 2019), which could influence learning outcomes and therefore, potentially affect the applicability of the findings.
The analysis in this review draws from empirical studies that may encompass varied reporting qualities, study designs, and construct conceptualizations. In particular, the varied interpretations of VR features and learning outcomes across studies adds to this complexity. Excluding conference articles may have led to the omission of significant empirical research. A possible publication bias—favouring reports with positive VR effects (Sutton et al., 2000)—could have skewed our review analysis. While the selected studies reported VR training effects at the 5% significance level, discerning specific VR feature effects required qualitative interpretation. The wide scope of this review, covering simulations from basic desktops to immersive applications across various domains, might limit its direct applicability to individual VR systems. These aspects serve as characteristics of our findings, necessitating careful interpretation of the results within the context of the identified limitations.
5 Conclusion
This systematic review comprehensively investigated the operationalization of VR features in professional training contexts, their influence on specific skill training and learning outcomes, and the assessment techniques used to measure learning effects in VR.
The results underscored the diverse applications of VR across multiple domains, notably in healthcare and formal education, identifying an array of technological and experiential VR features relevant to skill training. It remains established that VR simulators significantly enhance motor skills, yet the specific contribution of a few individual VR features, such as immersivity, fidelity and interactivity remain ambiguous in this context. The primary intent of this review was to deconstruct the VR features employed in each study. In doing so, we aimed to provide a comprehensive summary of all features and elucidate their associations with skill training.
This review sheds light on the significant role of haptic feedback, 3D visuals, interactivity, and unique multisensory integration offered by VR environments in facilitating effective learning. Although this study underscores the pronounced influence of VR on skill-based learning outcomes, it simultaneously emphasizes a comparatively subdued effect on cognitive and affective learning outcomes, thus underscoring the need for additional empirical research focusing on VR training in contexts that target these outcomes. Furthermore, the review revealed the complexity of measuring the effects of VR on learning, noting the prevalent use of subjective measures and the potential for quantitative, hybrid, and other state-of-the-art measures (e.g., AI) to create a comprehensive assessment framework.
The findings from this review pave the way for a user-focused adaptive learning approach that harnesses the power of VR technology and has the potential to significantly enhance professional training outcomes. It is envisaged that the findings of this literature review will offer pivotal insights into the technical and experiential aspects of VR for the system designers and education providers alike.
Data Availability
This manuscript has no associated data in a data repository. However, the data related to the literature review can be provided upon suitable request to the corresponding author.
References
Abelson, J. S., Silverman, E., Banfelder, J., Naides, A., Costa, R., & Dakin, G. (2015). Virtual operating room for team training in Surgery. The American Journal of Surgery,210(3), 585–590. https://doi.org/10.1016/j.amjsurg.2015.01.024
Allcoat, D., & von Mühlenen, A. (2018). Learning in virtual reality: Effects on performance, emotion and engagement. Research in Learning Technology. https://doi.org/10.25304/rlt.v26.2140
Arsenault, R., & Ware, C. (2000). Eye-hand co-ordination with force feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp 408–414). https://doi.org/10.1145/332040.332466.
Baceviciute, S., Cordoba, A. L., Wismer, P., Jensen, T. V., Klausen, M., & Makransky, G. (2022). Investigating the value of immersive virtual reality tools for organizational training: An applied international study in the biotech industry. Journal of Computer Assisted Learning,38(2), 470–487. https://doi.org/10.1111/jcal.12630
Baceviciute, S., Terkildsen, T., & Makransky, G. (2021). Remediating learning from non-immersive to immersive media: Using EEG to investigate the effects of environmental embeddedness on reading in virtual reality. Computers & Education,164, 104122. https://doi.org/10.1016/j.compedu.2020.104122
Balcı, M. B. C., & Ta, T. (2014). Applicability and effectiveness of virtual reality simulator training in urologic Surgery: A double-blind randomised study. Nobel Medicus,10, 66–71.
Barrett, A. J., Pack, A., & Quaid, E. D. (2021). Understanding learners’ acceptance of high-immersion virtual reality systems: Insights from confirmatory and exploratory PLS-SEM analyses. Computers & Education,169, 104214. https://doi.org/10.1016/j.compedu.2021.104214
Bing, E. G., Parham, G. P., Cuevas, A., Fisher, B., Skinner, J., Mwanahamuntu, M., & Sullivan, R. (2019). Using low-cost virtual reality simulation to build surgical capacity for cervical cancer treatment. Journal of Global Oncology,5, 1–7. https://doi.org/10.1200/JGO.18.00263
Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (1956). Taxonomy of educational objetives: The classification of educational goals: Handbook I: Cognitive domain. D. Mckay.
Booth, A., Sutton, A., & Papaioannou, D. (2016). Synthesising and analysing quantitative studies. In Systematic approaches to a successful literature review (2nd ed., pp. 171–214). London: Sage.
Bowman, D. A., & McMahan, R. P. (2007). Virtual reality: How much immersion is enough? Computer,40(7), 36–43.
Bulu, S. T. (2012). Place presence, social presence, co-presence, and satisfaction in virtual worlds. Computers & Education,58(1), 154–161. https://doi.org/10.1016/j.compedu.2011.08.024
Casso, G., Schoettker, P., Savoldelli, G. L., Azzola, A., & Cassina, T. (2019). Development and initial evaluation of a novel, ultraportable, virtual reality bronchoscopy simulator: The computer airway simulation system. Anesthesia & Analgesia,129(5), 1258–1264. https://doi.org/10.1213/ANE.0000000000003316
Chao, C. J., Wu, S. Y., Yau, Y. J., Feng, W. Y., & Tseng, F. Y. (2017). Effects of three-dimensional virtual reality and traditional training methods on mental workload and training performance. Human Factors and Ergonomics in Manufacturing & Service Industries,27(4), 187–196. https://doi.org/10.1002/hfm.20702
Chao, Y. P., Kang, C. J., Chuang, H. H., Hsieh, M. J., Chang, Y. C., Kuo, T. B. J., Yang, C. C. H., Huang, C. G., Fang, T. J., Li, H. Y., & Lee, L. A. (2023). Comparison of the effect of 360° versus two-dimensional virtual reality video on history taking and physical examination skills learning among undergraduate medical students: A randomized controlled trial. Virtual Reality,27(2), 637–650. https://doi.org/10.1007/s10055-022-00664-0
Chavez, B., and Bayona, S. (2018). Virtual Reality in the Learning Process. In Á. Rocha, H. Adeli, L. P. Reis, and S. Costanzo (Eds.), Trends and Advances in Information Systems and Technologies (Vol. 746, pp. 1345–1356). Springer International Publishing. https://doi.org/10.1007/978-3-319-77712-2_129.
Chien, J. H., Suh, I. H., Park, S. H., Mukherjee, M., Oleynikov, D., & Siu, K. C. (2013). Enhancing fundamental robot-assisted surgical proficiency by using a portable virtual simulator. Surgical Innovation,20(2), 198–203. https://doi.org/10.1177/1553350612458545
Chou, B., & Handa, V. L. (2006). Simulators and virtual reality in surgical education. Obstetrics and Gynecology Clinics,33(2), 283–296. https://doi.org/10.1016/j.ogc.2006.01.007
Collaço, E., Kira, E., Sallaberry, L. H., Queiroz, A. C. M., Machado, M. A. A. M., Crivello, O., Jr., & Tori, R. (2021). Immersion and haptic feedback impacts on dental anesthesia technical skills virtual reality training. Journal of Dental Education,85(4), 589–598. https://doi.org/10.1002/jdd.12503
Colombo, S., Nazir, S., & Manca, D. (2014). Immersive virtual reality for training and decision making: Preliminary results of experiments performed with a plant simulator. SPE Economics & Management,6(04), 165–172. https://doi.org/10.2118/164993-PA
Cummings, J. J., & Bailenson, J. N. (2016). How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychology,19(2), 272–309.
Dalgarno, B., & Lee, M. J. (2010). What are the learning affordances of 3-D virtual environments? British Journal of Educational Technology,41(1), 10–32. https://doi.org/10.1111/j.1467-8535.2009.01038.x
Dede, C., Salzman, M. C., Loftin, R. B., & Sprague, D. (1999). Multisensory immersion as a modeling environment for learning complex scientific concepts. In Modeling and simulation in science and mathematics education (pp. 282–319). Springer. https://doi.org/10.1007/978-1-4612-1414-4_12.
Dengel, A., & Mägdefrau, J. (2020). Immersive learning predicted: Presence, prior knowledge, and school performance influence learning outcomes in immersive educational virtual environments. In 2020 6th International Conference of the immersive learning research network (ILRN) (pp. 163–170). https://doi.org/10.23919/iLRN47897.2020.9155084.
dos Santos Nunes, E. P., Roque, L. G., & dos Nunes, S. (2016). Measuring knowledge acquisition in 3D virtual learning environments. IEEE Computer Graphics and Applications,36(2), 58–67. https://doi.org/10.1109/MCG.2016.20
Gagne, R. M. (1984). Learning outcomes and their effects: Useful categories of human performance. American Psychologist,39(4), 377.
Giordano, N. A., Whitney, C. E., Axson, S. A., Cassidy, K., Rosado, E., & Hoyt-Brennan, A. M. (2020). A pilot study to compare virtual reality to hybrid simulation for opioid-related overdose and naloxone training. Nurse Education Today,88, 104365. https://doi.org/10.1016/j.nedt.2020.104365
Grant, S. C., & Magee, L. E. (1998). Contributions of proprioception to navigation in virtual environments. Human Factors: The Journal of the Human Factors and Ergonomics Society,40(3), 489–497. https://doi.org/10.1518/001872098779591296
Gu, P., Xu, X., Qian, X., & Weng, T. H. (2023). Leveraging extended reality for autistic individuals: A scoping review of technical features and technology affordances. IEEE Transactions on Learning Technologies,16(1), 133–149. https://doi.org/10.1109/TLT.2022.3197430
Hammad, R., Khan, Z., Safieddine, F., & Ahmed, A. (2020). A review of learning theories and models underpinning technology-enhanced learning artefacts. World Journal of Science Technology and Sustainable Development,17(4), 341–354. https://doi.org/10.1108/WJSTSD-06-2020-0062
Harris, D. J., Hardcastle, K. J., Wilson, M. R., & Vine, S. J. (2021). Assessing the learning and transfer of gaze behaviours in immersive virtual reality. Virtual Reality,25(4), 961–973. https://doi.org/10.1007/s10055-021-00501-w
Hattori, A., Tonami, K., Tsuruta, J., Hideshima, M., Kimura, Y., Nitta, H., & Araki, K. (2022). Effect of the haptic 3D virtual reality dental training simulator on assessment of tooth preparation. Journal of Dental Sciences,17(1), 514–520. https://doi.org/10.1016/j.jds.2021.06.022
Hoffmann, C. P., Filippeschi, A., Ruffaldi, E., & Bardy, B. G. (2014). Energy management using virtual reality improves 2000-m rowing performance. Journal of Sports Sciences,32(6), 501–509. https://doi.org/10.1080/02640414.2013.835435
Hoffman, D. M., Girshick, A. R., Akeley, K., & Banks, M. S. (2008). Vergence–accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision,8(3), 33–33. https://doi.org/10.1167/8.3.33
Janßen, D., Tummel, C., Richert, A., & Isenhardt, I. (2016). Towards measuring user experience, activation and task performance in immersive virtual learning environments for students. International Conference on Immersive Learning. https://doi.org/10.1007/978-3-319-41769-1_4
Jensen, L., & Konradsen, F. (2018). A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies,23(4), 1515–1529. https://doi.org/10.1007/s10639-017-9676-0
Ju, R., Chang, P. L., Buckley, A. P., & Wang, K. C. (2012). Comparison of Nintendo Wii and PlayStation2 for enhancing laparoscopic skills. JSLS: Journal of the Society of Laparoendoscopic Surgeons,16(4), 612–618. https://doi.org/10.4293/108680812X13462882737294
Kaber, D., Tupler, L. A., Clamann, M., Gil, G. H., Zhu, B., Swangnetr, M., Jeon, W., Zhang, Y., Qin, X., Ma, W., & Lee, Y. S. (2014). Evaluation of an augmented virtual reality and haptic control interface for psychomotor training. Assistive Technology,26(1), 51–60. https://doi.org/10.1080/10400435.2013.800923
Kaber, D. B., & Zhang, T. (2011). Human factors in virtual reality system design for mobility and haptic task performance. Reviews of Human Factors and Ergonomics,7(1), 323–366. https://doi.org/10.1177/1557234X11410389
Kaplan, A. D., Cruit, J., Endsley, M., Beers, S. M., Sawyer, B. D., & Hancock, P. A. (2021). The effects of virtual reality, augmented reality, and mixed reality as training enhancement methods: A Meta-analysis. Human Factors: The Journal of the Human Factors and Ergonomics Society,63(4), 706–726. https://doi.org/10.1177/0018720820904229
Ke, F., Lee, S., & Xu, X. (2016). Teaching training in a mixed-reality integrated learning environment. Computers in Human Behavior,62, 212–220. https://doi.org/10.1016/j.chb.2016.03.094
Ke, F., & Xu, X. (2020). Virtual reality simulation-based learning of teaching with alternative perspectives taking. British Journal of Educational Technology,51(6), 2544–2557. https://doi.org/10.1111/bjet.12936
Khanal, P., Vankipuram, A., Ashby, A., Vankipuram, M., Gupta, A., Drumm-Gurnee, D., Josey, K., Tinker, L., & Smith, M. (2014). Collaborative virtual reality based advanced cardiac life support training simulator using virtual reality principles. Journal of Biomedical Informatics,51, 49–59. https://doi.org/10.1016/j.jbi.2014.04.005
Kikuchi, H., Ikeda, M., & Araki, K. (2012). Evaluation of a virtual reality simulation system for porcelain fused to metal crown preparation at Tokyo Medical and Dental University. Journal of Dental Education,77(6), 782–792. https://doi.org/10.1002/j.0022-0337.2013.77.6.tb05530.x
Klingenberg, S., Jørgensen, M. L. M., Dandanell, G., Skriver, K., Mottelson, A., & Makransky, G. (2020). Investigating the effect of teaching as a generative learning strategy when learning through desktop and immersive VR: A media and methods experiment. British Journal of Educational Technology,51(6), 2115–2138. https://doi.org/10.1111/bjet.13029
Köyağasıoğlu, O., & Özgürbüz, C. (2022). The effects of virtual reality nonphysical mental training on coordination and skill transfer in healthy adults. Journal of Sport Rehabilitation,1(aop), 1–10. https://doi.org/10.1123/jsr.2021-0198
Kozhevnikov, M., Gurlitt, J., & Kozhevnikov, M. (2013). Learning relative motion concepts in immersive and non-immersive virtual environments. Journal of Science Education and Technology,22(6), 952–962. https://doi.org/10.1007/s10956-013-9441-0
Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology,78(2), 311–328. https://doi.org/10.1037/0021-9010.78.2.311
Kwon, Y., Lemieux, M., McTavish, J., & Wathen, N. (2015). Identifying and removing duplicate records from systematic review searches. Journal of the Medical Library Association: JMLA,103(4), 184–188. https://doi.org/10.3163/1536-5050.103.4.004
Lee, A. L., Wong, E., & Fung, C. C. (2010). How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach. Computers & Education,55(4), 1424–1442. https://doi.org/10.1016/j.compedu.2010.06.006
Lee, E. A. L., & Wong, K. W. (2014). Learning with desktop virtual reality: Low spatial ability learners are more positively affected. Computers & Education,79, 49–58. https://doi.org/10.1016/j.compedu.2014.07.010
Legault, J., Zhao, J., Chi, Y. A., Chen, W., Klippel, A., & Li, P. (2019). Immersive virtual reality as an effective tool for second language vocabulary learning. Languages,4(1), 13. https://doi.org/10.3390/languages4010013
Liebermann, A., Seefelder, J., Nold, E., Huth, K. C., & Erdelt, K. (2021). Virtual dental teaching and its effect on test success—A cross-over study. Journal of Dental Education. https://doi.org/10.1002/jdd.12836
Lin, D. W., Romanelli, J. R., Kuhn, J. N., Thompson, R. E., Bush, R. W., & Seymour, N. E. (2009). Computer-based laparoscopic and robotic surgical simulators: Performance characteristics and perceptions of new users. Surgical Endoscopy,23(1), 209–214. https://doi.org/10.1007/s00464-008-9805-3
Lindgren, R., & Johnson-Glenberg, M. (2013). Emboldened by embodiment: Six precepts for research on embodied learning and mixed reality. Educational Researcher,42(8), 445–452. https://doi.org/10.3102/0013189X1351
Liu, W., Zheng, X., Wu, R., Jin, Y., Kong, S., Li, J., Lu, J., Yang, H., Xu, X., Lv, Y., & Zhang, X. (2018). Novel laparoscopic training system with continuously perfused ex-vivo porcine liver for hepatobiliary surgery. Surgical Endoscopy,32(2), 743–750. https://doi.org/10.1007/s00464-017-5731-6
Lohre, R., Bois, A. J., Pollock, J. W., Lapner, P., McIlquham, K., Athwal, G. S., & Goel, D. P. (2020). Effectiveness of immersive virtual reality on orthopedic surgical skills and knowledge acquisition among senior surgical residents: A randomized clinical trial. JAMA Network Open,3(12), e2031217. https://doi.org/10.1001/jamanetworkopen.2020.31217
Loke, S. K. (2015). How do virtual world experiences bring about learning? A critical review of theories. Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.2532
Lonn, L., Edmond, J. J., Marco, J., Kearney, P. P., & Gallagher, A. G. (2012). Virtual reality simulation training in a high-fidelity procedure suite: Operator appraisal. Journal of Vascular and Interventional Radiology,23(10), 1361-1366e2. https://doi.org/10.1016/j.jvir.2012.06.002
Lugrin, J. L., Latoschik, M. E., Habel, M., Roth, D., Seufert, C., & Grafe, S. (2016). Breaking bad behaviors: a new tool for learning classroom management using virtual reality. Frontiers in ICT. https://doi.org/10.3389/fict.2016.00026
Makransky, G., & Lilleholt, L. (2018). A structural equation modeling investigation of the emotional value of immersive virtual reality in education. Educational Technology Research and Development,66(5), 1141–1164. https://doi.org/10.1007/s11423-018-9581-2
Makransky, G., & Petersen, G. B. (2019). Investigating the process of learning with desktop virtual reality: A structural equation modeling approach. Computers & Education,134, 15–30. https://doi.org/10.1016/j.compedu.2019.02.002
Makransky, G., & Petersen, G. B. (2021). The cognitive affective model of immersive learning (CAMIL): A theoretical research-based model of learning in immersive virtual reality. Educational Psychology Review,33(3), 937–958. https://doi.org/10.1007/s10648-020-09586-2
Makransky, G., Terkildsen, T. S., & Mayer, R. E. (2019). Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learning and Instruction,60, 225–236. https://doi.org/10.1016/j.learninstruc.2017.12.007
Mallam, S. C., Lundh, M., & MacKinnon, S. N. (2017). Evaluating a digital ship design tool prototype: Designers’ perceptions of novel ergonomics software. Applied Ergonomics,59, 19–26. https://doi.org/10.1016/j.apergo.2016.08.026
Mallam, S. C., Nazir, S., & Renganayagalu, S. K. (2019). Rethinking maritime education, training, and operations in the digital era: Applications for emerging Immersive technologies. Journal of Marine Science and Engineering,7(12), 428. https://doi.org/10.3390/jmse7120428
Malone, S., & Brünken, R. (2021). Hazard perception, presence, and simulation sickness—A comparison of desktop and head-mounted display for driving simulation. Frontiers in Psychology,12, 647723. https://doi.org/10.3389/fpsyg.2021.647723
Matovu, H., Ungu, D. A. K., Won, M., Tsai, C. C., Treagust, D. F., Mocerino, M., & Tasker, R. (2022). Immersive virtual reality for science learning: Design, implementation, and evaluation. Studies in Science Education. https://doi.org/10.1080/03057267.2022.2082680
Matsumoto, E. D., Hamstra, S. J., Radomski, S. B., & Cusimano, M. D. (2002). The effect of bench model fidelity on endourological skills: A randomized controlled study. The Journal of Urology,167(3), 1243–1247. https://doi.org/10.1016/S0022-5347(05)65274-3
Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education,70, 29–40. https://doi.org/10.1016/j.compedu.2013.07.033
Mikropoulos, T. A., & Natsis, A. (2011). Educational virtual environments: A ten-year review of empirical research (1999–2009). Computers & Education,56(3), 769–780. https://doi.org/10.1016/j.compedu.2010.10.020
Mikropoulos, T. A., & Strouboulis, V. (2004). Factors that influence presence in educational virtual environments. CyberPsychology & Behavior,7(5), 582–591. https://doi.org/10.1089/cpb.2004.7.582
Mirchi, N., Bissonnette, V., Yilmaz, R., Ledwos, N., Winkler-Schwartz, A., & Del Maestro, R. F. (2020). The virtual operative assistant: An explainable artificial intelligence tool for simulation-based training in surgery and medicine. PLoS ONE,15(2), e0229596. https://doi.org/10.1371/journal.pone.0229596
Moglia, A., Ferrari, V., Morelli, L., Ferrari, M., Mosca, F., & Cuschieri, A. (2016). A systematic review of virtual reality simulators for robot-assisted surgery. European Urology,69(6), 1065–1080. https://doi.org/10.1016/j.eururo.2015.09.021
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., The PRISMA Group. (2009). Preferred reporting items for systematic reviews and Meta-analyses: The PRISMA Statement. PLoS Medicine,6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097
Moreno, R., & Mayer, R. (2007). Interactive Multimodal Learning environments: Special issue on interactive learning environments: Contemporary issues and trends. Educational Psychology Review,19(3), 309–326. https://doi.org/10.1007/s10648-007-9047-2
Nathanael, D., Mosialos, S., & Vosniakos, G. C. (2016). Development and evaluation of a virtual training environment for on-line robot programming. International Journal of Industrial Ergonomics,53, 274–283. https://doi.org/10.1016/j.ergon.2016.02.004
Nazir, S., Sorensen, L. J., Øvergård, K. I., & Manca, D. (2015). Impact of training methods on distributed situation awareness of industrial operators. Safety Science,73, 136–145. https://doi.org/10.1016/j.ssci.2014.11.015
North, M. M. (2014). Distance learning immersive environments: Sense of presence exploration. Journal of Visual Languages & Computing,25(6), 1040–1041. https://doi.org/10.1016/j.jvlc.2014.09.006
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., & Brennan, S. E. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery,88, 105906. https://doi.org/10.1016/j.ijsu.2021.105906
Pagnussat, M., Hauge, T., Lopes, E. S., de Almeida, M. R. M., & Naldony, A. (2020). Bimanual motor skill in recruitment of forest harvest machine operators. Croatian Journal of Forest Engineering,41(1), 25–33. https://doi.org/10.5552/crojfe.2020.623
Pahuta, M. A., Schemitsch, E. H., Backstein, D., Papp, S., & Gofton, W. (2012). Virtual fracture carving improves understanding of a complex fracture: A randomized controlled study. The Journal of Bone and Joint Surgery-American Volume,94(24), e182. https://doi.org/10.2106/JBJS.K.00996
Parmar, D., Bertrand, J., Babu, S. V., Madathil, K., Zelaya, M., Wang, T., Wagner, J., Gramopadhye, A. K., & Frady, K. (2016). A comparative evaluation of viewing metaphors on psychophysical skills education in an interactive virtual environment. Virtual Reality,20(3), 141–157. https://doi.org/10.1007/s10055-016-0287-7
Parong, J., & Mayer, R. E. (2018). Learning science in immersive virtual reality. Journal of Educational Psychology,110(6), 785. https://doi.org/10.1037/edu0000241
Parong, J., & Mayer, R. E. (2020). Cognitive and affective processes for learning science in immersive virtual reality. Journal of Computer Assisted Learning,37(1), 226–241. https://doi.org/10.1111/jcal.12482
Parong, J., & Mayer, R. E. (2021). Learning about history in immersive virtual reality: Does immersion facilitate learning? Educational Technology Research and Development,69(3), 1433–1451. https://doi.org/10.1007/s11423-021-09999-y
Petersen, G. B., Petkakis, G., & Makransky, G. (2022). A study of how immersion and interactivity drive VR learning. Computers & Education,179, 104429. https://doi.org/10.1016/j.compedu.2021.104429
Radianti, J., Majchrzak, T. A., Fromm, J., & Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education,147, 103778. https://doi.org/10.1016/j.compedu.2019.103778
Ralph, R., Jacoby, D., Coady, Y., Balachandar, D., Burt, E., Hnguyen, N., Kim, J., Maclang, K., Wong, S., & Bafia, L. (2017). Metrics for evaluation of educational experiences: Will virtual reality have impact? In 2017 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM) (pp. 1–6). https://doi.org/10.1109/PACRIM.2017.8121919.
Reich, O., Noll, M., Gratzke, C., Bachmann, A., Waidelich, R., Seitz, M., Schlenker, B., Baumgartner, R., Hofstetter, A., & Stief, C. G. (2006). High-level virtual reality simulator for endourologic procedures of lower urinary tract. Urology,67(6), 1144–1148. https://doi.org/10.1016/j.urology.2006.01.002
Remacle, A., Bouchard, S., Etienne, A. M., Rivard, M. C., & Morsomme, D. (2021). A virtual classroom can elicit teachers’ speech characteristics: Evidence from acoustic measurements during in vivo and in virtuo lessons, compared to a free speech control situation. Virtual Reality,25(4), 935–944. https://doi.org/10.1007/s10055-020-00491-1
Renganayagalu, S. K., Mallam, S. C., & Nazir, S. (2021). Effectiveness of VR head mounted displays in professional training: A systematic review. Technology, Knowledge and Learning. https://doi.org/10.1007/s10758-020-09489-9
Reymus, M., Liebermann, A., & Diegritz, C. (2020). Virtual reality: An effective tool for teaching root canal anatomy to undergraduate dental students—A preliminary study. International Endodontic Journal,53(11), 1581–1587. https://doi.org/10.1111/iej.13380
Richard, P., Birebent, G., Coiffet, P., Burdea, G., Gomez, D., & Langrana, N. (1996). Effect of frame rate and force feedback on virtual object manipulation. Presence: Teleoperators & Virtual Environments,5(1), 95–108. https://doi.org/10.1162/pres.1996.5.1.95
Rölfing, J. D., Jensen, R. D., & Paltved, C. (2020). HipSim—hip fracture surgery simulation utilizing the learning curve–cumulative summation test (LC-CUSUM). Acta Orthopaedica,91(6), 669–674. https://doi.org/10.1080/17453674.2020.1777511
Rosenberg, L. B. (1993). Virtual fixtures: Perceptual tools for telerobotic manipulation. In Proceedings of IEEE virtual reality annual international symposium (pp. 76–82). https://doi.org/10.1109/VRAIS.1993.380795
Salzman, M. C., Dede, C., Loftin, R. B., & Chen, J. (1999). A model for understanding how virtual reality aids complex conceptual learning. Presence: Teleoperators and Virtual Environments,8(3), 293–316. https://doi.org/10.1162/105474699566242
Sapkaroski, D., Mundy, M., & Dimmock, M. R. (2020). Virtual reality versus conventional clinical role-play for radiographic positioning training: A students’ perception study. Radiography,26(1), 57–62. https://doi.org/10.1016/j.radi.2019.08.001
Serrano, C. M., Wesselink, P. R., & Vervoorn, J. M. (2020). First experiences with patient-centered training in virtual reality. Journal of Dental Education,84(5), 607–614. https://doi.org/10.1002/jdd.12037
Shin, D. H. (2017). The role of affordance in the experience of virtual reality learning: Technological and affective affordances in virtual reality. Telematics and Informatics,34(8), 1826–1836. https://doi.org/10.1016/j.tele.2017.05.013
Sitzmann, T. (2011). A meta-analytic examination of the instructional effectiveness of computer-based simulation games. Personnel Psychology,64(2), 489–528.
Slater, M. (2004). How colorful was your day? Why questionnaires cannot assess presence in virtual environments. Presence,13(4), 484–493.
Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI,3, 74. https://doi.org/10.3389/frobt.2016.00074
Slater, M., & Wilbur, S. (1997). A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments,6(6), 603–616.
Stefanidis, D., Haluck, R., Pham, T., Dunne, J. B., Reinke, T., Markley, S., Korndorffer, J. R., Arellano, P., Jones, D. B., & Scott, D. J. (2007). Construct and face validity and task workload for laparoscopic camera navigation: Virtual reality versus videotrainer systems at the SAGES learning center. Surgical Endoscopy,21(7), 1158–1164. https://doi.org/10.1007/s00464-006-9112-9
Stirling, E. R., Lewis, T. L., & Ferran, N. A. (2014). Surgical skills simulation in trauma and orthopaedic training. Journal of Orthopaedic Surgery and Research,9(1), 126. https://doi.org/10.1186/s13018-014-0126-z
Suh, A., & Prophet, J. (2018). The state of immersive technology research: A literature analysis. Computers in Human Behavior,86, 77–90. https://doi.org/10.1016/j.chb.2018.04.019
Sutton, A. J., Duval, S. J., Tweedie, R. L., Abrams, K. R., & Jones, D. R. (2000). Empirical assessment of effect of publication bias on meta-analyses. BMJ,320(7249), 1574–1577. https://doi.org/10.1136/bmj.320.7249.1574
Tai, T. Y. (2022). Impact of mobile virtual reality on EFL learners’ listening comprehension. Language Learning. https://doi.org/10.1177/0735633121994291
Tergas, A. I., Sheth, S. B., Green, I. C., Giuntoli, R. L., Winder, A. D., & Fader, A. N. (2013). A pilot study of surgical training using a virtual robotic surgery simulator. JSLS: Journal of the Society of Laparoendoscopic Surgeons,17(2), 219–226. https://doi.org/10.4293/108680813X13654754535872
Topalli, D., & Cagiltay, N. E. (2019). Classification of intermediate and novice surgeons’ skill assessment through performance metrics. Surgical Innovation,26(5), 621–629. https://doi.org/10.1177/1553350619853112
Vaghela, K. R., Trockels, A., & Carobene, M. (2021). Active vs passive haptic feedback technology in virtual reality arthroscopy simulation: Which is most realistic? Journal of Clinical Orthopaedics and Trauma,16, 249–256. https://doi.org/10.1016/j.jcot.2021.02.014
Van der Meijden, O. A., & Schijven, M. P. (2009). The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: A current review. Surgical Endoscopy,23, 1180–1190.
Van Laar, E., Van Deursen, A. J. A. M., Van Dijk, J. A. G. M., & De Haan, J. (2017). The relation between 21st-century skills and digital skills: A systematic literature review. Computers in Human Behavior,72, 577–588. https://doi.org/10.1016/j.chb.2017.03.010
Verdaasdonk, E. G. G., Stassen, L. P. S., Monteny, L. J., & Dankelman, J. (2006). Validation of a new basic virtual reality simulator for training of basic endoscopic skills: The SIMENDO. Surgical Endoscopy,20(3), 511–518. https://doi.org/10.1007/s00464-005-0230-6
Wang, Z., Kasman, M., Martinez, M., Rege, R., Zeh, H., Scott, D., & Fey, A. M. (2019). A comparative human-centric analysis of virtual reality and dry lab training tasks on the da vinci surgical platform. Journal of Medical Robotics Research,04(03n04), 1942007. https://doi.org/10.1142/S2424905X19420078
Winn, W., & Windschitl, M. (2000). Learning science in virtual environments: The interplay of theory and experience. Themes in Education,1(4), 373–389.
Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence,7(3), 225–240. https://doi.org/10.1162/105474698565686
Won, T. B., Hwang, P., Lim, J. H., Cho, S. W., Paek, S. H., Losorelli, S., Vaisbuch, Y., Chan, S., Salisbury, K., & Blevins, N. H. (2018). Early experience with a patient-specific virtual surgical simulation for rehearsal of endoscopic skull-base surgery: Patient-specific VSE for skull base surgery. International Forum of Allergy & Rhinology,8(1), 54–63. https://doi.org/10.1002/alr.22037
Wood, G., Wright, D. J., Harris, D., Pal, A., Franklin, Z. C., & Vine, S. J. (2021). Testing the construct validity of a soccer-specific virtual reality simulator using novice, academy, and professional soccer players. Virtual Reality,25(1), 43–51. https://doi.org/10.1007/s10055-020-00441-x
Wu, B., Hu, Y., & Wang, M. (2020). How do head-mounted displays and planning strategy influence problem-solving-based learning in introductory electrical circuit design. Educational Technology & Society. https://doi.org/10.30191/ETS.202007_23(3).0004
Wu, B., Yu, X., & Gu, X. (2020). Effectiveness of immersive virtual reality using head-mounted displays on learning performance: A meta‐analysis. British Journal of Educational Technology,51(6), 1991–2005. https://doi.org/10.1111/bjet.13023
Wu, W. L., Hsu, Y., Yang, Q. F., Chen, J. J., & Jong, M. S. Y. (2021). Effects of the self-regulated strategy within the context of spherical video-based virtual reality on students’ learning performances in an art history class. Interactive Learning Environments. https://doi.org/10.1080/10494820.2021.1878231
Yilmaz, R., Winkler-Schwartz, A., Mirchi, N., Reich, A., Christie, S., Tran, D. H., Ledwos, N., Fazlollahi, A. M., Santaguida, C., Sabbagh, A. J., Bajunaid, K., & Del Maestro, R. (2022). Continuous monitoring of surgical bimanual expertise using deep neural networks in virtual reality simulation. NPJ Digital Medicine,5(1), 54. https://doi.org/10.1038/s41746-022-00596-8
Zahiri, M., Booton, R., Siu, K. C., & Nelson, C. A. (2016). Design and evaluation of a portable laparoscopic training system using virtual reality. Journal of Medical Devices,11(1), 011002. https://doi.org/10.1115/1.4034881
Zeng, W., & Richardson, A. (2016). Adding dimension to content: Immersive virtual reality for e-commerce.
Zhao, J., Wallgrun, J. O., Sajjadi, P., LaFemina, P., Lim, K. Y. T., Springer, J. P., & Klippel, A. (2022). Longitudinal effects in the effectiveness of educational virtual field trips. Journal of Educational Computing Research,60(4), 1008–1034. https://doi.org/10.1177/07356331211062925
Acknowledgements
The authors acknowledge the financial and organisational support from the Centre of Excellence in Maritime Simulator Training and Assessment (COAST) hosted at the University of South-Eastern Norway.
Funding
Open access funding provided by University Of South-Eastern Norway. This study has received funding from The Norwegian Directorate for Higher Education and Skills (HK-dir) under the Centre of Excellence in Education (SFU) scheme in Norway. Project code: SFU/10021-COAST.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
We, the authors, declare no conflicts of interest regarding the research, data, or financial involvement that could potentially influence the objectivity or impartiality of this scientific article.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Tusher, H.M., Mallam, S. & Nazir, S. A Systematic Review of Virtual Reality Features for Skill Training. Tech Know Learn 29, 843–878 (2024). https://doi.org/10.1007/s10758-023-09713-2
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10758-023-09713-2