Abstract
This study aims to analyze the use of virtual reality and gamification in education by examining the existing literature. In addition to virtual reality, this study focuses on gamified virtual reality learning environments which refer to virtual reality learning environments that integrate gamification elements and mechanisms. Based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement, a systematic literature review was carried out. No limitations were set regarding educational level, type of study, subject, and publication year. The related articles were retrieved from 5 databases (ERIC, Google Scholar, IEEE, SCOPUS, and Web of Science). A total of 112 articles were included, 16 research questions were explored, and a thematic analysis was conducted. To evaluate the quality of the articles included, the Mixed Methods Appraisal Tool (MMAT) was used. According to the findings, gamification and virtual reality support several pedagogical theories and approaches. Their adoption to and integration into education can enrich and transform traditional teaching and learning and were assessed positively by students and teachers. Gamification elements significantly affected students’ achievements. In comparison to traditional learning environments, gamified virtual reality learning environments were more motivating, engaging, and interactive and offered more opportunities for personalized and collaborative learning. Through the realistic and interactive experiences offered, students’ immersion and social presence can be enhanced, knowledge acquisition can be improved, and material comprehension can be facilitated. Positive changes in student attitude, behavior, and mentality as well as improved cognitive, physical, and social–emotional development were observed. When using learning environments that integrate both virtual reality and gamification, students’ learning outcomes, motivation, engagement, and self-efficacy were increased. Additionally, students’ academic performance, active involvement, and satisfaction were improved. Students’ curiosity, imagination, focus, and interest were enhanced and their skills and competences were developed. Finally, gamified virtual reality emerged as an effective educational tool that can improve learning at all educational levels, subjects, and contexts.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
The emergence of modern technological applications and their adoption in educational settings have challenged the effectiveness of traditional educational systems, approaches, and methodologies to meet the new educational and societal requirements and satisfy students’ demands for more active, engaging, and insightful learning (de Castro & García-Peñalvo, 2022; DiLullo et al., 2011). In the context of Education 4.0, the adoption and integration of technology-enhanced learning are imperative (Bayne, 2014; Hussin, 2018). As the integration of novel technologies and applications in the education process becomes more common, ineffective practices and approaches are being substituted (Hughes et al., 2006; Zawacki-Richter & Latchem, 2018).
To provide high quality education, the educational processes should adapt to the needs of digital native students and take their habits, knowledge, personality traits, competences, and interests into account (Prensky, 2001; Robinson et al., 2013). Additionally, when students play an active role in teaching and learning activities and participate more eagerly and willingly, improved learning outcomes can be yielded (Rupp et al., 2019). The use of Extended Reality (XR) technologies in education is gaining ground as they can satisfy the new educational demands and students’ requirements (Lampropoulos et al., 2022). Due to their interactive and immersive nature, XR technologies can assist in developing new pedagogical approaches, lead to more meaningful learning, promote lifelong learning, and create learning environments that students find more enjoyable, intriguing, motivating, and engaging (Beck, 2019; Calvet et al., 2019). XR technologies are composed of Mixed Reality (MR), Virtual Reality (VR), and Augmented Reality (AR) with VR being closer to the virtual environment while AR closer to the physical environment (Milgram & Kishino, 1994). These technologies provide users with a sense of immersion and aim at creating an MR in which the simultaneous existence of both real and digital objects is feasible, the human sense perceptions are substituted with ones that are created by computers, and the borders between the perceived virtual and real environments become blurred (Schmalstieg et al., 2002; Slater & Sanchez-Vives, 2016; Suh & Prophet, 2018). Additionally, gamification is a novel approach that can be combined with XR technologies to enrich and improve the teaching and learning activities (Lampropoulos et al., 2022). Gamification can transform traditional education by incorporating game mechanisms and elements into its processes to create more absorbing, fun, motivating, and interesting learning environments and experiences that promote inclusion and student-centered learning (Majuri et al., 2018; Nah et al., 2014; Pozo-Sánchez et al., 2022).
Even before the COVID-19 pandemic the educational domain had to address the new demands that were brought about by the digitalization of everyday life through adopting and incorporating new approaches, methods, and technological applications as well as transforming and enriching teaching and learning activities (Burbules & Callister, 2018). This fact was further amplified due to the pandemic (Ratten & Jones, 2021). Both gamification and virtual reality share a number of similarities which enable them to be used in conjunction. Particularly, the integration of gamified virtual reality learning environments in educational settings can offer various benefits. Their use can potentially help meet the new educational demands, enrich the educational process, improve learning achievements, and assist toward the materialization of the digital transformation of education.
Despite the interest and the studies regarding the educational use of virtual reality and gamification being increased (Martí-Parreño et al., 2016; Rojas-Sánchez et al., 2022; Swacha, 2021), little is known about their impact and effectiveness when they are combined. Therefore, this study aims at examining the use of gamified virtual reality learning environments through a systematic literature review. Specifically, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement was followed and no limitations were set regarding the educational level, subject, and publication year. The below-mentioned research questions (RQ), which are based on the study of Lampropoulos et al. (2022), have been set to be explored and answered:
-
RQ1: What benefits are brought about when incorporating virtual reality and gamification into the educational process?
-
RQ2: How are the related studies distributed among empirical studies, proposal and prototype papers as well as review, conceptual, and theoretical articles?
-
RQ3: Which are the countries which conducted the most studies related to the topic?
-
RQ4: What is the distribution and frequency of publications throughout the years?
-
RQ5: What are the main findings of the related studies?
-
RQ6: Which is the educational level that more widely adopted the use of virtual reality and gamification?
-
RQ7: What most studies focus on regarding students’ development?
-
RQ8: What is the most commonly used sample in the related studies?
-
RQ9: Which are the main objectives and aims of the related studies?
-
RQ10: What are the main areas, topics and subjects the use of virtual reality and gamification is more widely studied and applied in?
-
RQ11: Which instruments, research methods and categories, variables, and measures are mostly used to examine the given topic?
-
RQ12: Which development tools, methodologies, and operating systems are mostly used to develop gamified virtual reality applications for educational purposes?
-
RQ13: Which are the most commonly used devices to carry out the experiments?
-
RQ14: What degrees of freedom (dof) and representation are used within the gamified virtual reality applications in education?
-
RQ15: Which are the most widely used gamification mechanisms and elements in gamified virtual reality applications in education?
-
RQ16: Do the main findings of the different types of studies examined lead to the same conclusions?
Virtual reality in education
Virtual reality aims at immersing users in real or virtual environments and experiences which perceptually surround them and are generated through computational units to simulate their physical presence within them (Lampropoulos et al., 2020). More specifically, virtual reality is mainly characterized by the elements of interaction, immersion, immediacy, involvement, and presence (Freina & Ott, 2015; Psotka, 1995; Ryan, 2015; Sherman & Craig, 2003), uses computational systems to create “all-inclusive, sensory illusion of being present in another environment” (Biocca & Delaney, 1995, p. 63), and capitalizes on social and psychological aspects and processes to make users perceive these virtual environments and experiences as real (Blascovich & Bailenson, 2011).
The interdisciplinary nature of virtual reality, which arises from the field of computer science, allows it to be applied in several domains (Rashid et al., 2021), including education in which it is gaining more ground as an immersive, interactive, and useful teaching and learning tool (Hu-Au & Lee, 2017; Martín-Gutiérrez et al., 2017; Radianti et al., 2020), as it contributes toward more engaging (Annetta et al., 2009) and meaningful learning (Huang et al., 2010). The recent advances and the lower cost of digital devices and equipment have facilitated the adoption of virtual reality even further (Olmos et al., 2018).
Virtual reality impacts students’ affective domain, social interactions, and learning outcomes (Hew & Cheung, 2010). Additionally, it can be used in educational settings in a variety of ways, such as face-to-face, distance, and blended learning, as it creates safe, immersive, and unique environments that support various teaching and learning styles, increase involvement and motivation, and enable real-time communication and interaction between educators and learners even in cases in which traditional learning would not have been feasible (Bronack et al., 2006; Dalgarno et al., 2011; Dickey, 2005; Fan et al., 2015; Freina & Ott, 2015; Han, 2020). Within these safe, interactive, and controlled environments, students experience experiential learning and practice complicated and demanding tasks to develop their cognitive skills (Çaliskan, 2011; Hamilton et al., 2021).
Moreover, as virtual reality promotes autonomous decision-making (Martí-Parreño et al., 2016a) and enables the representation of abstract concepts in a tangible manner, it enhances the overall learning process (Persky & McBride, 2009). Specifically, virtual reality improves students’ motivation (Garris et al., 2002), interactivity, and active participation (Roussou, 2004) and enhances knowledge acquisition and retention for the students who adapt better at kinesthetic, visual or auditory learning (Leite et al., 2010). When combined with experiential and project-based learning, virtual reality can boost students’ soft skills, communication capabilities and academic performance, enhance their critical and reflective thinking and knowledge dissemination and increase their psychomotor, cognitive, and social-emotional skills development and enjoyment (Araiza-Alba et al., 2021; Halabi, 2020; Jensen & Konradsen, 2018).
By embodying design principles that capitalize on gesture, voice, and hand controls (Johnson-Glenberg, 2018) in virtual environments, allowing students to interact with multimedia lessons and acquire knowledge easily and intuitively (Parong & Mayer, 2018) and combining various instructional techniques, the overall educational effectiveness and experience can be enhanced and applied in several educational levels, contexts, and subjects (Bowman et al., 1999). As a result, and due to the immersiveness and interactivity that virtual reality offers, it can lead to increased learning outcomes when compared to only instructor led teaching (Bailenson et al., 2008; Bowman et al., 2009; Webster, 2016). Despite this fact, teachers’ role is crucial in order for immersive technologies to be effectively applied within educational settings. Virtual reality enriches teacher education programs and provides future learning opportunities (Billingsley et al., 2019). Specifically, virtual reality can help fill in the gaps of training pre-service teachers by exposing them to various teaching and learning experiences and environments and enabling them to practice and hone their skills in fully controlled and safe environments (Christensen et al., 2011).
Several recent systematic literature review, overview, scientific mapping, meta-analysis, and bibliometric studies have examined the use of virtual reality in different educational levels and contexts (Cheng et al., 2022; Freina & Ott, 2015; Kavanagh et al., 2017; Luo et al., 2021; Radianti et al., 2020; Rojas-Sánchez et al., 2022; Villena-Taranilla et al., 2022) as well as the use of virtual reality head-mounted displays in educational activities (Jensen & Konradsen, 2018). Virtual reality can bring about positive learning behaviors and attitudes and through the hands-on experiences it offers, it supports effective learning experiences in both K-12 and higher education contexts (Natale et al., 2020) as it creates new opportunities to enrich students’ learning, support diverse teaching approaches and enhance students’ stimuli and motivation (Araiza-Alba et al., 2022). Consequently, virtual reality can be effectively applied in numerous educational settings and subjects (Merchant et al., 2014), such as science, technology, engineering, art, and mathematics (STEAM) (Birt & Cowling, 2017), chemistry (Edwards et al., 2019; Jiménez, 2019), physics (Bogusevschi et al., 2020), biology (Lee et al., 2010), mathematics (Kaufmann et al., 2000), geometry (Kaufmann & Schmalstieg, 2006), geography (Šašinka et al., 2018), language learning (Blyth, 2018), environmental science (Markowitz et al., 2018), geology (Klippel et al., 2019), engineering (Abulrub et al., 2011; Halabi, 2020), communication skills (Shorey et al., 2020), medical and healthcare (Pears et al., 2020; Yiannakopoulou et al., 2015), nursing and midwifery (Fealy et al., 2019), vocational designing (Kim et al., 2020), etc.
Gamification in education
Gamification can be applied in several contexts and has become a multidisciplinary field of study (Nacke & Deterding, 2017). Gamification is related to gameful experiences, gamefulness, and games in general, and it integrates the game elements, mechanisms, and principles that lead to games being fun, challenging, interesting, and engrossing into contexts that are not related to games to improve end-users’ engagement, motivation, and experience (Deterding, 2012; Deterding et al., 2011; Seaborn & Fels, 2015). As active methodologies are at the core of gamification and since game designs and theories capitalize on the psychological theoretical backgrounds of learning, the adoption and incorporation of gamification in educational settings to improve students’ learning outcomes, engagement, and experiences was anticipated. (Bai et al., 2020; Cechetti et al., 2019; Landers, 2014). Due to its nature, gamification can make the learning experience more interactive and entertaining and enhance students’ interest in the learning subjects, their involvement, self-efficacy, engagement, focus, and motivation and encourage them to achieve better academic outcomes (Bouchrika et al., 2019; Kim et al., 2017; Yildirim, 2017). The motivational elements of gamification can result in desired student behaviors and enhanced psychological states (Hamari et al., 2014; Hanus & Fox, 2015; Palomino et al., 2019).
Recent studies have gone over the merits, challenges, and limitations of adopting and integrating gamification in education (de Borges et al., 2014; Dicheva et al., 2015; Huang et al., 2020; Majuri et al., 2018; Manzano-León et al., 2021; Martí-Parreño et al., 2016; Nadi-Ravandi & Batooli, 2022; Nah et al., 2014; Sailer & Homner, 2019; Subhash & Cudney, 2018; Swacha, 2021). Gamification is an effective didactic approach that enriches the traditional education process and can bring about new potentials owing to its ability to be used in conjunction with other approaches and technologies (O’Donovan, 2012; Sanchez et al., 2011). Due to the benefits gamification could bring in education, studies have been conducted across all educational levels and in several subjects (Lampropoulos et al., 2022). Many studies have put emphasis on science, technology, engineering, art, and mathematics (STEAM) related subjects (López et al., 2021; Ortiz et al., 2016), such as physics (Rose et al., 2016), chemistry (Chans & Castro, 2021; Mellor et al., 2018), mathematics (Jagušt et al., 2018; Lo & Hew, 2018), geometry (Kamalodeen et al., 2021), and astronomy (Barringer et al., 2018). Other studies have focused on natural science (Rivas et al., 2019), environmental science (Jung, 2017; Ouariachi et al., 2020), and geography (Mahat et al., 2021). Particular interest has been shown in medical and healthcare education (Ang et al., 2018; McCoy et al., 2016; Nevin et al., 2014; Sandrone & Carlson, 2021), history and cultural heritage education (Bonacini & Giaccone, 2021; Moseikina et al., 2022), and language learning (Dehganzadeh & Dehganzadeh, 2020; Dehghanzadeh et al., 2019). Gamification has also brought about positive learning outcomes in music education (Gomes et al., 2014), sports and physical education (Fernandez-Rio et al., 2020; Ferriz-Valero et al., 2020) as well as vocational education (Jayalath & Esichaikul, 2020).
Methodology
After having analyzed the theoretical background of this study, it is important to present the methodology used. As this is a systematic literature review, it is essential for all the steps followed and choices made to be clearly displayed and analyzed to ensure the reproducibility of the process and results. Hence, this section presents the research design followed and goes over the literature review process.
Research design
A systematic literature review following the PRISMA statement (Page et al., 2021) was conducted to address the aims of this study and the aforementioned research questions. This approach was selected due to the scope and nature of the specific study as it examined empirical studies, proposal and prototype papers, as well as review, conceptual and theoretical articles. Due to its high standards, its rigorous rules, and its being successfully implemented and validated in diverse contexts and topics, the well-established PRISMA statement was adopted (Higgins et al., 2019; Liberati, 2009; Webster & Watson, 2002).
A thorough combination of keywords and five databases, that is ERIC, Google Scholar, IEEE, SCOPUS, and Web of Science (WoS), were used to retrieve related to the topic documents. The databases which had the most related and accurate documents were SCOPUS and WoS which further justifies their being considered as highly impactful scientific databases (Mongeon & Paul-Hus, 2015; Zhu & Liu, 2020).
Systematic literature review process
Aiming at covering the literature around this interdisciplinary topic, a thorough search formula was used which involved studies of all educational levels, types, and subjects throughout the years. As a result, the following query which integrates logical operators and wildcards was utilized: “(‘virtual reality’ OR ‘vr’) AND (‘gamif*’) AND (‘college*’ OR ‘education*’ OR ‘learn*’ OR ‘pupil*’ OR ‘school*’ OR ‘student*’ OR ‘teach*’ OR ‘universit*’)”. The query searched in the title, abstract, and keywords parameters (topic) of the related documents of the ERIC, IEEE, SCOPUS, and WoS databases. In the case of Google Scholar, the operator “allintitle” was used in combination with the keywords in succession (e.g., ‘virtual reality’ AND ‘gamification’ AND ‘college,’ ‘virtual reality’ AND ‘gamified’ AND ‘students’, etc.).
Figure 1 depicts the whole process and steps taken which adhered to and followed the PRISMA statement guidelines and rules. A total of 950 related documents were initially reported in the five databases (21 in ERIC, 39 in Google Scholar, 157 in IEEE, 492 in SCOPUS, and 241 in WoS) on 1st of August 2022. Of these documents, 270 duplicates were identified and removed. Therefore, a total of 680 documents were screened. To minimize subjective judgments, inclusion criteria were established by both authors. More specifically, the main inclusion criteria set were for each study: (i) to use virtual reality and gamification elements in conjunction; (ii) to refer to education or educational contexts; and (iii) to involve either an empirical study, the development of an educational application, a proposal or prototype, a systematic review, overview, or theoretical contributions. Both researchers of this study have independently screened the 680 documents based on the inclusion criteria set and focusing on the title, abstract, and keywords of the documents. After having completed this process, the researchers compared their results and resolved any disagreements through consensus between them. This process was selected to improve the reliability of the review and the outcomes.
Following this process, 530 documents were not included in the study as they did not conform to the research criteria. The remaining 150 documents were sought for retrieval and except for 5, the rest (145) were successfully retrieved. The eligibility of the remaining 145 documents was examined. Specifically, the researchers reviewed the method section of each study to further verify it meeting the inclusion criteria and the purposes of this study. Due to their not complying with the research criteria set, 33 more documents were eliminated. As a result, this review involves and examines 112 studies. An objective data extraction form was used. The specific kind of form was selected to minimize the threat of missing relevant information and of subjective interpretation. Additionally, the form was used by both researchers and the extracted information was cross-validated.
These specific studies were grouped into the following categories: (1) Empirical studies (66 articles, 58.93%); (2) Proposal and prototype papers (design-oriented without being applied in educational contexts) (31 articles, 27.68%); and (3) Review, conceptual and theoretical articles (15 articles, 13.39%) (RQ2). The area of focus, aims, suggestions, and main findings of the proposal and prototype articles were looked into. The review, conceptual, and theoretical articles were examined and their main findings were analyzed and presented. Finally, for the empirical studies, the following variables were identified and analyzed: (1) Country of experiment conduct; (2) Educational level; (3) Area of focus; (4) Developmental category; (5) Sample; (6) Main aims; (7) Research methodology; (8) MMAT category; (9) Main variables; (10) Measurement - Research instruments and tools; 11) Measures; 12) Application name; 13) Application development methodology; 14) Development tools; 15) Operating system; 16) Devices used in the experiment; 17) Degrees of freedom (DoF); 18) Representations; 19) Gamification elements; and 20) Main findings.
It is worth noting that due to the nature of this study, studies that adopt qualitative, quantitative, and mixed methods approaches are included within the Empirical studies category. Therefore, to further examine the studies included in this systematic review and more rigorously evaluate their quality, the Mixed Methods Appraisal Tool (MMAT) systematic assessment tool was used (Hong et al., 2018). This particular tool includes methodological criteria and five core quality criteria for each of the five categories in which it divides Empirical studies based on their study design. These categories are: (i) Qualitative, (ii) Randomized controlled, (iii) Non-randomized, (iv) Quantitative descriptive, and (v) Mixed methods (Hong et al., 2018).
Results
To analyze the data, a mixed-method research approach was followed (Creswell & Clark, 2017). The results are categorized into empirical studies (Tables 1, 2, 3 and 4), proposal and prototype papers (Table 5), and review, conceptual, and theoretical articles (Table 6). Figure 2 presents the countries in which the experiment and/or the study were conducted as well as the frequency of each type of study.
The complete results of the countries in which the studies took place are displayed in Fig. 2, both as the total number of published documents and based on their categories. Spain, Germany, the United States, Peru, and the United Kingdom were the countries that conducted most empirical studies. The countries that mostly contributed with proposal and suggestion papers were: Greece, Germany, Brazil, Malaysia, and Romania. Portugal and the United Kingdom were the two countries that contributed the most with review, conceptual, and theoretical articles. When taking all types of studies into consideration, Spain, the United Kingdom, Germany, Greece, and the United States were the countries that conducted the most studies on the use of gamification and virtual reality in education (RQ3). The publication frequency and type of study of each year are depicted in Fig. 3. The years 2019, 2020, and 2022 were the ones with the highest numbers of related publications (RQ4).
Due to the volume of studies explored and the variables analyzed, the data is grouped and presented into four tables. Table 1 displays the empirical study basic information (e.g., country, educational level, area of focus, developmental category, sample, and aims). The information related to the research approach (e.g., research method, main variables, and measurement-research tools) is presented in Table 2. The information concerning the developed application or system as well as the gamification mechanisms used (e.g., application name, development tools, operating system, device, and gamification elements) is depicted in Table 3. It must be mentioned that in Table 3 when there is only the indication “game-like features and mechanisms” in a study, it refers to the fact that a virtual reality game that entails gamification aspects was used but the specific gamification elements identified in other studies were not implicitly mentioned in the text or shown within the figures of the corresponding studies. Nonetheless, based on the inclusion criteria and scope of this study, such studies are deemed appropriate for inclusion as they combine virtual reality with gamification and are applied in educational settings. Finally, the main findings of each study are presented in Table 4 (RQ5).
Several observations can be made based on the aforementioned information. Higher education (71.21%) was by far the educational level that most studies focused on, followed by secondary education (10.61%). Primary education (4.55%) and K-12 (3.03%) had fewer related studies. In total, 7 studies (10.61%) did not specify a particular age group or educational level. Figure 4 presents the information related to the educational level that the studies focused on (RQ6). As shown in Fig. 5 (RQ7), increasing student cognitive development (93.94%) was the main focus of the experiments while fewer studies put emphasis on student cognitive and social-emotional development (4.55%) and physical development (1.52%).
Furthermore, the experiment sample consisted mostly of students, but there were also studies that explored the attitude, experience, and views of teachers (RQ8). The goal of most studies was to provide students with an interactive, fun, and interesting learning environment to improve their learning experience and outcomes and enhance their engagement and motivation (RQ9). The main area of focus of the empirical studies was STEAM-related fields (e.g., physics, chemistry, computer science, arts, mathematics), followed by medical and healthcare education, language learning, and engineering (RQ10).
Based on Table 2, most studies adopted a quantitative research approach (63.64%), followed by mixed-method approach (24.24%) and qualitative approach (12.12%). The variation of methods used assists in acquiring collective insights to improve user experience (UX) (Nielsen, 2000). Figure 6 presents the related to the research methodology information (RQ11). Moreover, the research approach of the studies was further examined using the MMAT. Particularly, most studies adopted a Quantitative descriptive approach (39.39%), followed by mixed methods (Qualitative and Quantitative descriptive) approach (16.67%), Randomized controlled approach (13.64%), Qualitative approach (12.12%), and Non-randomized approach (10.61%). The Mixed methods (Qualitative and Randomized controlled) (4.55%) and Mixed methods (Qualitative and Non-randomized) (3.03%) approaches were also used but to a lesser extent. The relevant to the MMAT category information is showcased in Fig. 7 (RQ11). Several validated in the educational context questionnaires were used. Some examples of those are: the System Usability Scale (SUS) (Brooke, 1996), the Presence Questionnaire (Witmer & Singer, 1998), the Game Engagement Questionnaire (GEQ) (Brockmyer et al., 2009), Technology Acceptance Model (TAM) (Davis, 1993), the Simulator Sickness Questionnaire (Kennedy et al., 1993), the NASA task load index (Hart & Staveland, 1988), the Presence Questionnaire (PQ) and the Immersive Tendencies Questionnaire (ITQ) (Witmer & Singer, 1998), the Post-Study System Usability Questionnaire (PSSUQ) (Lewis, 2002), the User Experience Questionnaire (UEQ) (Laugwitz et al., 2008), the Immersion and Presence Questionnaire (IPQ) (Schubert et al., 2001), the Virtual Reality Sickness Questionnaire (VRSQ) (Kim et al., 2018), the Use, Satisfaction, Ease to use (USE) questionnaire (Lund, 2001), and the Questionnaire to Assess Current Motivation in Learning Situations (CQM) (Rheinberg et al., 2001). Beyond the use of already validated questionnaires, most studies implemented ad hoc questionnaires or surveys. There were also studies, such as (Chávez et al., 2020; Chiang, 2021; Falah et al., 2021; Makransky et al., 2019; May & Denecke, 2020; Palmas et al., 2021), which adopted items from existing evaluation tools (RQ11). Most of the studies used student related variables, such as experience, acceptance, motivation, performance, satisfaction, feedback, and viewpoints (RQ11). Additionally, given the tools used, the variables analyzed, and the participants, the measures of each study were divided into objective, subjective, or both. The measures of the vast majority of the studies were subjective (68.18%), followed by objective and subjective (21.21%), and objective (10.61%). The related to the measures information is depicted in Fig. 8.
It was obvious that there was a clear lack of detailed descriptions regarding the development approaches, processes, and tools used as well as of a display of examples of the application and the experiments. Additionally, the paucity of technical information and of provision of resources and repositories was apparent. Design-based research methodology (Ahlers et al., 2022; Rosmansyah et al., 2019), collaborative design (Wilson et al., 2017a), user-centered approach (Wilson et al., 2017b), and instructional design approach (Vagg et al., 2016) were some examples of the methodologies and approaches used to develop the educational applications. Most studies used Windows as the operating system of their application (56.06%), followed by android (12.12%), while some studies developed cross-platform applications (12.12%). A significant number of studies did not report a specific operating system (27.27%) or devices used (12.12%) (RQ12). Furthermore, the HTC Vive head-mounted devices were mostly used to conduct the experiments (37.88%), followed by general purpose head-mounted devices (27.27%), and the Oculus Rift (13.64%). Figure 9 presents the information related to the application operating system while Fig. 10 depicts the frequency of the devices used during the experiments. Although several studies did not specify the Software Development Kit (SDK) that they used, based on those which did, Unity was by far the most commonly used SDK (56.06%), followed by Unreal Engine 4 (9.09%), Oculus Rift Development Kit (9.09), and Google VR SDK (6.06%) (RQ13). To further analyze and understand the specifications and nature of the gamified virtual reality applications used in education, their DoF and their representation of content were examined. The vast majority of applications used 6-DoF (62.12%), followed by 3-DoF (37.88%) as it can also be seen in Fig. 11 (RQ14). Additionally, the overwhelming majority of applications used immersive virtual reality content and environments (92.42%) while only a few used 360-degree content (7.58%). The representations used in the applications examined are presented in Fig. 12 (RQ14). Regarding gamification elements, the use of game-like features and mechanisms was widely adopted and elements, such as points and scores, tasks and quests, quiz questions, virtual achievements and rewards, difficulty levels, feedback, mini-games, and leaderboards were integrated within the educational applications (RQ15).
The main findings of the related empirical studies are presented in Table 4. Most results revealed positive learning outcomes and acceptance by the educational community. More details and comments on the results are listed in the summary and discussion sections.
Information regarding the proposal and prototype studies are presented in Table 5. Based on the results, most studies focused on higher education (74.19%), followed by K-12 (12.90). Some studies (12.90%) did not specify the educational level or age group that their proposed application was aiming at (Fig. 13). In this category of studies, there was no study that was targeting at primary or secondary education. STEM-related fields, medical and healthcare education, and engineering were the main focus areas of these studies (RQ10). Finally, the aims and main findings of the review, conceptual and theoretical articles are presented in Table 6.
Summary of the results and main findings
When taking into consideration the findings of the studies analyzed, it can be concluded that the use of gamification and virtual reality, as well as their combination in education can affect the educational process positively and yield benefits for both teachers and students (RQ16). To answer RQ1, the conclusions, results, and findings of the related studies were summarized. In the context of this study, the educational benefits that can be yielded through the use of gamified virtual reality refer to the aspects that render teaching and learning more effective, the new educational opportunities that arise, the positive learning outcomes, the elements that lead to the cognitive, social-emotional, and physical development of students, as well as the aspects that result in students’ personal development and well-being. The integration of gamification and virtual reality in education can support technology-enhanced learning and the transformation of traditional education, facilitate and support teachers, and satisfactorily meet students’ educational needs and requirements; thus, improving the overall teaching and learning experience. But in order for this to be achieved, student habits, knowledge, requirements, personalities, experiences, and characteristics must be taken into account and appropriate educational strategies and methods should be adopted. By utilizing virtual reality and gamification in conjunction, secure, safe, immersive, and interactive learning environments that have students at their core can be created. These environments promote active involvement, offer a sense of presence, provide personalized learning experiences, allow students to learn both individually and collaboratively, to experience environments and situations, and to participate in activities that would not be possible otherwise. Students that experienced learning in such gamified environments demonstrated better academic performance, enhanced motivation and engagement, improved psychological states and behaviors, and increased knowledge acquisition and retention. Students felt that these environments made them more focused, stimulated their imagination and curiosity, facilitated the comprehension of the subject, and were more intriguing, fun, and interesting compared to traditional learning. Most studies reported positive outcomes and very few reported some neutral or negative results (e.g., motion sickness).
It is important to note that besides students’ assessing the use of gamification and virtual reality in the educational process positively, teachers were also favorable toward it and willing to familiarize themselves with using them and to create related educational material. This is particularly significant since teachers’ role is essential for student development and the productive and efficient conduct of the educational process. Hence, teachers’ acceptance of virtual reality and gamification and acknowledgement of the benefits they can yield is determining for their adoption and integration in educational settings. Based on the results, and the research instruments used to assess the applications, the development and validation of assessment instruments is a must.
According to the aforementioned results, the countries which explored the use of gamification and virtual reality in teaching and learning activities the most were Spain, the United Kingdom, Germany, Greece, and the United States. The studies were conducted in 37 different countries around all inhabited continents; thus, supporting the idea that the use of virtual reality and gamification in education has attracted worldwide interest. Most studies were published during the years 2019, 2020, and 2022, focused on higher education and put emphasis on medical and health-care education, STEM subjects, language learning, and computer science. The majority of studies involved students, used quantitative research methods, and aimed at evaluating the effect of gamification and virtual reality in education and understanding the participants’ perceptions and experience. As a result, most of the measures were subjective. Based on the MMAT, the quantitative studies mostly adopted the Quantitative descriptive approach, followed by Randomized controlled and Non-randomized approaches which were used to a lesser extent. The mixed methods studies mostly used a qualitative approach in combination with a Quantitative descriptive approach, followed by qualitative and Randomized controlled as well as qualitative and Non-randomized approaches to a far less extent. The most popular device was HTC Vive (Pro), Windows was the most widely used operating system, and Unity was by far the most commonly used development platform. It is worth noting that several studies did not use any specialized equipment but low-cost head-mounted devices which led to positive results, nevertheless. Students’ cognitive development was the main focus of most studies; hence, the need to further analyze and comprehend the effect of gamification and virtual reality on student social-emotional and physical development is evident.
Discussion
Educational and societal needs and demands evolve along with technology; hence, the emergence of new pedagogical approaches and the use of technological applications in teaching and learning are inevitable (Ribeiro et al., 2019). Ethical, moral, and cultural factors (Hincapie et al., 2021; Lally et al., 2012) and students’ needs, pursuit for more active and meaningful learning, characteristics, personality traits, and learning styles should be taken into account to facilitate the adoption and integration of Information and Communication Technologies (ICT) in education and to create educational experiences and activities that will lead to better learning outcomes (Bayne, 2014; DiLullo et al., 2011; Hussin, 2018). By incorporating technology-enhanced learning and multimedia learning into educational contexts, traditional teaching and learning activities can be transformed, the educational process becomes more student-centered and personalized and the educational material can be enriched with multimedia to be more effective and interactive (Djurovic & Djurovic, 2010; Sung et al., 2016).
Virtual reality supports multimedia learning and the cognitive theory of multimedia learning (Parong & Mayer, 2018) which states that when compared to solely textual information, the use of audiovisual information can lead to more engaging learning experiences which, in turn, result in improved learning outcomes (Mayer, 2020; Mayer & Moreno, 1998). As it becomes more widely adopted, the number of related applications and educational material increases while the required equipment becomes more affordable and advanced (Jensen & Konradsen, 2018). Additionally, although the devices used affect the overall student experiences and learning outcomes (Alamäki et al., 2021; Merchant et al., 2014), when designing student-centered approaches that take the unique student characteristics and environment conditions into consideration, even lower-end devices can bring about increased learning results (Adnan et al., 2020). Consequently, the use of virtual reality is gaining ground in both K-12 education (Merchant et al., 2014) and higher education (Freina & Ott, 2015). The effectiveness of virtual reality in education can be further increased through the use of gamification, several aspects of which are based on educational psychology (Kapp, 2012; Simões et al., 2013). The integration of gamification in education can positively affect students’ cognitive and affective domains (Mullins & Sabherwal, 2020; Ritzhaupt et al., 2021), increase their intrinsic and extrinsic motivations (Dicheva et al., 2015; Van Roy & Zaman, 2018), and improve their behavioral and psychological states (Kim et al., 2017) which, in turn, can increase learning outcomes and student engagement (Wigfield et al., 2019).
Both virtual reality and gamification play a vital role in transforming traditional education and enriching current teaching and learning activities as well as in creating new instructional media, theories, and designs as well as novel pedagogical approaches and methodologies (An, 2021; Beck, 2019; Johnson et al., 2015). Specifically, immersive and interactive learning experiences, which occur in safe and secure virtual environments and can result in new teaching and learning opportunities and educational benefits, can be created through the use of gamification and virtual reality (Dede, 2009; Shapley et al., 2011). These environments are in line with active learning methodologies (Bai et al., 2020; Murillo-Zamorano et al., 2021), the motivational theory (Malone & Lepper, 1987), the engagement theory (Kearsley & Shneiderman, 1998), and the instructional theory (Dede et al., 2017; Rupp et al., 2019) as they motivate students to be engaged, participate actively, and remain committed to the educational activities and they enable them to cultivate their skills through hands-on experiences in both real-like and imaginary scenarios and conditions that otherwise would be impossible. As these immersive environments support experiential learning and offer personalized and authentic learning experiences, they allow students to play a central role in the learning activities which they can control and personally experience at their own pace (Brown et al., 1989; Kolb, 2014). As a result, students become more eager, inclined, focused, enthusiastic, and motivated to learn and actively participate in educational activities, stay engaged and interested longer, and attain better learning achievements (Barab et al., 2007; Robson et al., 2015; Roseth et al., 2008; Sharan, 2010). The gamified virtual reality environments can provide meaningful learning (Fan et al., 2015), increase student learning motivation and involvement (Alsawaier, 2018; Buckley & Doyle, 2014), and positively affect their emotions (López-Faican & Jaen, 2020) which are essential aspects of effective education (Pekrun & Linnenbrink-Garcia, 2014; Tokan & Imakulata, 2019) and can bring about positive learning attitudes and behaviors (Kiili, 2005) and increase students’ engagement (Swartout & Lent, 2003), higher-order thinking (Crocco et al., 2016), knowledge acquisition, and learning outcomes (Huang et al., 2020). These environments create an interactive and positive climate (Hamari et al., 2014), promote and support inclusive and ubiquitous learning, foster social interactions, cooperation, satisfaction, and positive behaviors, and create opportunities for effective collaborative learning (Gimbert & Cristol, 2003; Hamari & Koivisto, 2015; Liu et al., 2017; Pozo-Sánchez et al., 2022). Therefore, besides the benefits in terms of learning outcomes and knowledge acquisition, students can also cultivate their 21st century skills, critical thinking, decision-making, emotional awareness, and social skills which are vital in modern society in these immersive environments (National Research Council, 2012; Romasz et al., 2004).
Therefore, due to the potential impact that the adoption and integration of gamified virtual reality applications and experiences can yield in the educational domain, this study focuses on analyzing the existing literature to achieve a deeper understanding of the topic. Several valuable findings and insights emerged from this analysis. Despite the recency of the specific topic, empirical studies, proposal and prototype papers as well as review, conceptual and theoretical articles have already been published. This fact further validates the significance of the topic and its vast potentials to enrich the educational process. In contrast to the number of empirical studies and proposal and prototype papers that have already been published, there is a clear lack of theoretical articles that analyze the state-of-the-art and create the theoretical basis of this expanding research area. This specific study aims at filling this gap in the existing literature. Based on the data, the years of 2019 and 2020 had the largest number of related documents published. Given the fact that virtual reality HMDs became more easily accessible in 2016, the interest in them has been increasing since 2017 which is justifiable as new technologies require additional time to start being adopted in education. Moreover, Occulus Rift and HTC Vive and the different versions of theirs, which were mostly used in the studies examined, have been released since 2016 which led to an increase in empirical studies being conducted. The number of related documents being published has increased over the years and as the required equipment becomes more affordable, advanced, and accessible, it is expected that this number will be increasing. The reach and interest in this topic can also be observed since countries around all inhabited continents have actively been exploring this area of study. This is particularly interesting when taking the different social, cultural, economic, and political aspects that characterize education around the world into account. This fact highlights the applicability and suitability of gamified virtual reality applications and experiences to be adopted and integrated in different environments. Despite the fact that 37 different countries have contributed in this field, there is a clear lack of cross-country and cross-cultural studies being conducted. It, thus, remains difficult to generalize and specify how particular characteristics and elements of gamified virtual reality applications affect education and learners around the world since direct comparisons cannot be made due to the numerous differences. Therefore, there is a clear need for more such studies to be carried out so that the implications and effects of gamified virtual reality applications can be objectively studied in depth and from different dimensions.
Due to its nature, the use of gamified virtual reality applications has been adopted and examined in all educational levels. This fact highlights their flexibility, adaptability, and usability to be integrated to meet learners’ needs throughout their development. However, the vast majority of empirical studies as well as proposal and prototype papers focused on higher education, as it can be seen in Table 7. This outcome can be attributed to several reasons. For example, higher education students are more familiar with and accustomed to using new technologies, have a better understanding of their learning needs, and a better cohesion of technological applications. The topics and subjects being actively examined are more complex and suitable for higher education students and the evaluation tools used more appropriate for them as well. Additionally, it is easier to conduct virtual reality experiments involving higher education students since in some cases feelings of nausea have been reported with younger students. Another reason can be the differences in bureaucratic processes and ethical concerns that are required to carry out experiments between adults and underage participants. Finally, although the required equipment is becoming more accessible, higher education institutes are better and more appropriately equipped to carry out experiments, particularly the ones that are actively researching and developing virtual reality contents and applications. Despite this fact, there is a clear need for more studies that focus on primary, secondary, and K-12 education to be conducted so that the effect of gamified virtual reality applications on education can be more objectively assessed.
As far as the Empirical studies are concerned, the vast majority of studies (69.70%) used only students as their sample (Fig. 14). Some studies did not specify the exact sample nor provided age or background details and referred to the educational stakeholders that responded as participants (19.70%). Studies also focused on analyzing teachers’ perspectives. This fact highlights the important role of meeting students’ needs and having them at the core of new technology integration in education. Hence, it is important to take students’ viewpoints and feedback into account when developing gamified virtual reality applications and incorporating them in cooperative design approaches. Nonetheless, there is a need for more empirical studies to be conducted focusing on teachers to better comprehend their viewpoints, attitudes, acceptance, and readiness to integrate such solutions. Identifying teachers’ needs and the specific skills they lack to integrate gamified virtual reality in their classrooms would assist in creating and organizing appropriate and more effective training programs that would improve their skills and enhance their readiness to adopt such novelties. Moreover, the overwhelming majority of the studies examined focused on developing and testing gamified virtual reality applications to assess the participants’ viewpoints and the impact they can have in education. As the topic is in its infancy, specialized aims were not observed. Therefore, future studies should put emphasis on analyzing how gamified virtual reality applications can influence specific areas of the educational process or specific variables associated with students’ learning rather than focus on more generalized aims.
Due to its nature, gamified virtual reality can be applied in various subjects across all educational levels. Hence, the studies examined span across several educational topics, subjects, and areas. As it can be seen in Tables 8 and 9 topics emerged when clustering the documents based on the subject they involve. The topics that emerged based on the most popular areas of study are medical and healthcare education (21.21%), followed by language learning (10.61%), STEM (10.61%), arts (9.09%), computer science (9.09%), engineering (7.58%), general skills (7.58%), architecture and design (6.06%), and cultural heritage (6.06%). As the name suggests, studies that could not be included in one of these categories and could not be grouped with others into new categories were clustered in the “Other educational topics” category (12.12%). Furthermore, no matter the subject, educational level, or sample, the significant majority of studies focused solely on the cognitive developmental area (92.42%). Only 3 out of the 66 empirical studies explored social-emotional development (Pinzón-Cristancho et al., 2019; Reitz et al., 2016; Šašinka et al., 2018) and only a single study focused entirely on participants’ physical development (Senecal et al., 2020). Specifically in education, understanding how a specific intervention can affect all developmental areas of students and learners is crucial for ensuring its effective and appropriate adoption and integration. Hence, there is a clear need for more studies that take into account the influence of gamified virtual reality applications on participants’ social-emotional and physical development.
Regarding the research approach and based on Table 10, most of the studies adopted a quantitative approach (63.64%), followed by Mixed (24.24%) and qualitative (12.12%) approaches. Moreover, based on the MMAT tool, the quantitative studies were separated into Quantitative descriptive (39.9%), Randomized controlled (13.64%), and Non-randomized (10.61%) categories while the mixed method studies were divided into Qualitative and Quantitative descriptive (16.67%), Qualitative and Randomized controlled (4.55%), and Qualitative and Non-randomized (3.03%) categories. This fact highlights the multidimensional nature of this topic and its ability to be examined from different angles and using different methods. In addition to the different approaches used to explore this topic, the studies examined used various measurement and research tools (Table 9). The vast majority of studies used ad hoc questionnaires and surveys (66.67%), followed by existing validated tools (27.27%) with TAM (Davis, 1993) being the most commonly used tool. Interviews and discussions (21.21%) as well as observations (13.64%) were also used but to a lesser extent. Studies that used pre-test and post-test (16.67%) or application related data (12.12%) were also conducted and led to more objective results. Few studies (6.06%) used specific task-related tools to evaluate the impact of gamified virtual reality applications.
Given the different methods, approaches, and tools used, several variables have been examined throughout the studies included in this systematic review. When clustering the variables based on the frequency of use, 7 main variables were identified (Table 11). In particular, the studies focused on analyzing: (i) the participants’ viewpoints, attitudes, and experiences (59.09%), (ii) usability and ease of use (31.81%), (iii) learning outcomes, achievements, and skills development (30.30%), (iv) enjoyment, satisfaction, and acceptance (19.70%), (v) effectiveness (13.64%), (vi) motivation (9.09%), as well as (vii) knowledge acquisition and comprehension (7.58%). When looking into the approaches, the tools, the sample, and the main variables used, it is not surprising that the measures of the vast majority of studies were subjective (68.18%) as it can be seen in Table 12. Some studies (21.21%), mostly those that applied mixed method approaches, resulted in both objective and subjective measures. Finally, few of the studies led to strictly objective measures (10.61%) and these were mostly studies that adopted pre-tests and post-tests or used application-related data. Based on the aforementioned results, it can be concluded that there is a clear need for more standardized and validated tools to be developed to more effectively evaluate gamified virtual reality learning experiences and to a greater extent extended reality experiences. These tools will also allow for comparative studies to be conducted. Additionally, more studies should focus on providing objective measures rather than rely solely on subjective measures through the analysis of the participants’ perspectives, opinions, and experiences. Finally, many studies focus solely on collecting and analyzing data derived only after the intervention which hinders the understanding of its true impact. Hence, future studies should focus on collecting data prior to the intervention so that comparisons with the data gathered after the intervention can be made to better comprehend the influence of the intervention. Comparative studies among different populations and topics should be promoted.
Although many of the studies did not provide many details and specifications about the development of their application (e.g., the application development methodologies or system design), some findings emerged from the data extracted. Most studies used Windows (59.09%) as the operating system of their application, followed by android (13.64%) and few studies (4.55%) used different operating systems (Table 13). It is worth noting that only two studies (May & Denecke, 2020; Pinzón-Cristancho et al., 2019) explicitly indicated that their applications can be used in multiple operating systems. When we take into account the development tools used, of which Unity was by far the most used platform (56.06%) and given its ability to allow cross-platform development, it should be mentioned that potentially more applications could be cross-platform but were only examined using specific operating systems and devices. Other popular development tools and platforms (Table 14) that were used to develop the applications were: Unreal Engine (9.09%), Oculus Rift Development Kit (9.09%), SteamVR (7.58%), and Google VR SDK (6.06%). Different types of HTC Vive head-mounted devices were most widely used (37.88%) to carry out the experiments. General purpose head-mounted devices (27.27%) as well as the Oculus Rift (13.64%) were also used. These outcomes highlight several areas that can be further examined in the future. Due to the variety of the tools, the applications, and the approaches used as well as the differences in environments and settings, comparisons regarding the effects that different devices, platforms, and operating systems might have could not be explored. As the operating system and the platform may not significantly affect the outcomes, given the fact that many end-users are unaware of or disinterested in them, future studies should focus on exploring which devices can lead to better outcomes through the comparison of different devices in the same experimental settings. Additionally, future studies should provide more specifications about their applications and the development process so that their influence could be examined in more detail. It would also be worth exploring how different design and development approaches and methodologies could affect the impact of gamified virtual reality applications.
Presence and immersion are vital aspects in any virtual reality experience. Based on the results of the studies examined, the higher the presence and the immersion of a student is, the better the learning outcomes and educational benefits are. DoF and content representation are elements that affect students’ presence and immersion in the virtual environment. Based on Table 15, the vast majority of studies used 6-DoF (62.12%) while the rest used 3-DoF (37.88%). It is worth noting that most recent studies opted to use 6-DoF. Hence, it can be inferred that it is preferrable to allow students to more freely move within the virtual world and interact with their surroundings rather than restrict them as they will be able to become fully immersed and explore the virtual environments on their own. Nonetheless, based on the topic or subject to be explored, in some cases 3-DoF was used and led to increased learning outcomes. To determine how different DoF affect students and their learning experiences and outcomes, there is a clear need for carrying out more studies that directly compare applications with the same content and overall experience but with different DoF in the same settings and environments. Regarding content representation (Table 16), the overwhelming majority of the studies used immersive virtual reality (92.42%) rather than 360-degree content (7.58%). Based on the results, it can be inferred that by engaging themselves in immersive virtual reality environments and interacting with contents, objects, and other users, students become more engaged and immersed in the overall experience which, in turn, increases the educational benefits yielded. Gamification elements can also affect students’ presence and immersion as well as the overall learning experience and outcomes. Although game-like features and mechanisms were widely used across all studies examined in this systematic review, particular gamification elements including scores and points, quests and tasks, quizzes, virtual rewards and achievements, difficulty levels and challenges, feedback, mini-games, and leaderboards were observed in the majority of studies. Despite the fact that different gamification elements can affect learners’ presence, immersion, experience, and learning to a different degree, the variety in the nature of the applications, the experiments, and the environments did not allow the examination of the most optimal and impactful use of gamification elements. Future studies should focus on examining and comparing the influence that different gamification elements and their combination can have to determine the ones that improve and enrich the educational process more. In addition, besides the impact they can have on the educational process, future studies can also look into how different gamification elements can affect students.
Examining the impact of gamified virtual reality applications and experiences on education was a focal point of this study. It is worth noting that differences in terms of gender and age were also observed with younger participants showcasing more openness and acceptance of the integration of gamification and virtual reality learning experiences. Additionally, girls showcased higher levels of immersion and acceptance (Chiang, 2021; Fonseca et al., 2017a, 2020; Mouronte-López et al., 2020). Despite this fact, the overwhelming majority of the studies reported positive educational outcomes. To better understand the benefits and merits yielded through the integration of gamification and virtual reality in education, a thematic analysis of the benefits identified was conducted, the results of which can be seen in Table 17. A total of 18 broad categories were identified. More specifically, the adoption and integration of virtual reality and gamification in the educational process is positively viewed and accepted by the educational stakeholders and they are regarded as effective educational tools that can enrich and improve teaching and learning in all educational levels. Furthermore, the use of gamification and virtual reality applications can increase learning outcomes and academic performance and improve motivation, engagement, and active participation.
Being enriched with gamifiation elements and mechanisms, virtual reality experiences can also increase interaction, communication, and collaboration and improve knowledge acquisition and material comprehension. The gamified virtual reality environments offer enhanced immersion and provide students with realistic experiences which increase their satisfaction and enjoyment, improve their concentration and focus, and enhance their curiosity and creativity. Students’ social presence and sense of belonging to a group of people and relating to them can also be improved. As students are able to participate in experiential learning and gain hands-on experience in safe and secure environments, their skills, competences, and knowledge are increased and as a result, their self-efficacy is improved. When students experience environments that are characterized by high levels of realism and apply their theoretical knowledge into practice, better learning achievements can be yielded. These interactive environments that are easy to use and navigate can offer adaptive and personalized experiences and feedback and provide enjoyable, fun, and interesting learning environments. Based on the aforementioned, it is clear that the use of virtual reality and gamification in education can improve and enrich the overall educational process and create opportunities for new teaching and learning experiences. Through these immersive environments, students can experience ubiquitous learning in environments and settings that would have been impossible otherwise.
Other benefits were also observed but to a lesser extent. These benefits include: improved cross-cultural understanding (Zhang et al., 2016), creation of learning experiences that would have been impossible otherwise (Silva et al., 2021; Tan et al., 2022), opportunities for hands-on experiences in safe environments (Alexander et al., 2022), reduced costs and resources (Yengin & Bayrak, 2019), minimized risks (Muñoz et al., 2022), enhanced physical condition (Theethum et al., 2021), flexibility and accessibility (Abuhammad et al., 2021), as well as opportunities to create new formal and informal learning experiences (Bahrin et al., 2022) among others.
As technology improves and people around the world are becoming more connected through it, new opportunities arise to experience learning surrounded by and interacting with people and experts from all over the world within completely virtual environments, such as the metaverse. Although various educational benefits emerged in these studies, it is important for future studies to focus on objectively assessing and measuring the degree of impact that the use of virtual reality and gamification can have in education across different settings, educational levels, countries, cultures, and subjects in comparison to traditional face-to-face learning, online learning, and other novel solutions.
To design and develop such multimodal environments that offer meaningful learning experiences and increased learning outcomes and do not overload students with extensive information (Moreno & Mayer, 2007), several factors should be considered (Dondlinger, 2007; El-Masri & Tarhini, 2015; Nicholson, 2014) and specific design principles should be followed (Mayer, 2020). Additionally, to create effective learning experiences that integrate virtual reality and gamification, teaching and learning styles (Fan et al., 2015; Huang et al., 2019), learning objectives (Kiryakova et al., 2014), gamification elements (Tiefenbacher, 2020), student characteristics, and the specific activities, contexts, and environment conditions should be taken into account (Kukulska-Hulme et al., 2020). Creating or acquiring the required educational material, the cost of equipment, and the feelings of nausea that some younger students sometimes experience should also be taken into consideration (Chiang, 2021; Vagg et al., 2016). These experiences should provide clear and concise instructions and aims (AlKhateeb et al., 2019; Mayer, 2005), guided activities that stimulate student intrinsic and extrinsic motivations (Zichermann & Cunningham, 2011), real-time and personalized feedback (Palmas et al., 2021; Sweetser & Wyeth, 2005), and allow students to learn at their own pace, reflect upon their results, and control the activities themselves (Moreno & Mayer, 2007). Hence, student-centered approaches should be followed when designing and creating such experiences (Alharbi et al., 2020). The role of educators in the adoption and integration of new technologies and ICT in educational activities is vital (Comi et al., 2017; Iquira et al., 2019). Therefore, educators along with students should be actively involved in the design and development of educational activities and applications as their experiences and viewpoints can help develop more effective learning experiences and environments that lead to increased academic performance (Cober et al., 2015). Moreover, it is crucial to provide teachers with the required training to develop both their technical and pedagogical digital competencies (Tømte, 2015) and not only to familiarize themselves with new technologies and approaches and learn how to effectively use and integrate them in their classroom, but also to create appropriate digital educational material (Davis & Roblyer, 2005). As the process of developing virtual reality applications can be challenging and complicated for non-tech-savvy people, there is a clear need to create educational tools that will facilitate the design and development process and will enable teachers to produce educational material for virtual reality environments. Finally, as the use of gamification and virtual reality in education is becoming more widespread, the need to develop widely accepted standards, guidelines, and reliable assessment instruments and validate them in different contexts is imperative.
Conclusions
As educational and societal needs and demands have changed, traditional learning needs to be reinforced and transformed through the use of new technological applications and approaches to adapt and meet the new requirements. The use of gamification and virtual reality in educational contexts is becoming more popular as a means to satisfy students’ pursuit for more interactive, immersive, engaging, and meaningful learning.
Aiming at examining the existing literature regarding the adoption and integration of virtual reality and gamification in education, this study involved the conduct of a systematic literature review following the PRISMA statement. Particularly, no limitations were set in terms of year of publication, educational levels, type of study, and subjects to provide a more comprehensive overview of the topic. Using a versatile search query, 950 related documents were retrieved from 5 scientific databases. After having examined the articles, in total 112 were included in this study. These articles were separated into empirical studies, proposal and prototype papers, and review, conceptual, and theoretical articles. Moreover, 16 research questions were set and answered through the analysis of these articles.
Based on the results, the use of gamification can positively influence educational activities and enrich virtual reality experiences to create more interactive, engaging, and motivating learning environments. The vast majority of studies reported positive outcomes regarding learning achievements and student satisfaction. Both students and teachers positively assessed their use in education, highly regarded their role in transforming traditional teaching and learning activities, and greatly valued the merits that they can bring in the educational process by facilitating and supporting teachers and successfully meeting student requirements and demands for more effective learning. Additionally, the use of gamification and virtual reality is in line with several pedagogical theories and approaches.
Learning environments that integrate virtual reality and gamification allow students to individually and collaboratively experience environments, situations, and conditions and partake in educational activities that otherwise would be impossible. Within these virtual, safe, and secure environments, students can get hands-on experiences and cultivate their skills. These environments offer personalized learning experiences, provide a sense of presence, and promote active participation. Furthermore, the gamified virtual reality environments facilitate comprehension of the subjects taught, allow students to be more focused, and increase their curiosity and imagination. When compared to traditional learning, these environments are more intriguing, interactive, and enjoyable. Students’ learning experiences in such settings resulted in improved learning outcomes and academic performance, increased motivation and engagement, and enhanced knowledge acquisition. Positive changes in students’ attitude, behavior, and mentality and improved cognitive, physical, and social–emotional development were also observed. To design and develop more effective learning environments that integrate gamification and virtual reality and reap their full benefits, appropriate strategies, principles, and methods should be followed, teachers’ digital literacy skills and ability to incorporate such environments in their classrooms should be taken into account, and students’ unique personality traits and characteristics, knowledge, interests, habits, and preferences should be considered.
Data availability
The dataset analyzed in this study is available from the corresponding author upon reasonable request.
References
Abuhammad, A., Falah, J., Alfalah, S. F. M., Abu-Tarboush, M., Tarawneh, R. T., Drikakis, D., & Charissis, V. (2021). MedChemVR: A virtual reality game to enhance medicinal chemistry education. Multimodal Technologies and Interaction, 5(3), 10. https://doi.org/10.3390/mti5030010.
Abulrub, A. H. G., Attridge, A. N., & Williams, M. A. (2011). Virtual reality in engineering education: The future of creative learning. 2011 IEEE Global Engineering Education Conference (EDUCON), 751–757. IEEE. https://doi.org/10.1109/EDUCON.2011.5773223.
Adjorlu, A., & Serafin, S. (2020). Co-designing a head-mounted display based virtual reality game to teach street-crossing skills to children diagnosed with autism spectrum disorder. In Lecture notes of the institute for computer sciences, social informatics and telecommunications engineering (pp. 397–405). Springer. https://doi.org/10.1007/978-3-030-53294-9_28.
Adnan, A. H. M., Shak, M. S. Y., Karim, R. A., Tahir, M. H. M., & Shah, D. S. M. (2020). 360-degree videos, VR experiences and the application of education 4.0 technologies in Malaysia for exposure and immersion. Advances in Science Technology and Engineering Systems Journal, 5(1), 373–381.
Ahlers, T., Bumann, C., Kölle, R., & Lazović, M. (2022). Foreign language tandem learning in social VR. I-Com, 21(1), 203–215. https://doi.org/10.1515/icom-2021-0039.
Alamäki, A., Dirin, A., Suomala, J., & Rhee, C. (2021). Students’ experiences of 2D and 360 videos with or without a low-cost VR headset: An experimental study in higher education. Journal of Information Technology Education: Research, 20, 309–329. https://doi.org/10.28945/4816.
Alexander, B., Hou, Y., Khan, B., & Jin, J. (2022). Learn programming in virtual reality? A case study of computer science students. 2022 IEEE Global Engineering Education Conference (EDUCON). IEEE. https://doi.org/10.1109/educon52537.2022.9766621.
Alharbi, A., Aloufi, S., Assar, R., & Meccawy, M. (2020). Virtual reality street-crossing training for children with autism in Arabic language. 2020 International Conference on Innovation and Intelligence for Informatics, Computing and Technologies (3ict), 1–6. IEEE. https://doi.org/10.1109/3ict51146.2020.9311981.
AlKhateeb, H., AlSamel, Z., AlBarazi, J., Mansor, E. I., & VR GAME THAT AIMS TO TEST AND ENHANCE THE PLAYER’S KNOWLEDGE OF TAJWEED. (2019). QEE:. Proceedings of the International Conferences Interfaces and Human Computer Interaction 2019 Game and Entertainment Technologies 2019 and Computer Graphics, Visualization, Computer Vision and Image Processing 2019, 149–156. IADIS Press. https://doi.org/10.33965/ihci2019_201906l019.
Almousa, O., Prates, J., Yeslam, N., Gregor, D. M., Zhang, J., Phan, V., Nielsen, M., Smith, R., & Qayumi, K. (2019). Virtual reality simulation technology for cardiopulmonary resuscitation training: An innovative hybrid system with haptic feedback. Simulation & Gaming, 50(1), 6–22. https://doi.org/10.1177/1046878118820905.
Alsawaier, R. S. (2018). The effect of gamification on motivation and engagement. The International Journal of Information and Learning Technology, 35(1), 56–79. https://doi.org/10.1108/ijilt-02-2017-0009.
An, Y. (2021). A history of instructional media, instructional design, and theories. International Journal of Technology in Education, 4(1), 1–21. https://doi.org/10.46328/ijte.35.
Anastasovitis, E., Ververidis, D., Nikolopoulos, S., & Kompatsiaris, I. (2017). Digiart: Building new 3D cultural heritage worlds. 2017 3dtv Conference: The True Vision - Capture, Transmission and Display of 3d Video (3dtv-CON). IEEE. https://doi.org/10.1109/3dtv.2017.8280406.
Ang, E. T., Chan, J. M., Gopal, V., & Shia, N. L. (2018). Gamifying anatomy education. Clinical Anatomy, 31(7), 997–1005. https://doi.org/10.1002/ca.23249.
Angelino, F., Loureiro, S., & Bilro, R. G. (2019). Exploring the future of virtual reality and gamification in learning enviornments: Students motivation and engagement in higher education. 15th China-Europe International Symposium on Software Engineering Education.
Annetta, L., Mangrum, J., Holmes, S., Collazo, K., & Cheng, M. T. (2009). Bridging realty to virtual reality: Investigating gender effect and student engagement on learning through video game play in an elementary school classroom. International Journal of Science Education, 31(8), 1091–1113. https://doi.org/10.1080/09500690801968656.
Araiza-Alba, P., Keane, T., Chen, W. S., & Kaufman, J. (2021). Immersive virtual reality as a tool to learn problem-solving skills. Computers & Education, 164, 104121. https://doi.org/10.1016/j.compedu.2020.104121.
Araiza-Alba, P., Keane, T., & Kaufman, J. (2022). Are we ready for virtual reality in k12 classrooms? Technology Pedagogy and Education. https://doi.org/10.1080/1475939x.2022.2033307
Azar, A. S., & Tan, N. H. I. (2020). The application of ICT techs (mobile-assisted language learning, gamification, and virtual reality) in teaching English for secondary school students in Malaysia during COVID-19 pandemic. Universal Journal of Educational Research, 8(11 C), 55–63. https://doi.org/10.13189/ujer.2020.082307.
Bahrin, A. S., Sunar, M. S., & Azman, A. (2022). Enjoyment as gamified experience for informal learning in virtual reality. In Lecture notes of the institute for computer sciences, social informatics and telecommunications engineering (pp. 383–399). Springer. https://doi.org/10.1007/978-3-030-99188-3_24.
Bai, S., Hew, K. F., & Huang, B. (2020). Does gamification improve student learning outcome? Evidence from a meta-analysis and synthesis of qualitative data in educational contexts. Educational Research Review, 30, 100322. https://doi.org/10.1016/j.edurev.2020.100322.
Bailenson, J. N., Yee, N., Blascovich, J., Beall, A. C., Lundblad, N., & Jin, M. (2008). The use of immersive virtual reality in the learning sciences: Digital transformations of teachers, students, and social context. The Journal of the Learning Sciences, 17(1), 102–141. https://doi.org/10.1080/10508400701793141.
Banjar, A., & Campbell, A. G. (2022). Doctoral colloquium—the potential of mixed-reality technology for motivating dentistry students in higher education. 2022 8th International Conference of the Immersive Learning Research Network (iLRN), 1–3. IEEE. https://doi.org/10.23919/iLRN55037.2022.9815939.
Barab, S., Zuiker, S., Warren, S., Hickey, D., Ingram-Goble, A., Kwon, E. J., Kouper, I., & Herring, S. C. (2007). Situationally embodied curriculum: Relating formalisms and contexts. Science Education, 91(5), 750–782. https://doi.org/10.1002/sce.20217.
Barringer, D. F., Plummer, J. D., Kregenow, J., & Palma, C. (2018). Gamified approach to teaching introductory astronomy online. Physical Review Physics Education Research. https://doi.org/10.1103/physrevphyseducres.14.010140
Bayne, S. (2014). What’s the matter with ‘technology-enhanced learning?’. Learning Media and Technology, 40(1), 5–20. https://doi.org/10.1080/17439884.2014.915851.
Becerra, D. A. I., Quispe, J. A. H., Aceituno, R. G. A., Vargas, G. M. P., Zamora, F. G. F., Mango, J. L. H., Figueroa, G. P. A., Vizcarra, A. A. P., & Chana, J. W. (2017). T. Evaluation of a gamified 3D virtual reality system to enhance the understanding of movement in physics. Proceedings of the 9th International Conference on Computer Supported Education - Volume 1: CSEDU, 395–401. SCITEPRESS - Science; Technology Publications. https://doi.org/10.5220/0006328003950401.
Beck, D. (2019). Augmented and virtual reality in education: Immersive learning research. Journal of Educational Computing Research, 57(7), 1619–1625. https://doi.org/10.1177/0735633119854035.
Bedregal-Alpaca, N., Sharhorodska, O., Jiménez-Gonzáles, L., & Arce-Apaza, R. (2020). A gamification experience and virtual reality in teaching astronomy in basic education. International Journal of Advanced Computer Science and Applications, 11(5), 513–521. https://doi.org/10.14569/ijacsa.2020.0110566.
Besoain, F., Jego, L., & Arenas-Salinas, M. (2018). Implementation of a gamified puzzle based on pro-origami protein structure cartoons: An experience in virtual reality. 2018 IEEE Biennial Congress of Argentina (ARGENCON). IEEE. https://doi.org/10.1109/argencon.2018.8646202.
Billingsley, G., Smith, S., Smith, S., & Meritt, J. (2019). A systematic literature review of using immersive virtual reality technology in teacher education. Journal of Interactive Learning Research, 30(1), 65–90.
Bilro, R. G., Loureiro, S. M. C., & de Aires Angelino, F. J. (2020). Implications of gamification and virtual reality in higher education. In Managerial challenges and social impacts of virtual and augmented reality (pp. 111–124). IGI Global. https://doi.org/10.4018/978-1-7998-2874-7.ch007.
Bilro, R. G., Loureiro, S. M. C., & de Aires Angelino, F. J. (2022). Implications of gamification and virtual reality in higher education. In Research anthology on developments in gamification and game-based learning (pp. 1676–1686). IGI Global. https://doi.org/10.4018/978-1-6684-3710-0.ch081.
Biocca, F., & Delaney, B. (1995). Immersive virtual reality technology. Communication in the Age of Virtual Reality, 15(32), 127–157. https://doi.org/10.4324/9781410603128.
Birt, J., & Cowling, M. (2017). Toward future ‘mixed reality’ learning spaces for STEAM education. International Journal of Innovation in Science and Mathematics Education, 25(4), 1–16.
Blascovich, J., & Bailenson, J. (2011). Infinite reality: Avatars, eternal life, new worlds, and the dawn of the virtual revolution. William Morrow & Co.
Blyth, C. (2018). Immersive technologies and language learning. Foreign Language Annals, 51(1), 225–232. https://doi.org/10.1111/flan.12327.
Bogusevschi, D., Muntean, C., & Muntean, G. M. (2020). Teaching and learning physics using 3D virtual learning environment: A case study of combined virtual reality and virtual laboratory in secondary school. Journal of Computers in Mathematics and Science Teaching, 39(1), 5–18.
Bonacini, E., & Giaccone, S. C. (2021). Gamification and cultural institutions in cultural heritage promotion: A successful example from Italy. Cultural Trends, 31(1), 3–22. https://doi.org/10.1080/09548963.2021.1910490.
Bouchrika, I., Harrati, N., Wanick, V., & Wills, G. (2019). Exploring the impact of gamification on student engagement and involvement with e-learning systems. Interactive Learning Environments, 29(8), 1244–1257. https://doi.org/10.1080/10494820.2019.1623267.
Bowman, D. A., Hodges, L. F., Allison, D., & Wineman, J. (1999). The educational value of an information-rich virtual environment. Presence: Teleoperators & Virtual Environments, 8(3), 317–331. https://doi.org/10.1162/105474699566251.
Bowman, D. A., Sowndararajan, A., Ragan, E. D., & Kopper, R. (2009). Higher Levels of Immersion Improve Procedure Memorization Performance. In M. Hirose, D. Schmalstieg, C. A. Wingrave, & K. Nishimura (Eds.), Joint virtual reality conference of EGVE - ICAT - EuroVR. The Eurographics Association. https://doi.org/10.2312/EGVE/JVRC09/121-128.
Brockmyer, J. H., Fox, C. M., Curtiss, K. A., McBroom, E., Burkhart, K. M., & Pidruzny, J. N. (2009). The development of the game engagement questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology, 45(4), 624–634. https://doi.org/10.1016/j.jesp.2009.02.016.
Bronack, S., Riedl, R., & Tashner, J. (2006). Learning in the zone: A social constructivist framework for distance education in a 3-dimensional virtual world. Interactive Learning Environments, 14(3), 219–232. https://doi.org/10.1080/10494820600909157.
Brooke, J. (1996). SUS: A quick and dirty’ usability scale. Usability Evaluation in Industry, 189(194), 4–7.
Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42. https://doi.org/10.3102/0013189x018001032.
Bryan, S. J., Campbell, A., & Mangina, E. (2018). Scenic spheres - an AR/VR educational game. 2018 IEEE Games, Entertainment, Media Conference (GEM), 367–374. IEEE. https://doi.org/10.1109/gem.2018.8516456.
Buckley, P., & Doyle, E. (2014). Gamification and student motivation. Interactive Learning Environments, 24(6), 1162–1175. https://doi.org/10.1080/10494820.2014.964263.
Burbules, N. C., & Callister, T. A. (2018). Watch IT: The risks and promises of information technologies for education. Routledge.
Çaliskan, O. (2011). Virtual field trips in education of earth and environmental sciences. Procedia-Social and Behavioral Sciences, 15, 3239–3243. https://doi.org/10.1016/j.sbspro.2011.04.278.
Calvet, L., Bourdin, P., & Prados, F. (2019). Immersive technologies in higher education: Applications, challenges, and good practices. Proceedings of the 2019 3rd International Conference on Education and e-Learning, 95–99. https://doi.org/10.1145/3371647.3371667.
Cechetti, N. P., Bellei, E. A., Biduski, D., Rodriguez, J. P. M., Roman, M. K., & Marchi, A. C. B. D. (2019). Developing and implementing a gamification method to improve user engagement: A case study with an m-health application for hypertension monitoring. Telematics and Informatics, 41, 126–138. https://doi.org/10.1016/j.tele.2019.04.007.
Chans, G. M., & Castro, M. P. (2021). Gamification as a strategy to increase motivation and engagement in higher education chemistry students. Computers, 10(10), 132. https://doi.org/10.3390/computers10100132.
Chávez, O. L., Rodríguez, L. F., & Gutierrez-Garcia, J. O. (2020). A comparative case study of 2D, 3D and immersive-virtual-reality applications for healthcare education. International Journal of Medical Informatics, 141, 104226. https://doi.org/10.1016/j.ijmedinf.2020.104226.
Chen, Q., Low, S. E., Yap, J. W. E., Sim, A. K. X., Tan, Y. Y., Kwok, B. W. J., Lee, J. S. A., Tan, C. T., Loh, W. P., Loo, B. L. W., & Wong, A. C. (2020). K. Immersive virtual reality training of bioreactor operations. 2020 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), 873–878. IEEE. https://doi.org/10.1109/tale48869.2020.9368468.
Cheng, K. H., Tang, K. Y., & Tsai, C. C. (2022). The mainstream and extension of contemporary virtual reality education research: Insights from a co-citation network analysis (20152020). Educational Technology Research and Development, 70(1), 169–184. https://doi.org/10.1007/s11423-021-10070-z.
Chiang, T. H. C. (2021). Investigating effects of interactive virtual reality games and gender on immersion, empathy and behavior into environmental education. Frontiers in Psychology, 12, 1–13. https://doi.org/10.3389/fpsyg.2021.608407.
Christensen, R., Knezek, G., Tyler-Wood, T., & Gibson, D. (2011). SimSchool: An online dynamic simulator for enhancing teacher preparation. International Journal of Learning Technology, 6(2), 201–220. https://doi.org/10.1504/IJLT.2011.042649.
Chrysanthakopoulou, A., Kalatzis, K., Michalakis, G., Michalellis, I., & Moustakas, K. (2022). ArtScape: Gamified virtual reality art exploration. 2022 IEEE Conference on Virtual Reality and 3d User Interfaces Abstracts and Workshops (VRW). IEEE. https://doi.org/10.1109/vrw55335.2022.00302.
Cober, R., Tan, E., Slotta, J., So, H. J., & Könings, K. D. (2015). Teachers as participatory designers: Two case studies with technology-enhanced learning environments. Instructional Science, 43(2), 203–228. https://doi.org/10.1007/s11251-014-9339-0.
Comi, S. L., Argentin, G., Gui, M., Origo, F., & Pagani, L. (2017). Is it the way they use it? Teachers, ICT and student achievement. Economics of Education Review, 56, 24–39. https://doi.org/10.1016/j.econedurev.2016.11.007.
Creswell, J. W., & Clark, V. L. P. (2017). Designing and conducting mixed methods research. Sage.
Crocco, F., Offenholley, K., & Hernandez, C. (2016). A proof-of-concept study of game-based learning in higher education. Simulation & Gaming, 47(4), 403–422. https://doi.org/10.1177/1046878116632484.
Dalgarno, B., Lee, M. J., Carlson, L., Gregory, S., & Tynan, B. (2011). An Australian and New Zealand scoping study on the use of 3D immersive virtual worlds in higher education. Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.978
Davis, M. (1983). Medición De las diferencias individuales en la empatía: Evidencia De Un enfoque multidimensional. Journal of Personality and Social Psychology, 44(1), 113–126. https://doi.org/10.1037/0022-3514.44.1.113.
Davis, F. D. (1993). User acceptance of information technology: System characteristics, user perceptions and behavioral impacts. International Journal of Man-Machine Studies, 38(3), 475–487. https://doi.org/10.1006/imms.1993.1022.
Davis, N. E., & Roblyer, M. D. (2005). Preparing teachers for the schools that technology built. Journal of Research on Technology in Education, 37(4), 399–409. https://doi.org/10.1080/15391523.2005.10782445.
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1992). Extrinsic and intrinsic motivation to use computers in the workplace. Journal of Applied Social Psychology, 22(14), 1111–1132. https://doi.org/10.1111/j.1559-1816.1992.tb00945.x.
de Borges, S., Durelli, S., Reis, V. H. S., H. M., & Isotani, S. (2014). A systematic mapping on gamification applied to education. Proceedings of the 29th Annual ACM Symposium on Applied Computing. ACM. https://doi.org/10.1145/2554850.2554956.
de Castro, M. G. A., & García-Peñalvo, F. (2022). Metodologías educativas de éxito: Proyectos erasmus + relacionados con e-learning o TIC. Campus Virtuales, 11(1), 95. https://doi.org/10.54988/cv.2022.1.1022.
de Geus, K., Beê, R., Corrêa, V., Santos, R., Faria, A., Sato, E., Swinka-Filho, V., Miquelin, A., Scheer, S., Siqueira, P., Godoi, W., Rosendo, M., & Gruber, Y. (2020). Immersive serious game-style virtual environment for training in electrical live line maintenance activities. Proceedings of the 12th International Conference on Computer Supported Education, 42–53. SCITEPRESS - Science; Technology Publications. https://doi.org/10.5220/0009343200420053.
de Lima, R. M., de Medeiros Santos, A., Neto, F. M. M., Neto, S., de Leao, A. F., Macedo, F. C. P., F. T., & de Paula Canuto, A. M. (2016). A 3D serious game for medical students training in clinical cases. 2016 IEEE International Conference on Serious Games and Applications for Health (SeGAH). IEEE. https://doi.org/10.1109/segah.2016.7586255.
Deci, E. L., Eghrari, H., Patrick, B. C., & Leone, D. R. (1994). Facilitating internalization: The self-determination theory perspective. Journal of Personality, 62(1), 119–142. https://doi.org/10.1111/j.1467-6494.1994.tb00797.x.
Dede, C. (2009). Immersive interfaces for engagement and learning. Science, 323(5910), 66–69. https://doi.org/10.1126/science.1167311.
Dede, C. J., Jacobson, J., & Richards, J. (2017). Introduction: Virtual, augmented, and mixed realities in education. In Virtual, augmented, and mixed realities in education (pp. 1–16). Springer. https://doi.org/10.1007/978-981-10-5490-7_1.
Deggim, S., Kersten, T. P., Tschirschwitz, F., & Hinrichsen, N. (2017). Segeberg 1600–reconstructing a historic town for virtual reality visualisation as an immersive experience. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W8, 87–94. https://doi.org/10.5194/isprs-archives-xlii-2-w8-87-2017.
Dehganzadeh, H., & Dehganzadeh, H. (2020). Investigating effects of digital gamification-based language learning: A systematic review. Journal of English Language Teaching and Learning, 12(25), 53–93.
Dehghanzadeh, H., Fardanesh, H., Hatami, J., Talaee, E., & Noroozi, O. (2019). Using gamification to support learning English as a second language: A systematic review. Computer Assisted Language Learning, 34(7), 934–957. https://doi.org/10.1080/09588221.2019.1648298.
Deterding, S. (2012). Gamification: Design for motivation. Interactions, 19(4), 14–17. https://doi.org/10.1145/2212877.2212883.
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness. Proceedings of the 15th International Academic MindTrek Conference on Envisioning Future Media Environments - MindTrek’ 11. ACM Press. https://doi.org/10.1145/2181037.2181040.
Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Journal of Educational Technology & Society, 18(3), 75–88.
Dickey, M. D. (2005). Brave new (interactive) worlds: A review of the design affordances and constraints of two 3D virtual worlds as interactive learning environments. Interactive Learning Environments, 13(1–2), 121–137. https://doi.org/10.1080/10494820500173714.
DiLullo, C., McGee, P., & Kriebel, R. M. (2011). Demystifying the millennial student: A reassessment in measures of character and engagement in professional education. Anatomical Sciences Education, 4(4), 214–226. https://doi.org/10.1002/ase.240.
Djurovic, G., & Djurovic, M. Z. (2010). Implementing cognitive theory of multimedia learning in existing academic programs. 2010 IEEE Transforming Engineering Education: Creating Interdisciplinary Skills for Complex Global Environments. IEEE. https://doi.org/10.1109/tee.2010.5508949.
Dondlinger, M. J. (2007). Educational video game design: A review of the literature. Journal of Applied Educational Technology, 4(1), 21–31.
Doumanis, I., & Economou, D. (2020). Evaluating the impact of multimodal collaborative virtual environments on user’s spatial knowledge and experience of gamified educational tasks. 2020 6th International Conference of the Immersive Learning Research Network (iLRN), 185–193. IEEE. https://doi.org/10.23919/ilrn47897.2020.9155165.
Economou, D., Mentzelopoulos, M., Ingram, J., Martinez-Mukimov, T., Primkulova, S., & Abduvaliev, S. (2022). Work-in-progress-gamifying the process of learning sign language in VR. 2022 8th International Conference of the Immersive Learning Research Network (iLRN), 1–3. https://doi.org/10.23919/iLRN55037.2022.9815988.
Edwards, B. I., Bielawski, K. S., Prada, R., & Cheok, A. D. (2019). Haptic virtual reality and immersive learning for enhanced organic chemistry instruction. Virtual Reality, 23(4), 363–373. https://doi.org/10.1007/s10055-018-0345-4.
El-Masri, M., & Tarhini, A. (2015). A design science approach to gamify education: From games to platforms. ECIS 2015 Research-in-Progress Papers.
Falah, J., Wedyan, M., Alfalah, S. F. M., Abu-Tarboush, M., Al-Jakheem, A., Al-Faraneh, M., Abuhammad, A., & Charissis, V. (2021). Identifying the characteristics of virtual reality gamification for complex educational topics. Multimodal Technologies and Interaction, 5(9), 53. https://doi.org/10.3390/mti5090053.
Fan, K. K., Xiao, P., & Su, C. (2015). The effects of learning styles and meaningful learning on the learning achievement of gamification health education curriculum. EURASIA Journal of Mathematics Science and Technology Education. https://doi.org/10.12973/eurasia.2015.1413a
Fealy, S., Jones, D., Hutton, A., Graham, K., McNeill, L., Sweet, L., & Hazelton, M. (2019). The integration of immersive virtual reality in tertiary nursing and midwifery education: A scoping review. Nurse Education Today, 79, 14–19. https://doi.org/10.1016/j.nedt.2019.05.002.
Fernandez-Rio, J., Heras, E., de las, González, T., Trillo, V., & Palomares, J. (2020). Gamification and physical education. Viability and preliminary views from students and teachers. Physical Education and Sport Pedagogy, 25(5), 509–524. https://doi.org/10.1080/17408989.2020.1743253.
Ferriz-Valero, A., Østerlie, O., Martínez, S. G., & García-Jaén, M. (2020). Gamification in physical education: Evaluation of impact on motivation and academic performance within higher education. International Journal of Environmental Research and Public Health, 17(12), 4465. https://doi.org/10.3390/ijerph17124465.
Flandoli, A. M. B., Camacho, J. R. C., & Maldonado, J. C. (2022). Teaching audiovisual production using gamification and virtual reality. 2022 17th Iberian Conference on Information Systems and Technologies (CISTI). IEEE. https://doi.org/10.23919/cisti54924.2022.9820213.
Fonseca, D., Villagrasa, S., Navarro, I., Redondo, E., Valls, F., Llorca, J., Gómez-Zavallos, M., Ferrer, Á., & Calvo, X. (2017a). Student motivation assessment using and learning virtual and gamified urban environments. Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality, 1–7. ACM. https://doi.org/10.1145/3144826.3145422.
Fonseca, D., Villagrasa, S., Navarro, I., Redondo, E., Valls, F., & Sánchez, A. (2017b). Urban gamification in architecture education. In Advances in intelligent systems and computing (pp. 335–341). Springer International Publishing. https://doi.org/10.1007/978-3-319-56541-5_34.
Fonseca, D., Sanchez-Sepulveda, M., Necchi, S., Peña, E., Marti, N., Villagrasa, S., Redondo, E., Franquesa, J., & Navarro, I. (2020). What is happening in the process of engaging architectural students and teachers for including virtual and interactive systems in the projects developments? Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality, 775–783. ACM. https://doi.org/10.1145/3434780.3436540.
Fonseca, D., Cavalcanti, J., Peña, E., Valls, V., Sanchez-Sepúlveda, M., Moreira, F., Navar-ro, I., & Redondo, E. (2021). Mixed assessment of virtual serious games applied in architectural and urban design education. Sensors (Basel, Switzerland), 21(9), 3102. https://doi.org/10.3390/s21093102.
Freina, L., & Ott, M. (2015). A literature review on immersive virtual reality in education: State of the art and perspectives. The International Scientific Conference Elearning and Software for Education, 1–8.
Frøland, T. H., Heldal, I., Sjøholt, G., & Ersvær, E. (2020). Games on mobiles via web or virtual reality technologies: How to support learning for biomedical laboratory science education. Information, 11(4), 195. https://doi.org/10.3390/info11040195.
Garcia, S., Kauer, R., Laesker, D., Nguyen, J., & Andujar, M. (2019). A virtual reality experience for learning languages. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 1–4. ACM. https://doi.org/10.1145/3290607.3313253.
Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441–467. https://doi.org/10.1177/1046878102238607.
Gerard, F. J., Mentzelopoulos, M., Economou, D., Khalish, Z., Ingram, J., & Ashley, E. (2022). Work-in-progress—CrimOPS—gamified virtual simulations for authentic assessment in criminology. 2022 8th International Conference of the Immersive Learning Research Network (iLRN), 1–3. https://doi.org/10.23919/iLRN55037.2022.9815942.
Gimbert, B., & Cristol, D. (2003). Teaching curriculum with technology: Enhancing children’s technological competence during early childhood. Early Childhood Education Journal, 31(3), 207–216. https://doi.org/10.1023/b:ecej.0000012315.64687.ee.
Gomes, C., Figueiredo, M., & Bidarra, J. (2014). Gamification in teaching music: Case study. EduRe’14 - International Virtual Conference on Education, Social and Technological Science, 1–19.
Gonzalez, D. C., & Garnique, L. V. (2018). Development of a simulator with HTC vive using gamification to improve the learning experience in medical students. 2018 Congreso Internacional de Innovación y Tendencias En Ingeniería (CONIITI), 1–6. IEEE. https://doi.org/10.1109/coniiti.2018.8587058.
Gonzalez-Gonzalez, C. S. (2020). A case of gamification in virtual environments with RV/RA. 2020 x International Conference on Virtual Campus (JICV), 1–3. IEEE. https://doi.org/10.1109/jicv51605.2020.9375816.
Gordon, N., & Brayshaw, M. (2017). Flexible virtual environments: Gamifying immersive learning. In Communications in computer and information science (pp. 115–121). Springer International Publishing. https://doi.org/10.1007/978-3-319-58753-0_18.
Gordon, C. L., Shea, T. M., Noelle, D. C., & Balasubramaniam, R. (2019). Affordance compatibility effect for word learning in virtual reality. Cognitive Science, 43(6), 1–17. https://doi.org/10.1111/cogs.12742.
Grivokostopoulou, F., Perikos, I., & Hatzilygeroudis, I. (2016). An innovative educational environment based on virtual reality and gamification for learning search algorithms. 2016 IEEE Eighth International Conference on Technology for Education (T4e), 110–115. IEEE. https://doi.org/10.1109/t4e.2016.029.
Grivokostopoulou, F., Kovas, K., & Perikos, I. (2019a). Examining the impact of a gamified entrepreneurship education framework in higher education. Sustainability, 11(20), 5623. https://doi.org/10.3390/su11205623.
Grivokostopoulou, F., Perikos, I., Kovas, K., & Hatzilygeroudis, I. (2019b). An innovative educational environment based on virtual reality and gamification for learning STEM entrepreneurship. ICERI2019 Proceedings. IATED. https://doi.org/10.21125/iceri.2019.2797.
Halabi, O. (2020). Immersive virtual reality to enforce teaching in engineering education. Multimedia Tools and Applications, 79(3), 2987–3004. https://doi.org/10.1007/s11042-019-08214-8.
Hamari, J., & Koivisto, J. (2015). Working out for likes: An empirical study on social influence in exercise gamification. Computers in Human Behavior, 50, 333–347. https://doi.org/10.1016/j.chb.2015.04.018.
Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work? – a literature review of empirical studies on gamification. 47th Hawaii International Conference on System Sciences. IEEE. https://doi.org/10.1109/hicss.2014.377.
Hamilton, D., McKechnie, J., Edgerton, E., & Wilson, C. (2021). Immersive virtual reality as a pedagogical tool in education: A systematic literature review of quantitative learning outcomes and experimental design. Journal of Computers in Education, 8(1), 1–32. https://doi.org/10.1007/s40692-020-00169-2.
Han, I. (2020). Immersive virtual field trips in education: A mixed-methods study on elementary students’ presence and perceived learning. British Journal of Educational Technology, 51(2), 420–435. https://doi.org/10.1111/bjet.12842.
Hanus, M. D., & Fox, J. (2015). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education, 80, 152–161. https://doi.org/10.1016/j.compedu.2014.08.019.
Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (task load index): Results of empirical and theoretical research. In Advances in psychology (pp. 139–183). Elsevier. https://doi.org/10.1016/s0166-4115(08)62386-9.
Hartfill, J., Gabel, J., Neves-Coelho, D., Vogel, D., Räthel, F., Tiede, S., Ariza, O., & Stein-icke, F. (2020). Word saber: An effective and fun VR vocabulary learning game. Proceedings of the Conference on Mensch Und Computer, 145–154. ACM. https://doi.org/10.1145/3404983.3405517.
Hew, K. F., & Cheung, W. S. (2010). Use of three-dimensional (3-d) immersive virtual worlds in k-12 and higher education settings: A review of the research. British Journal of Educational Technology, 41(1), 33–55. https://doi.org/10.1111/j.1467-8535.2008.00900.x.
Higgins, J. P., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M. J., & Welch, V. A. (2019). Cochrane handbook for systematic reviews of interventions. Wiley. https://doi.org/10.1002/9781119536604
Hincapie, M., Diaz, C., Valencia, A., Contero, M., & Güemes-Castorena, D. (2021). Educational applications of augmented reality: A bibliometric study. Computers & Electrical Engineering, 93, 107289. https://doi.org/10.1016/j.compeleceng.2021.107289.
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M. P., Griffiths, F., Nicolau, B., O’Cathain, A., Rousseau, M. C., Vedel, I., & Pluye, P. (2018). The mixed methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Education for Information, 34(4), 285–291. https://doi.org/10.3233/EFI-180221.
Hu-Au, E., & Lee, J. J. (2017). Virtual reality in education: A tool for learning in the experience age. International Journal of Innovation in Education, 4(4), 215–226. https://doi.org/10.1504/IJIIE.2017.091481.
Huaman, E. M. R., Aceituno, R. G. A., & Sharhorodska, O. (2019). Application of virtual reality and gamification in the teaching of art history. In Learning and collaboration technologies. Ubiquitous and virtual environments for learning and collaboration (pp. 220–229). Springer International Publishing. https://doi.org/10.1007/978-3-030-21817-1_17.
Huang, H. M., Rauch, U., & Liaw, S. S. (2010). Investigating learners’ attitudes toward virtual reality learning environments: Based on a constructivist approach. Computers & Education, 55(3), 1171–1182. https://doi.org/10.1016/j.compedu.2010.05.014.
Huang, C. L., Luo, Y. F., Yang, S. C., Lu, C. M., & Chen, A. S. (2019). Influence of students’ learning style, sense of presence, and cognitive load on learning outcomes in an immersive virtual reality learning environment. Journal of Educational Computing Research, 58(3), 596–615. https://doi.org/10.1177/0735633119867422.
Huang, R., Ritzhaupt, A. D., Sommer, M., Zhu, J., Stephen, A., Valle, N., Hampton, J., & Li, J. (2020). The impact of gamification in educational settings on student learning outcomes: A meta-analysis. Educational Technology Research and Development, 68(4), 1875–1901. https://doi.org/10.1007/s11423-020-09807-z.
Hughes, J., Thomas, R., & Scharber, C. (2006). Assessing technology integration: The RAT–replacement, amplification, and transformation-framework. Society for Information Technology & Teacher Education International Conference, 1616–1620. Association for the Advancement of Computing in Education (AACE).
Hussin, A. A. (2018). Education 4.0 made simple: Ideas for teaching. International Journal of Education and Literacy Studies, 6(3), 92. https://doi.org/10.7575/aiac.ijels.v.6n.3p.92.
Iquira, D., Sotelo, B., & Sharhorodska, O. (2019). A gamified mobile-based virtual reality laboratory for physics education: Results of a mixed approach. In Communications in computer and information science (pp. 247–254). Springer International Publishing. https://doi.org/10.1007/978-3-030-23525-3_32.
Jagušt, T., Botički, I., & So, H. J. (2018). Examining competitive, collaborative and adaptive gamification in young learners’ math learning. Computers &Amp Education, 125, 444–457. https://doi.org/10.1016/j.compedu.2018.06.022.
Jayalath, J., & Esichaikul, V. (2020). Gamification to enhance motivation and engagement in blended eLearning for technical and vocational education and training. Technology Knowledge and Learning, 27(1), 91–118. https://doi.org/10.1007/s10758-020-09466-2.
Jensen, L., & Konradsen, F. (2018). A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies, 23(4), 1515–1529. https://doi.org/10.1111/jcal.12538.
Jiang, J., & Zeng, L. (2019). Research on the application of virtual reality technology in the teaching model. 2019 14th International Conference on Computer Science & Education (ICCSE), 145–148. IEEE. https://doi.org/10.1109/iccse.2019.8845411.
Jiang, L., Zhao, F., Wang, X., & Zhang, J. (2022). Students’ status toward the new gamified learning method: An exploratory study. In Lecture notes in computer science (pp. 444–455). Springer International Publishing. https://doi.org/10.1007/978-3-031-05637-6_28.
Jiménez, Z. A. (2019). Teaching and learning chemistry via augmented and immersive virtual reality. In Technology integration in chemistry education and research (TICER). ACS Publications. https://doi.org/10.1021/bk-2019-1318.ch003
Johnson, L., Becker, S. A., Estrada, V., & Freeman, A. (2015). NMC horizon report: 2015 museum edition (pp. 1–50). The New Media Consortium.
Johnson-Glenberg, M. C. (2018). Immersive VR and education: Embodied design principles that include gesture and hand controls. Frontiers in Robotics and AI, 5, 81. https://doi.org/10.3389/frobt.2018.00081.
Jung, C. (2017). Gamification for environment education based on the extended cooperation. Journal of Korea Game Society, 17(4), 37–46. https://doi.org/10.7583/JKGS.2017.17.4.37.
Kamalodeen, V. J., Ramsawak-Jodha, N., Figaro-Henry, S., Jaggernauth, S. J., & Dedovets, Z. (2021). Designing gamification for geometry in elementary schools: Insights from the designers. Smart Learning Environments. https://doi.org/10.1186/s40561-021-00181-8
Kapp, K. M. (2012). The gamification of learning and instruction: Game-based methods and strategies for training and education. Wiley.
Kaufmann, H., & Schmalstieg, D. (2006). Designing immersive virtual reality for geometry education. IEEE Virtual Reality Conference (VR 2006), 51–58. IEEE. https://doi.org/10.1109/VR.2006.48.
Kaufmann, H., Schmalstieg, D., & Wagner, M. (2000). Construct3D: A virtual reality application for mathematics and geometry education. Education and Information Technologies, 5(4), 263–276. https://doi.org/10.1023/A:1012049406877.
Kavanagh, S., Luxton-Reilly, A., Wuensche, B., & Plimmer, B. (2017). A systematic review of virtual reality in education. Themes in Science and Technology Education, 10(2), 85–119.
Kearsley, G., & Shneiderman, B. (1998). Engagement theory: A framework for technology-based teaching and learning. Educational Technology, 38(5), 20–23.
Kennedy, R. S., Lane, N. E., Berbaum, K. S., & Lilienthal, M. G. (1993). Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology, 3(3), 203–220. https://doi.org/10.1207/s15327108ijap0303_3.
Kiili, K. (2005). Digital game-based learning: Towards an experiential gaming model. The Internet and Higher Education, 8(1), 13–24. https://doi.org/10.1016/j.iheduc.2004.12.001.
Kim, S., Song, K., Lockee, B., & Burton, J. (2017). What is gamification in learning and education? In Gamification in learning and education (pp. 25–38). Springer International Publishing. https://doi.org/10.1007/978-3-319-47283-6_4.
Kim, H. K., Park, J., Choi, Y., & Choe, M. (2018). Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment. Applied Ergonomics, 69, 66–73. https://doi.org/10.1016/j.apergo.2017.12.016.
Kim, K. G., Oertel, C., Dobricki, M., Olsen, J. K., Coppi, A. E., Cattaneo, A., & Dillenbourg, P. (2020). Using immersive virtual reality to support designing skills in vocational education. British Journal of Educational Technology, 51(6), 2199–2213. https://doi.org/10.1111/bjet.13026.
Kiourt, C., Kalles, D., Lalos, A., Papastamatiou, N., Silitziris, P., Paxinou, E., Theodoropou-lou, H., Zafeiropoulos, V., Papadopoulos, A., & Pavlidis, G. (2020). XRLabs: Extended reality interactive laboratories. Proceedings of the 12th International Conference on Computer Supported Education. SCITEPRESS - Science; Technology Publications. https://doi.org/10.5220/0009441606010608.
Kiryakova, G., Angelova, N., & Yordanova, L. (2014). Gamification in education. Proceedings of 9th International Balkan Education and Science Conference.
Klippel, A., Zhao, J., Jackson, K. L., La Femina, P., Stubbs, C., Wetzel, R., Blair, J., Wallgrün, J. O., & Oprean, D. (2019). Transforming earth science education through immersive experiences: Delivering on a long held promise. Journal of Educational Computing Research, 57(7), 1745–1771. https://doi.org/10.1177/0735633119854025.
Klippel, A., Zhao, J., Sajjadi, P., Wallgrun, J. O., Bagher, M. M., & Oprean, D. (2020). Immersive place-based learning - an extended research framework. 2020 IEEE Conference on Virtual Reality and 3d User Interfaces Abstracts and Workshops (VRW), 449–454. IEEE. https://doi.org/10.1109/vrw50115.2020.00095.
Kolb, D. A. (2014). Experiential learning: Experience as the source of learning and development. FT.
Krauter, C. A., Vogelsang, J. A. S., Calepso, A. S., Angerbauer, K., & Sedlmair, M. (2021). Don’t catch it: An interactive virtual-reality environment to learn about COVID-19 measures using gamification elements. Mensch Und Computer 2021, 593–596. ACM. https://doi.org/10.1145/3473856.3474031.
Kukulska-Hulme, A., Beirne, E., Conole, G., Costello, E., Coughlan, T., Ferguson, R., FitzGerald, E., Gaved, M., Herodotou, C., & Whitelock, D. (2020). Innovating pedagogy 2020: Open university innovation report 8.
Lally, V., Sharples, M., Tracy, F., Bertram, N., & Masters, S. (2012). Researching the ethical dimensions of mobile, ubiquitous and immersive technology enhanced learning (MUITEL): A thematic review and dialogue. Interactive Learning Environments, 20(3), 217–238. https://doi.org/10.1080/10494820.2011.607829.
Lampropoulos, G., Keramopoulos, E., & Diamantaras, K. (2020). Enhancing the functionality of augmented reality using deep learning, semantic web and knowledge graphs: A review. Visual Informatics, 4(1), 32–42. https://doi.org/10.1016/j.visinf.2020.01.001.
Lampropoulos, G., Keramopoulos, E., Diamantaras, K., & Evangelidis, G. (2022). Augmented reality and gamification in education: A systematic literature review of research, applications, and empirical studies. Applied Sciences, 12(13), 6809. https://doi.org/10.3390/app12136809.
Landers, R. N. (2014). Developing a theory of gamified learning. Simulation & Gaming, 45(6), 752–768. https://doi.org/10.1177/1046878114563660.
Laugwitz, B., Held, T., & Schrepp, M. (2008). Construction and evaluation of a user experience questionnaire. In Lecture notes in computer science (pp. 63–76). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-89350-9_6.
Lee, E. A. L., Wong, K. W., & Fung, C. C. (2010). How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach. Computers & Education, 55(4), 1424–1442. https://doi.org/10.1016/j.compedu.2010.06.006.
Leite, W. L., Svinicki, M., & Shi, Y. (2010). Attempted validation of the scores of the VARK: Learning styles inventory with multitrait–multimethod confirmatory factor analysis models. Educational and Psychological Measurement, 70(2), 323–339. https://doi.org/10.1177/0013164409344507.
Lewis, J. R. (2002). Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human-Computer Interaction, 14(3–4), 463–488. https://doi.org/10.1080/10447318.2002.9669130.
Liberati, A. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. Annals of Internal Medicine, 151(4), 65–94. https://doi.org/10.7326/0003-4819-151-4-200908180-00136.
Liritzis, I., & Volonakis, P. (2021). Cyber-archaeometry: Novel research and learning subject overview. Education Sciences, 11(2), 86. https://doi.org/10.3390/educsci11020086.
Liu, D., Santhanam, R., & Webster, J. (2017). Toward meaningful engagement: A framework for design and research of gamified information systems. MIS Quarterly, 41(4), 1011–1034.
Lo, C. K., & Hew, K. F. (2018). A comparison of flipped learning with gamification, traditional learning, and online independent study: The effects on students’ mathematics achievement and cognitive engagement. Interactive Learning Environments, 28(4), 464–481. https://doi.org/10.1080/10494820.2018.1541910.
López, P., Rodrigues-Silva, J., & Alsina, Á. (2021). Brazilian and Spanish mathematics teachers’ predispositions towards gamification in STEAM education. Education Sciences, 11(10), 618. https://doi.org/10.3390/educsci11100618.
López-Faican, L., & Jaen, J. (2020). EmoFindAR: Evaluation of a mobile multiplayer augmented reality game for primary school children. Computers & Education, 149, 1–20. https://doi.org/10.1016/j.compedu.2020.103814.
Loureiro, S. M. C., Bilro, R. G., & de Aires Angelino, F. J. (2020). Virtual reality and gamification in marketing higher education: A review and research agenda. Spanish Journal of Marketing - ESIC, 25(2), 179–216. https://doi.org/10.1108/sjme-01-2020-0013.
Luigini, A., Parricchi, M. A., Basso, A., & Basso, D. (2020). Immersive and participatory serious games for heritage education, applied to the cultural heritage of south Tyrol. Interaction Design and Architecture(s), 43, 26. https://doi.org/10.55612/s-5002-043-003.
Lund, A. M. (2001). Measuring usability with the use questionnaire12. Usability Interface, 8(2), 3–6.
Luo, H., Li, G., Feng, Q., Yang, Y., & Zuo, M. (2021). Virtual reality in k-12 and higher education: A systematic review of the literature from 2000 to 2019. Journal of Computer Assisted Learning. https://doi.org/10.1111/jcal.12538.
Mahat, H., Hashim, M., Norkhaidi, S. B., Nayan, N., Saleh, Y., Hamid, N., Hidayah, N., & Faudzi, N. A. M. (2021). The readiness of geography teacher trainees in gamification approach. Review of International Geographical Education Online, 11(3), 720–734.
Maines, C. L., Tang, S., & Llewellyn-Jones, D. (2015). VICTour 1.1: Introducing virtual learning environments and gamification. 2015 International Conference on Developments of e-Systems Engineering (DeSE), 159–164. IEEE. https://doi.org/10.1109/dese.2015.66.
Majuri, J., Koivisto, J., & Hamari, J. (2018). Gamification of education and learning: A review of empirical literature. Proceedings of the 2nd International GamiFIN Conference, GamiFIN 2018. CEUR-WS.
Makled, E., Yassien, A., Elagroudy, P., Magdy, M., Abdennadher, S., & Hamdi, N. (2019). PathoGenius VR: VR medical training. Proceedings of the 8th ACM International Symposium on Pervasive Displays, 1–2. ACM. https://doi.org/10.1145/3321335.3329694.
Makransky, G., Bonde, M. T., Wulff, J. S. G., Wandall, J., Hood, M., Creed, P. A., Bache, I., Silahtaroglu, A., & Nørremølle, A. (2016). Simulation based virtual learning environment in medical genetics counseling: An example of bridging the gap between theory and practice in medical education. BMC Medical Education. https://doi.org/10.1186/s12909-016-0620-6
Makransky, G., Mayer, R., Nøremølle, A., Cordoba, A. L., Wandall, J., & Bonde, M. (2019). Investigating the feasibility of using assessment and explanatory feedback in desktop virtual reality simulations. Educational Technology Research and Development, 68(1), 293–317. https://doi.org/10.1007/s11423-019-09690-3.
Malone, T. W., & Lepper, M. R. (1987). Making learning fun: A taxonomy of intrinsic motivations for learning. Aptitude, learning, and instruction (pp. 223–254). Routledge.
Manzano-León, A., Camacho-Lazarraga, P., Guerrero, M. A., Guerrero-Puerta, L., Aguilar-Parra, J. M., Trigueros, R., & Alias, A. (2021). Between level up and game over: A systematic literature review of gamification in education. Sustainability, 13(4), 2247. https://doi.org/10.3390/su13042247.
Markowitz, D. M., Laha, R., Perone, B. P., Pea, R. D., & Bailenson, J. N. (2018). Immersive virtual reality field trips facilitate learning about climate change. Frontiers in Psychology, 9, 2364. https://doi.org/10.3389/fpsyg.2018.02364.
Martí-Parreño, J., Méndez-Ibáñez, E., & Alonso-Arroyo, A. (2016). The use of gamification in education: A bibliometric and text mining analysis. Journal of Computer Assisted Learning, 32(6), 663–676. https://doi.org/10.1111/jcal.12161.
Martín-Gutiérrez, J., Mora, C. E., Añorbe-Díaz, B., & González-Marrero, A. (2017). Virtual technologies trends in education. Eurasia Journal of Mathematics Science and Technology Education, 13(2), 469–486. https://doi.org/10.12973/eurasia.2017.00626a.
Mas, A., Ismael, I., & Filliard, N. (2018). Indy: A virtual reality multi-player game for navigation skills training. 2018 IEEE Fourth VR International Workshop on Collaborative Virtual Environments (3dcve). IEEE. https://doi.org/10.1109/3dcve.2018.8637113.
May, R., & Denecke, K. (2020). Extending patient education with CLAIRE: An interactive virtual reality and voice user interface application. In Addressing global challenges and quality education (pp. 482–486). Springer International Publishing. https://doi.org/10.1007/978-3-030-57717-9_49.
Mayer, R. E. (2005). Introduction to multimedia learning. The Cambridge handbook of multimedia learning (pp. 1–24). Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.002
Mayer, R. E. (2020). Multimedia learning (3rd ed.). Cambridge University Press. https://doi.org/10.1017/9781316941355
Mayer, R. E., & Moreno, R. (1998). A cognitive theory of multimedia learning: Implications for design principles. Journal of Educational Psychology, 91(2), 358–368. https://doi.org/10.1037/0022-0663.91.2.358.
McCoy, L., Lewis, J. H., & Dalton, D. (2016). Gamification and multimedia for medical education: A landscape review. Journal of Osteopathic Medicine, 116(1), 22–34. https://doi.org/10.7556/jaoa.2016.003.
Mehrabian, A., & Epstein, N. (1972). A measure of emotional empathy. Journal of Personality, 40(4), 525–543. https://doi.org/10.1111/j.1467-6494.1972.tb00078.x.
Mellor, K. E., Coish, P., Brooks, B. W., Gallagher, E. P., Mills, M., Kavanagh, T. J., Simcox, N., Lasker, G. A., Botta, D., Voutchkova-Kostal, A., Kostal, J., Mullins, M. L., Nesmith, S. M., Corrales, J., Kristofco, L., Saari, G., Steele, W. B., Melnikov, F., Zimmerman, J. B., & Anastas, P. T. (2018). The safer chemical design game. Gamification of green chemistry and safer chemical design concepts for high school and undergraduate students. Green Chemistry Letters and Reviews, 11(2), 103–110. https://doi.org/10.1080/17518253.2018.1434566.
Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students learning outcomes in k-12 and higher education: A meta-analysis. Computers & Education, 70, 29–40. https://doi.org/10.1016/j.compedu.2013.07.033.
Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems, 77(12), 1321–1329.
Molloy, W., Huang, E., & Wunsche, B. C. (2019). Mixed reality piano tutor: A gamified piano practice environment. 2019 International Conference on Electronics, Information, and Communication (ICEIC). IEEE. https://doi.org/10.23919/elinfocom.2019.8706474.
Mongeon, P., & Paul-Hus, A. (2015). The journal coverage of web of Science and Scopus: A comparative analysis. Scientometrics, 106(1), 213–228. https://doi.org/10.1007/s11192-015-1765-5.
Moreno, R., & Mayer, R. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19(3), 309–326. https://doi.org/10.1007/s10648-007-9047-2.
Moseikina, M., Toktamysov, S., & Danshina, S. (2022). Modern technologies and gamification in historical education. Simulation & Gaming. https://doi.org/10.1177/10468781221075965
Motejlek, J., & Alpay, E. (2021). Taxonomy of virtual and augmented reality applications in education. IEEE Transactions on Learning Technologies, 14(3), 415–429. https://doi.org/10.1109/tlt.2021.3092964.
Mouronte-López, M. L., García, A., Bautista, S., & Cortés, C. (2020). Analyzing the gender influence on the interest in engineering and technical subjects. International Journal of Technology and Design Education, 31(4), 723–739. https://doi.org/10.1007/s10798-020-09580-3.
Mullins, J. K., & Sabherwal, R. (2020). Gamification: A cognitive-emotional view. Journal of Business Research, 106, 304–314. https://doi.org/10.1016/j.jbusres.2018.09.023.
Muñoz, E. G., Fabregat, R., Bacca-Acosta, J., Duque-Méndez, N., & Avila-Garzon, C. (2022). Augmented reality, virtual reality, and game technologies in ophthalmology training. Information, 13(5), 222. https://doi.org/10.3390/info13050222.
Murillo-Zamorano, L. R., López Sánchez, J., Godoy-Caballero, A. L., & Bueno Muñoz, C. (2021). Gamification and active learning in higher education: Is it possible to match digital society, academia and students’ interests? International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-021-00249-y
Mystakidis, S. (2020). Distance education gamification in social virtual reality: A case study on student engagement. 2020 11th International Conference on Information, Intelligence, Systems and Applications (IISA, 1–6. IEEE. https://doi.org/10.1109/iisa50023.2020.9284417.
Nacke, L. E., & Deterding, S. (2017). The maturing of gamification research. Computers in Human Behavior, 71, 450–454. https://doi.org/10.1016/j.chb.2016.11.062.
Nadi-Ravandi, S., & Batooli, Z. (2022). Gamification in education: A scientometric, content and co-occurrence analysis of systematic review and meta-analysis articles. Education and Information Technologies. https://doi.org/10.1007/s10639-022-11048-x.
Nah, F. F. H., Zeng, Q., Telaprolu, V. R., Ayyappa, A. P., & Eschenbrenner, B. (2014). Gamification of education: A review of literature. In Lecture notes in computer science (pp. 401–409). Springer International Publishing. https://doi.org/10.1007/978-3-319-07293-7_39.
Natale, A. F. D., Repetto, C., Riva, G., & Villani, D. (2020). Immersive virtual reality in k-12 and higher education: A 10-year systematic review of empirical research. British Journal of Educational Technology, 51(6), 2006–2033. https://doi.org/10.1111/bjet.13030.
National Research Council. (2012). Education for life and work: Developing transferable knowledge and skills in the 21st century. National Academies. https://doi.org/10.17226/13398
Nevin, C. R., Westfall, A. O., Rodriguez, J. M., Dempsey, D. M., Cherrington, A., Roy, B., Patel, M., & Willig, J. H. (2014). Gamification as a tool for enhancing graduate medical education. Postgraduate Medical Journal, 90(1070), 685–693. https://doi.org/10.1136/postgradmedj-2013-132486.
Nicholson, S. (2014). A RECIPE for meaningful gamification. In Gamification in education and business (pp. 1–20). Springer International Publishing. https://doi.org/10.1007/978-3-319-10208-5_1.
Nicola, S., Stoicu-Tivadar, L., & Patrascoiu, A. (2018). VR for education in information and tehnology: Application for bubble sort. 2018 International Symposium on Electronics and Telecommunications (ISETC). IEEE. https://doi.org/10.1109/isetc.2018.8583999.
Nielsen, J. (1994). Enhancing the explanatory power of usability heuristics. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 152–158. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/191666.191729.
Nielsen, J. (2000). Why you only need to test with 5 users. In Nielsen Norman Group. https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/.
O’Donovan, S. (2012). Gamification of the games course. University of Cape Town.
Oberhauser, R., & Lecon, C. (2019). TOWARDS GAMIFYING SOFTWARE STRUCTURE COMPREHENSION IN VIRTUAL REALITY. Mechatronic Systems and Control. https://doi.org/10.2316/j.2019.201-2873
Olmos, E., Cavalcanti, J. F., Soler, J. L., Contero, M., & Alcañiz, M. (2018). Mobile virtual reality: A promising technology to change the way we learn and teach. In Mobile and ubiquitous learning (pp. 95–106). Springer. https://doi.org/10.1007/978-981-10-6144-8_6.
Ortiz, M., Chiluiza, K., & Valcke, M. (2016). Gamification in higher education and stem: A systematic review of literature. EDULEARN Proceedings. IATED. https://doi.org/10.21125/edulearn.2016.0422.
Ouariachi, T., Li, C. Y., & Elving, W. J. L. (2020). Gamification approaches for education and engagement on pro-environmental behaviors: Searching for best practices. Sustainability, 12(11), 4565. https://doi.org/10.3390/su12114565.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., McGuinness, L. A., Stewart, L. A., Thomas, J., Tricco, A. C., Welch, V. A., Whiting, P., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery, 88, 105906. https://doi.org/10.1016/j.ijsu.2021.105906.
Palmas, F., Reinelt, R., Cichor, J. E., Plecher, D. A., & Klinker, G. (2021). Virtual reality public speaking training: Experimental evaluation of direct feedback technology acceptance. 2021 IEEE Virtual Reality and 3d User Interfaces (VR), 463–472. IEEE. https://doi.org/10.1109/vr50410.2021.00070.
Palomino, P. T., Toda, A. M., Oliveira, W., Cristea, A. I., & Isotani, S. (2019). Narrative for gamification in education: Why should you care? 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT). IEEE. https://doi.org/10.1109/icalt.2019.00035.
Papagiannakis, G., Lydatakis, N., Kateros, S., Georgiou, S., & Zikas, P. (2018). Transforming medical education and training with VR using mages. SIGGRAPH Asia 2018 Posters. https://doi.org/10.1145/3283289.3283291
Parakh, A., Subramaniam, M., & Ostler, E. (2017). QuaSim: A virtual quantum cryptography educator. 2017 IEEE International Conference on Electro Information Technology (EIT), 600–605. IEEE. https://doi.org/10.1109/eit.2017.8053434.
Parong, J., & Mayer, R. E. (2018). Learning science in immersive virtual reality. Journal of Educational Psychology, 110(6), 785. https://doi.org/10.1037/edu0000241.
Parong, J., & Mayer, R. E. (2019). Cognitive consequences of playing brain-training games in immersive virtual reality. Applied Cognitive Psychology, 34(1), 29–38. https://doi.org/10.1002/acp.3582.
Patterson, K., Lilja, A., Arrebola, M., & McGhee, J. (2019). Molecular genomics education through gamified cell exploration in virtual reality. The 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry, 1–2. ACM. https://doi.org/10.1145/3359997.3365724.
Paul, G. (1966). Personal report of confidence as a speaker.
Pears, M., Yiasemidou, M., Ismail, M. A., Veneziano, D., & Biyani, C. S. (2020). Role of immersive technologies in healthcare education during the COVID-19 epidemic. Scottish Medical Journal, 65(4), 112–119. https://doi.org/10.1177/0036933020956317.
Pekrun, R., & Linnenbrink-Garcia, L. (2014). Introduction to emotions in education. International handbook of emotions in education (pp. 11–20). Routledge.
Persky, S., & McBride, C. M. (2009). Immersive virtual environment technology: A promising tool for future social and behavioral genomics research and practice. Health Communication, 24(8), 677–682. https://doi.org/10.1080/10410230903263982.
Pifarré, M., & Tomico, O. (2007). Bipolar laddering (BLA) a participatory subjective exploration method on user experience. Proceedings of the 2007 Conference on Designing for User eXperiences - DUX’07. ACM Press. https://doi.org/10.1145/1389908.1389911.
Pinto, R. D., Peixoto, B., Melo, M., Cabral, L., & Bessa, M. (2021). Foreign language learning gamification using virtual reality-a systematic review of empirical research. Education Sciences, 11(5), 222. https://doi.org/10.3390/educsci11050222.
Pintrich, P. R., & Groot, E. V. D. (1990). Motivated strategies for learning questionnaire. American Psychological Association (APA). https://doi.org/10.1037/t09161-000
Pinzón-Cristancho, B., Calderón-Torres, H. A., Mejía-Moncayo, C., & Rojas, A. E. (2019). An educational strategy based on virtual reality and QFD to develop soft skills in engineering students. In Communications in computer and information science (pp. 89–100). Springer International Publishing. https://doi.org/10.1007/978-3-030-31019-6_8.
Poulova, P., Cerna, M., Hamtilova, J., Malý, F., Kozel, T., Kriz, P., Han, J., & Ulrych, Z. (2020). Virtual hotel - gamification in the management of tourism education. In Cross reality and data science in engineering (pp. 773–781). Springer International Publishing. https://doi.org/10.1007/978-3-030-52575-0_63.
Pozo-Sánchez, S., Lampropoulos, G., & López-Belmonte, J. (2022). Comparing gamification models in higher education using face-to-face and virtual escape rooms. Journal of New Approaches in Educational Research, 11(2), 307. https://doi.org/10.7821/naer.2022.7.1025.
Prensky, M. (2001). Digital natives, digital immigrants part 2: Do they really think differently? On the Horizon, 9(6), 1–6. https://doi.org/10.1108/10748120110424843.
Psotka, J. (1995). Immersive training systems: Virtual reality and education and training. Instructional Science, 23(5–6), 405–431. https://doi.org/10.1007/BF00896880.
Punyani, S., Kahile, M., & Kane, S. (2022). Can AR, VR, and gaming be the future of physiotherapy education and training? ECS Transactions, 107(1), 16057–16063. https://doi.org/10.1149/10701.16057ecst.
Radianti, J., Majchrzak, T. A., Fromm, J., & Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education, 147, 103778. https://doi.org/10.1016/j.compedu.2019.103778.
Rashid, S., Khattak, A., Ashiq, M., Ur Rehman, S., & Rashid Rasool, M. (2021). Educational landscape of virtual reality in higher education: Bibliometric evidences of publishing patterns and emerging trends. Publications, 9(2), 17. https://doi.org/10.3390/publications9020017.
Ratten, V., & Jones, P. (2021). Covid-19 and entrepreneurship education: Implications for advancing research and practice. The International Journal of Management Education, 19(1), 100432. https://doi.org/10.1016/j.ijme.2020.100432.
Redondo, E., Fonseca, D., Sánchez-Sepúlveda, M., Zapata, H., Navarro, I., Gimenez, L., & Pérez, M. A. (2020). EDUGAME4CITY. A gamification for architecture students. Viability study applied to urban design. In Learning and collaboration technologies. Human and technology ecosystems (pp. 296–314). Springer International Publishing. https://doi.org/10.1007/978-3-030-50506-6_22.
Reitz, L., Sohny, A., & Lochmann, G. (2016). VR-based gamification of communication training and oral examination in a second language. International Journal of Game-Based Learning, 6(2), 46–61. https://doi.org/10.4018/ijgbl.2016040104.
Rheinberg, F., Vollmeyer, R., & Burns, B. D. (2001). FAM: Ein Fragebogen Zur Erfassung aktuller motivation in lern- und leistungssituationen. Diagnostica, 47(2), 57–66. https://doi.org/10.1026//0012-1924.47.2.57.
Ribeiro, M. A. O., Tori, A. A., Tori, R., & Nunes, F. L. S. (2019). Immersive game for dental anesthesia training with haptic feedback. ACM SIGGRAPH 2019 Posters. ACM. https://doi.org/10.1145/3306214.3338592.
Ritzhaupt, A. D., Huang, R., Sommer, M., Zhu, J., Stephen, A., Valle, N., Hampton, J., & Li, J. (2021). A meta-analysis on the influence of gamification in formal educational settings on affective and behavioral outcomes. Educational Technology Research and Development, 69(5), 2493–2522. https://doi.org/10.1007/s11423-021-10036-1.
Rivas, E. S., Palmero, J. R., & Rodríguez, J. S. (2019). Gamification of assessments in the natural sciences subject in primary education. Educational Sciences: Theory & Practice. https://doi.org/10.12738/estp.2019.1.0296
Robinson, R., Molenda, M., & Rezabek, L. (2013). Facilitating learning. Educational technology (pp. 27–60). Routledge.
Robson, K., Plangger, K., Kietzmann, J. H., McCarthy, I., & Pitt, L. (2015). Is it all a game? Understanding the principles of gamification. Business Horizons, 58(4), 411–420. https://doi.org/10.1016/j.bushor.2015.03.006.
Rojas-Sánchez, M. A., Palos-Sánchez, P. R., & Folgado-Fernández, J. A. (2022). Systematic literature review and bibliometric analysis on virtual reality and education. Education and Information Technologies. https://doi.org/10.1007/s10639-022-11167-5.
Romasz, T. E., Kantor, J. H., & Elias, M. J. (2004). Implementation and evaluation of urban school-wide social-emotional learning programs. Evaluation and Program Planning, 27(1), 89–103. https://doi.org/10.1016/j.evalprogplan.2003.05.002.
Rose, J. A., O’Meara, J. M., Gerhardt, T. C., & Williams, M. (2016). Gamification: Using elements of video games to improve engagement in an undergraduate physics class. Physics Education, 51(5), 055007. https://doi.org/10.1088/0031-9120/51/5/055007.
Roseth, C. J., Johnson, D. W., & Johnson, R. T. (2008). Promoting early adolescents’ achievement and peer relationships: The effects of cooperative, competitive, and individualistic goal structures. Psychological Bulletin, 134(2), 223–246. https://doi.org/10.1037/0033-2909.134.2.223.
Rosmansyah, Y., Achiruzaman, M., & Hardi, A. B. (2019). A 3D multiuser virtual learning environment for online training of agriculture surveyors. Journal of Information Technology Education: Research, 18, 481–507. https://doi.org/10.28945/4455.
Roumana, A., Georgopoulos, A., & Koutsoudis, A. (2022). DEVELOPING AN EDUCATIONAL CULTURAL HERITAGE 3D PUZZLE IN a VIRTUAL REALITY ENVIRONMENT. The International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences, 43, 885–891. https://doi.org/10.5194/isprs-archives-xliii-b2-2022-885-2022.
Roussou, M. (2004). Learning by doing and learning through play: An exploration of interactivity in virtual environments for children. Computers in Entertainment (CIE), 2(1), 10–10. https://doi.org/10.1145/973801.973818.
Rupp, M. A., Odette, K. L., Kozachuk, J., Michaelis, J. R., Smither, J. A., & McConnell, D. S. (2019). Investigating learning outcomes and subjective experiences in 360-degree videos. Computers & Education, 128, 256–268. https://doi.org/10.1016/j.compedu.2018.09.015.
Ryan, M. L. (2015). Narrative as virtual reality 2: Revisiting immersion and interactivity in literature and electronic media. JHU.
Sailer, M., & Homner, L. (2019). The gamification of learning: A meta-analysis. Educational Psychology Review, 32(1), 77–112. https://doi.org/10.1007/s10648-019-09498-w.
Sanchez, É., Ney, M., & Labat, J. M. (2011). Jeux sérieux et pédagogie universitaire: De La conception à l’évaluation Des apprentissages. Revue Internationale Des Technologies En pédagogie Universitaire, 8(1–2), 48. https://doi.org/10.7202/1005783ar.
Sanchez-Sepulveda, M. V., Marti-Audi, N., & Fonseca-Escudero, D. (2019). Visual technologies for urban design competences in architecture education. Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing Multiculturality, 726–731. ACM. https://doi.org/10.1145/3362789.3362822.
Sandrone, S., & Carlson, C. (2021). Gamification and game-based education in neurology and neuroscience: Applications, challenges, and opportunities. Brain Disorders, 1, 100008. https://doi.org/10.1016/j.dscb.2021.100008.
Šašinka, Č., Stachoň, Z., Sedlák, M., Chmelík, J., Herman, L., Kubíček, P., Šašinková, A., Doležal, M., Tejkl, H., Urbánek, T., Svatoňová, H., Ugwitz, P., & Juřík, V. (2018). Collaborative immersive virtual environments for education in geography. ISPRS International Journal of Geo-Information, 8(1), 3. https://doi.org/10.3390/ijgi8010003.
Sathya, A., Priya, L., & Kumar, P. (2022). A virtual reality based interactive android educational application. ECS Transactions, 107(1), 18235–18245. https://doi.org/10.1149/10701.18235ecst.
Schmalstieg, D., Fuhrmann, A., Hesina, G., Szalavári, Z., Encarnaçao, L. M., Gervautz, M., & Purgathofer, W. (2002). The studierstube augmented reality project. Presence: Teleoperators & Virtual Environments, 11(1), 33–54. https://doi.org/10.1162/105474602317343640.
Schubert, T., Friedmann, F., & Regenbrecht, H. (2001). The experience of presence: Factor analytic insights. Presence: Teleoperators and Virtual Environments, 10(3), 266–281. https://doi.org/10.1162/105474601300343603.
Seaborn, K., & Fels, D. I. (2015). Gamification in theory and action: A survey. International Journal of Human-Computer Studies, 74, 14–31. https://doi.org/10.1016/j.ijhcs.2014.09.006.
Senecal, S., Nijdam, N. A., Aristidou, A., & Magnenat-Thalmann, N. (2020). Salsa dance learning evaluation and motion analysis in gamified virtual reality environment. Multimedia Tools and Applications, 79(33–34), 24621–24643. https://doi.org/10.1007/s11042-020-09192-y.
Shapley, K., Sheehan, D., Maloney, C., & Caranikas-Walker, F. (2011). Effects of technology immersion on middle school students’ learning opportunities and achievement. The Journal of Educational Research, 104(5), 299–315. https://doi.org/10.1080/00220671003767615.
Sharan, Y. (2010). Cooperative learning for academic and social gains: Valued pedagogy, problematic practice. European Journal of Education, 45(2), 300–313. https://doi.org/10.1111/j.1465-3435.2010.01430.x.
Sherman, W. R., & Craig, A. B. (2003). Understanding virtual reality—interface, application, and design. Presence: Teleoperators and Virtual Environments, 12(4), 441–442. https://doi.org/10.1162/105474603322391668.
Shorey, S., Ang, E., Ng, E. D., Yap, J., Lau, L. S. T., & Chui, C. K. (2020). Communication skills training using virtual reality: A descriptive qualitative study. Nurse Education Today, 94, 104592. https://doi.org/10.1016/j.nedt.2020.104592.
Silva, F., Ferreira, R., Castro, A., Pinto, P., & Ramos, J. (2021). Experiments on gamification with virtual and augmented reality for practical application learning. In Methodologies and intelligent systems for technology enhanced learning, 11th international conference (pp. 175–184). Springer International Publishing. https://doi.org/10.1007/978-3-030-86618-1_18.
Simões, J., Redondo, R. D., & Vilas, A. F. (2013). A social gamification framework for a k-6 learning platform. Computers in Human Behavior, 29(2), 345–353. https://doi.org/10.1016/j.chb.2012.06.007.
Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI, 3, 74. https://doi.org/10.3389/frobt.2016.00074.
Smith, J., Nguyen, M., Allison, N., Carr, B., Wood, K., Uribe-Quevedo, A., Perera, S., Tokuhiro, A., & Waller, E. (2021). Seeing the invisible: A VR approach to radiation attenuation visualization for nuclear engineering laboratory practice. IEEE Transactions on Games. https://doi.org/10.1109/tg.2021.3110717
Stelian, N., & Lacramioara, S. T. (2018). Mixed reality supporting modern medical education. Studies in Health Technology and Informatics 255(Decision Support Systems and Education. https://doi.org/10.3233/978-1-61499-921-8-242
Stelian, N., Ioan, V., & Lacramioara, S. T. (2017). VR medical gamification for training and education. Studies in Health Technology and Informatics, 236, 97–103. https://doi.org/10.3233/978-1-61499-759-7-97. Health Informatics Meets eHealth.
Stigall, J., & Sharma, S. (2017). Virtual reality instructional modules for introductory programming courses. 2017 IEEE Integrated STEM Education Conference (ISEC), 34–42. IEEE. https://doi.org/10.1109/isecon.2017.7910245.
Stranger-Johannessen, E. (2018). Exploring math achievement through gamified virtual reality. In Lifelong technology-enhanced learning (pp. 613–616). Springer International Publishing. https://doi.org/10.1007/978-3-319-98572-5_57.
Subhash, S., & Cudney, E. A. (2018). Gamified learning in higher education: A systematic review of the literature. Computers in Human Behavior, 87, 192–206. https://doi.org/10.1016/j.chb.2018.05.028.
Suh, A., & Prophet, J. (2018). The state of immersive technology research: A literature analysis. Computers in Human Behavior, 86, 77–90. https://doi.org/10.1016/j.chb.2018.04.019.
Suncksen, M., Bendig, H., Teistler, M., Wagner, M., Bott, O. J., & Dresing, K. (2018). Gamification and virtual reality for teaching mobile x-ray imaging. 2018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH). IEEE. https://doi.org/10.1109/segah.2018.8401364.
Sung, Y. T., Chang, K. E., & Liu, T. C. (2016). The effects of integrating mobile devices with teaching and learning on students learning performance: A meta-analysis and research synthesis. Computers & Education, 94, 252–275. https://doi.org/10.1016/j.compedu.2015.11.008.
Suppes, R., Feldmann, Y., Abdelrazeq, A., & Daling, L. (2019). Virtual reality mine: A vision for digitalised mining engineering education. Mining goes digital (pp. 17–24). CRC. https://doi.org/10.1201/9780429320774-3
Swacha, J. (2021). State of research on gamification in education: A bibliometric survey. Education Sciences, 11(2), 69. https://doi.org/10.3390/educsci11020069.
Swartout, W., & van Lent, M. (2003). Making a game of system design. Communications of the ACM, 46(7), 32–39. https://doi.org/10.1145/792704.792727.
Sweetser, P., & Wyeth, P. (2005). GameFlow: A model for evaluating player enjoyment in games. Computers in Entertainment, 3(3), 3–3. https://doi.org/10.1145/1077246.1077253.
Symonenko, S., Zaitseva, N., Osadchyi, V., Osadcha, K., & Shmeltser, E. (2019). Virtual reality in foreign language training at higher educational institutions. Augmented Reality in Education: Proceedings of the 2nd International Workshop (AREdu 2019), 37–49. https://doi.org/10.31812/123456789/3759.
Tan, C., Tay, J., Tan, P. Y., & Ong, W. K. (2022). Introducing basic manufacturing concepts to secondary school students through virtual reality gamification. Proceedings of the 12th Conference on Learning Factories (CLF 2022), 1–6.
Theethum, T., Arpornrat, A., & Vittayakorn, S. (2021). Thinkercise: An educational VR game for python programming. 2021 18th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), 439–442. IEEE. https://doi.org/10.1109/ecti-con51831.2021.9454730.
Thompson, R. L., Higgins, C. A., & Howell, J. M. (1991). Personal computing: Toward a conceptual model of utilization. MIS Quarterly, 15(1), 125. https://doi.org/10.2307/249443.
Tiefenbacher, F. (2020). Evaluation of gamification elements in a VR application for higher education. In Communications in computer and information science (pp. 830–847). Springer International Publishing. https://doi.org/10.1007/978-3-030-56441-4_63.
Tokan, M. K., & Imakulata, M. M., and (2019). The effect of motivation and learning behaviour on student achievement. South African Journal of Education, 39(1), 1–8. https://doi.org/10.15700/saje.v39n1a1510.
Tømte, C. E. (2015). Educating teachers for the new millennium? - teacher training, ICT and digital competence. Nordic Journal of Digital Literacy, 10, 138–154. https://doi.org/10.18261/issn1891-943x-2015-jubileumsnummer-10.
Vagg, T., Plant, B., Ronan, N., Eustace, J., & Tabirca, S. (2016). Using an interactive virtual reality game-based educational application to teach medical students about cystic fibrosis. Proceedings of the 6th Irish Conference on Game-Based Learning (Igbl2016), 93–99.
Van Roy, R., & Zaman, B. (2018). Need-supporting gamification in education: An assessment of motivational effects over time. Computers & Education, 127, 283–297. https://doi.org/10.1016/j.compedu.2018.08.018.
Vega, J., Rose, S., Eckhardt, C., Tahai, L., Humer, I., & Pietroszek, K. (2017). VR wildfire prevention. Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, 1–2. ACM. https://doi.org/10.1145/3139131.3141218.
Vidal, T., Navarro, I., Sanchez, A., Valls, F., Gimenez, L., & Redondo, E. (2021). Virtual reality for enhanced learning in artistic disciplines of degree of video games. 2021 16th Iberian Conference on Information Systems and Technologies (CISTI), 1–5. IEEE. https://doi.org/10.23919/cisti52073.2021.9476656.
Villagrasa, S., Fonseca, D., & Durán, J. (2014a). Teaching case: Applying gamification techniques and virtual reality for learning building engineering 3D arts. Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality - TEEM’14, 171–177. ACM Press. https://doi.org/10.1145/2669711.2669896.
Villagrasa, S., Fonseca, D., Redondo, E., & Duran, J. (2014b). Teaching case of gamification and visual technologies for education. Journal of Cases on Information Technology, 16(4), 38–57. https://doi.org/10.4018/jcit.2014100104.
Villena-Taranilla, R., Tirado-Olivares, S., Cózar-Gutiérrez, R., & González-Calero, J. A. (2022). Effects of virtual reality on learning outcomes in k-6 education: A meta-analysis. Educational Research Review, 35, 100434. https://doi.org/10.1016/j.edurev.2022.100434.
Wang, D. (2017). Gamified learning through unity 3D in visualizing environments. Neural Computing and Applications, 29(5), 1399–1404. https://doi.org/10.1007/s00521-017-2928-5.
Webster, R. (2016). Declarative knowledge acquisition in immersive virtual learning environments. Interactive Learning Environments, 24(6), 1319–1333. https://doi.org/10.1080/10494820.2014.994533.
Webster, J., & Watson, R. T. (2002). Analyzing the past to prepare for the future: Writing a literature review (pp. xiii–xxiii). MIS Quarterly.
Wigfield, A., Faust, L. T., Cambria, J., & Eccles, J. S. (2019). Motivation in education. The oxford handbook of human motivation (pp. 443–461). Oxford University Press.
Wilson, A., Sean, O’Connor, J., Taylor, L., & Carruthers, D. (2017b). A case study into the use of virtual reality and gamification in ophthalmology training. In Serious games (pp. 158–169). Springer International Publishing. https://doi.org/10.1007/978-3-319-70111-0_15.
Wilson, A. S., O’Connor, J., Taylor, L., & Carruthers, D. (2017a). A 3D virtual reality ophthalmoscopy trainer. The Clinical Teacher, 14(6), 427–431. https://doi.org/10.1111/tct.12646.
Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225–240. https://doi.org/10.1162/105474698565686.
Witmer, B. G., Jerome, C. J., & Singer, M. J. (2005). The factor structure of the presence questionnaire. Presence: Teleoperators and Virtual Environments, 14(3), 298–312. https://doi.org/10.1162/105474605323384654.
Xu, J., Weng, J., Xu, Y., & Xin, Y. (2022). A virtual reality scaffolding prototype for college students self-directed learning in STEAM. In Lecture notes in computer science (pp. 193–204). Springer International Publishing. https://doi.org/10.1007/978-3-031-05431-0_14.
Xu, T., Yallapragada, V. V. B., Tangney, M., & Tabirca, S. (2022). Schedio-pro: An interactive virtual reality game for protein design. In Lecture notes in electrical engineering (pp. 293–300). Springer Singapore. https://doi.org/10.1007/978-981-19-0390-8_36.
Yampray, K., & Jirapanthong, W. (2017). Towards learning social cultures through virtual reality game. Proceedings of 2017 the 7th International Workshop on Computer Science and Engineering, 439–443. WCSE. https://doi.org/10.18178/wcse.2017.06.075.
Yengin, D., & Bayrak, T. (2019). Analysis of the use of virtual reality technology in gamified learning. Turkish Online Journal of Design Art Communication. https://doi.org/10.7456/ctc_2019_25
Yiannakopoulou, E., Nikiteas, N., Perrea, D., & Tsigris, C. (2015). Virtual reality simulators and training in laparoscopic surgery. International Journal of Surgery, 13, 60–64. https://doi.org/10.1016/j.ijsu.2014.11.014.
Yildirim, I. (2017). The effects of gamification-based teaching practices on student achievement and students’ attitudes toward lessons. The Internet and Higher Education, 33, 86–92. https://doi.org/10.1016/j.iheduc.2017.02.002.
Yusoffa, A., & Shafirilb, S. (2019). The implementation of serious game concept into forest’s ranger virtual reality game as a gamification learning tool. International Journal of Innovation Creativity and Change, 6(2), 164–173.
Zawacki-Richter, O., & Latchem, C. (2018). Exploring four decades of research in computers & education. Computers & Education, 122, 136–152. https://doi.org/10.1016/j.compedu.2018.04.001.
Zhang, J., & Bryan-Kinns, N. (2022). QiaoLe: Accessing traditional Chinese musical instruments in VR. 2022 IEEE Conference on Virtual Reality and 3d User Interfaces Abstracts and Workshops (VRW). IEEE. https://doi.org/10.1109/vrw55335.2022.00080.
Zhang, B., Benton, S., Pearson, W., LeMoine, J., Herbertson, N., Williams, H., & Goodman, L. (2016). Playing 3D: Digital technologies and novel 3d virtual environments to support the needs of Chinese learners in western education: Cross-cultural collaboration, gamification, well-being and social inclusion. 2016 22nd International Conference on Virtual System & Multimedia (VSMM). IEEE. https://doi.org/10.1109/vsmm.2016.7863154.
Zhu, J., & Liu, W. (2020). A tale of two databases: The use of web of science and Scopus in academic papers. Scientometrics, 123(1), 321–335. https://doi.org/10.1007/s11192-020-03387-8.
Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. O’Reilly Media, Inc.
Funding
Open access funding provided by HEAL-Link Greece. No funding was received for conducting this study.
Author information
Authors and Affiliations
Contributions
Both authors have contributed equally to this study and approved the submission of the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regarding to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Lampropoulos, G., Kinshuk Virtual reality and gamification in education: a systematic review. Education Tech Research Dev 72, 1691–1785 (2024). https://doi.org/10.1007/s11423-024-10351-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-024-10351-3