Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Transforming Classic Learning Games with the Use of AR: The Case of the Word Hangman Game

  • Conference paper
  • First Online:
Learning and Collaboration Technologies: Games and Virtual Environments for Learning (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12785))

Included in the following conference series:

Abstract

Augmented Reality in combination with playful learning is used to enhance students’ engagement in blended learning environments. This paper presents an AR game with hand tracking & hand interaction that transforms the classic Hangman word game. The thematic word areas of the game are recycling and Covid 19, two areas that are of great interest today.

The game offers alternative interaction through a 3D hand model and 3D objects/letters. The player moves the 3D letters to complete words and collect paper cards with the words’ image. These paper cards are then placed, in any order, by the student to create a picture story and a virtual maquette with AR objects is generated. This maquette allows player to create different picture-stories by shuffling the order of found words’ paper cards. A field study has been contacted with two groups of students, one group used classic learning techniques and the other group used our AR game. Preliminary results of the study show that all students improved their language skills but only the group with the AR game evolve into being more active, involved, participative and engaged in the educational process and developed their creativity skills.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Radu, I.: Augmented reality in education: a meta-review and cross-media analysis. Pers. Ubiquit. Comput. 18(6), 1533–1543 (2014). https://doi.org/10.1007/s00779-013-0747-y

    Article  Google Scholar 

  2. Hamari, J., Shernoff, D.J., Rowe, E., Coller, B., Asbell-Clarke, J., Edwards, T.: Challenging games help students learn: an empirical study on engagement, flow and immersion in game-based learning. Comput. Hum. Behav. 54, 170–179 (2016)

    Article  Google Scholar 

  3. Riemer, V., Schrader, C.: Learning with quizzes, simulations, and adventures: students’ attitudes, perceptions and intentions to learn with different types of serious games. Comput. Educ. 88, 160–168 (2015). https://doi.org/10.1016/j.compedu.2015.05.003

    Article  Google Scholar 

  4. Mahayuddin, Z., Saif, A.F.M.: Augmented reality based AR alphabets towards improved learning process in primary education system. JCR 7(19), 514–521 (2020)

    Google Scholar 

  5. Huang, T.C., Chen, C.C., Chou, Y.W.: Animating eco-education: to see, feel, and discover in an augmented reality-based experiential learning environment. Comput. Educ. 96, 72–82 (2016). https://doi.org/10.1016/j.compedu.2016.02.008

    Article  Google Scholar 

  6. Schechter, R., Macaruso, P., Kazakoff, E.R., Brooke, E.: Exploration of a blended learning approach to reading instruction for low SES students in early elementary grades. Comput. Sch. 32(3–4), 183–200 (2015). https://doi.org/10.1080/07380569.2015.1100652

  7. Alarcia, D.T., Barco, D.I.: Videojuegos y aprendizaje de la Historia: la saga Assasin’s Creed. Contextos Educativos. Revista de Educación 17, 145 (2014). https://doi.org/10.18172/con.2598

    Article  Google Scholar 

  8. Chu, H.-C., Hung, C.-M.: Effects of the digital game-development approach on elementary school students’ learning motivation, problem solving, and learning achievement. Int. J. Distance Educ. Technol., 472–487 (2015). https://doi.org/10.4018/978-1-4666-8200-9.ch023

  9. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. E77-D, 1321–1329 (1994)

    Google Scholar 

  10. Ronald, T.A.: A survey of augmented reality. Presense 6(4), 355–385 (1997)

    Article  Google Scholar 

  11. Gouidis, F., Panteleris, P., Oikonomidis, I., Argyros, A.: Accurate hand keypoint localization on mobile devices. In: Proceedings of the 16th International Conference on Machine Vision and Applications (MVA) (2019). https://doi.org/10.23919/MVA.2019.8758059

  12. Fotaris, P., Mastoras, T., Leinfellner, R., Rosunally, Y.: Climbing up the leaderboard; an empirical study of applying gamification techniques to a computer programming class. Electr. J. E-learn. 14(2), 94–110 (2016)

    Google Scholar 

  13. Sitzmann, T.: A meta-analytic examination of the instruction effectiveness of computer-based simulation games. Pers. Psychol. 64, 489–528 (2011)

    Article  Google Scholar 

  14. Prensky, M.: Digital Game-Based Learning. McGraw-Hill, New York (2007). https://doi.org/10.1145/950566.950567

  15. Enyedy, N., Danish, J. A., Delacruz, G., Kumar, M.: Learning physics through play in an augmented reality environment. Int. J. Comput. Support. Collab. Learn. 7(3) (2012). https://doi.org/10.1007/s11412-012-9150-3

  16. Bacca, J., Baldiris, S., Fabregat, R., Graf, S., Kinshuk: Augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014).

    Google Scholar 

  17. Cai, S., Chiang, F.K., Sun, Y., Lin, C., Lee, J.J.: Applications of augmented reality-based natural interactive learning in magnetic field instruction. Interact. Learn. Environ. 25(6), 778–791 (2017). https://doi.org/10.1080/10494820.2016.1181094

    Article  Google Scholar 

  18. Laine, T.H., Nygren, E., Dirin, A., Suk, H.J.: Science spots AR: a platform for science learning games with augmented reality. Educ. Technol. Res. Dev. 64, 507–531 (2016)

    Article  Google Scholar 

  19. Alakärppä, I.; Jaakkola, E.; Väyrynen, J.; Häkkilä, J.: Using nature elements in mobile AR for education with children. In: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, Vienna, Austria, 4–7 September (2017)

    Google Scholar 

  20. Hockly, N.: Augmented reality. ELT J. 73(3), 328–334 (2019)

    Google Scholar 

  21. Shabalina, O., Malliarakis, C., Tomos, F., Mozelius, P.: Game-based learning for learning to program: from learning through play to learning through game development. In: Pivec, M., Gründler, J. (eds.) Proceedings of the European Conference on Games Based Learning, vol. 11, pp. 571–576. Academic Conferences and Publishing International Limited, Reading, UK (2017)

    Google Scholar 

  22. Oranç, C., Küntay, A.C.: Learning from the real and the virtual worlds: Educational use of augmented reality in early childhood. Int. J. Child-Comput. Interact. 21, 104–111 (2019). https://doi.org/10.1016/j.ijcci.2019.06.002

    Article  Google Scholar 

  23. Hirsh-Pasek, K., Zosh, J.M., Golinkoff, R.M., Gray, J.H., Robb, M.B., Kaufman, J.: Putting education in educational apps: lessons from the science of learning. Psychol. Sci. Public Interest. 16, 3–34 (2015). https://doi.org/10.1177/1529100615569721

    Article  Google Scholar 

  24. Tobar-Muñoz, H., Baldiris, S., Fabregat, R.: Augmented reality game-based learning: enriching students’ experience during reading comprehension activities. J. Educ. Comput. Res. 55(7), 901–936 (2017)

    Google Scholar 

  25. Mwakapina, W., Mhandeni, J.S., Nyinondi, O.: WhatsApp mobile tool in second language learning: opportunities, potentials and challenges in higher education settings in Tanzania. Int. J. English Lang. Educ. 4(2), 70 (2016). https://doi.org/10.5296/ijele.v4i2.9711

    Article  Google Scholar 

  26. Önal, N., Çevik, K.K., Şenol, V., Önal, N.: The effect of SOS Table learning environment on mobile learning tools acceptance, motivation and mobile learning attitude in English language learning. Interact. Learn. Environ., 1–14. https://doi.org/10.1080/10494820.2019.1690529

  27. Alemi, M., Meghdari, A., Ghazisaedy, M.: The impact of social robotics on L2 learners’ anxiety and attitude in English vocabulary acquisition. Int. J. Soc. Robot. 7(4), 523–535 (2015). https://doi.org/10.1007/s12369-015-0286-y

    Article  Google Scholar 

  28. Gilakjani, A.P., Branch, L., Branch, L.: A review of the literature on the integration of technology into the learning and teaching of English language skills. Int. J. English Linguist. 7(5), 95–106 (2017). https://doi.org/10.5539/ijel.v7n5p95

  29. Berns, A., Isla-Montes, J.-L., Palomo-Duarte, M., Dodero, J.-M.: Motivation, students’ needs and learning outcomes: a hybrid game-based app for enhanced language learning. Springerplus 5(1), 1305 (2016). https://doi.org/10.1186/s40064-016-2971-1

    Article  Google Scholar 

  30. Butler, Y.G.: The use of computer games as foreign language learning tasks for digital natives. System 54, 91–102 (2015). https://doi.org/10.1016/j.system.2014.10.010

    Article  Google Scholar 

  31. Hwang, W.-Y., Shih, T.K., Ma, Z.-H., Shadiev, R., Chen, S.-Y.: Evaluating listening and speaking skills in a mobile game-based learning environment with situational contexts. Comput. Assist. Lang. Learn. 29(4), 639–657 (2016). https://doi.org/10.1080/09588221.2015.1016438

    Article  Google Scholar 

  32. Le, H.Q., Kim, J.I.: An augmented reality application with hand gestures for learning 3D geometry. In: 2017 IEEE International Conference on Big Data and Smart Computing, BigComp, pp. 34–41 (2017). https://doi.org/10.1109/BIGCOMP.2017.7881712

  33. Cui, C., Sourin, A.: Mid-air interaction with optical tracking for 3D modeling. Comput. Graph. 74, 1–11 (2018). https://doi.org/10.1016/j.cag.2018.04.004

    Article  Google Scholar 

  34. Kim, J.S., Park, J.M.: Direct and realistic handover of a virtual object. In: IEEE International Conference on Intelligent Robots and Systems, vol. 2016, pp. 994–999 (2016). https://doi.org/10.1109/IROS.2016.7759170

  35. Liu, H., et al.: High-fidelity grasping in virtual reality using a glove-based system. In: Proceedings of the IEEE Conference on Robotics and Automation, vol. 2019, pp. 5180–5186 (2019). https://doi.org/10.1109/ICRA.2019.8794230

  36. Wu, Y., Wang, C.M.: Applying hand gesture recognition and joint tracking to a TV controller using CNN and Convolutional Pose Machine. In: Proceedings of the International Conference on Pattern Recognition, vol. 2018, pp. 3086–3091 (2018). https://doi.org/10.1109/ICPR.2018.8546209

  37. Kyriakou, P., Hermon, S.: Can i touch this? Using natural interaction in a museum augmented reality system. Digit. Appl. Archaeol. Cult. Herit. 12, 1–9 (2019). https://doi.org/10.1016/j.daach.2018.e00088

    Article  Google Scholar 

  38. Sdravopoulou, K., Castillo, J.J.G., González, J.M.M.: Naturalistic approaches applied to AR technology: an evaluation. Educ. Inf. Technol. 26(1), 683–697 (2020). https://doi.org/10.1007/s10639-020-10283-4

    Article  Google Scholar 

  39. Victor, D.: HandTrack: a library for prototyping real-time hand tracking interfaces using convolutional neural networks, GitHub Repos. (2017). https://github.com/victordibia/handtracking/tree/master/docs/handtrack.pdf

  40. Juhee, L.: Problem-based gaming via an augmented reality mobile game and a printed game in foreign language education. Educ. Inf. Technol. (2020).https://doi.org/10.1007/s10639-020-10391-1

  41. Parmaxi, A., Demetriou, A.A.: Augmented reality in language learning: a state‐of‐the‐art review of 2014–2019. J. Comput. Assist. Learn. 36(6), 861–875 (2020). https://doi.org/10.1111/jcal.12486

    Article  Google Scholar 

  42. Martinez, A.A., Benito, J.R.L., Gonzalez, E.A., Ajuria, E.B.: An experience of the application of augmented reality to learn English in infant education. In: 2017 International Symposium on Computers in Education, SIIE 2017, vol. 2018, pp. 1–6 (2017). https://doi.org/10.1109/SIIE.2017.8259645

  43. Dalim, C.S.C., Piumsomboon, T., Dey, A., Billinghurst, M., Sunar, S.: TeachAR: an interactive augmented reality tool for teaching basic English to non-native children. In: Adjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016, pp. 344–345 (2017). https://doi.org/10.1109/ISMAR-Adjunct.2016.0113

  44. Solak, E., Cakır, R.: Investigating the role of augmented reality technology in the language classroom . Croatian J. Educ. 18(4), 1067–1085 (2017). https://doi.org/10.15516/cje.v18i4.1729

    Article  Google Scholar 

  45. Yilmaz, R.M., Goktas, Y.: Using augmented reality technology in storytelling activities: examining elementary students’ narrative skill and creativity. Virtual Reality 21(2), 75–89 (2016). https://doi.org/10.1007/s10055-016-0300-1

    Article  Google Scholar 

  46. Tobar-Muñoz, H., Baldiris, S., Fabregat, R.: Augmented reality game-based learning: enriching students’ experience during reading comprehension activities. J. Educ. Comput. Res. 55(7), 901–936 (2017). https://doi.org/10.1177/0735633116689789

    Article  Google Scholar 

  47. Bartholomew, K., Henderson, A.J.Z., Marcia, J.E.: Coding semi-structured interviews in social psychological research. In: Reis, H., Judd, C.M. (eds.) Handbook of Research Methods in Social and Personality Psychology, pp. 286–312. Cambridge University Press, Cambridge (2000)

    Google Scholar 

  48. Lapassade, G.: L’observation participante. In: Hess, R., Gabriele, W. (eds.) L’observation participante. Paris. ECONOMICA, Anthropos (2006)

    Google Scholar 

  49. Hall, G.: Recent developments in uses of literature in language teaching. In: Teranishi, M., Saito, Y., Wales, K. (eds.) Literature and Language Learning in the EFL Classroom, pp. 13–25. Palgrave Macmillan, London (2015). https://doi.org/10.1057/9781137443663_2

    Chapter  Google Scholar 

  50. Calvo-Ferrer, J.R.: Educational games as stand-alone learning tools and their motivational effect on L2 vocabulary acquisition and perceived learning gains. Br. J. Edu. Technol. 48(2), 264–278 (2017)

    Article  Google Scholar 

  51. Ragatz, C. M.: Playing vocabulary games and learning academic language with gifted elementary students (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses Global. (Order No. 3689691) (2015)

    Google Scholar 

  52. Taheri, M.: The effect of using language games on vocabulary retention of Iranian elementary EFL learners. J. Lang. Teach. Res. 5(3), 544–549 (2014). https://doi.org/10.4304/jltr.5.3.544-549

    Article  Google Scholar 

  53. Casañ-Pitarch, R.: Gamifying content and language integrated learning with serious video-games. J. Lang. Educ. 3(3), 107–114 (2017)

    Article  Google Scholar 

  54. Vidakis, N., Barianos, A.K., Trampas, A.M., Papadakis, S., Kalogiannakis, M., Vassilakis, K.: Generating education in-game data: the case of an ancient theatre serious game. In: Proceedings of the 11th International Conference on Computer Supported Education, CSEDU 2019, vol. 1, pp. 36–43 (2019)

    Google Scholar 

  55. Vidakis, N., Syntychakis, E., Kalafatis, K., Christinaki, E., Triantafyllidis, G.: Ludic educational game creation tool: teaching schoolers road safety. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9177, pp. 565–576. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20684-4_55

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Hellenic Mediterranean University, Heraklion, Crete, Greece

    Ilias Logothetis, George Papadourakis, Iraklis Katsaris, Konstantinos Katsios & Nikolas Vidakis

Authors
  1. Ilias Logothetis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. George Papadourakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Iraklis Katsaris
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Konstantinos Katsios
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Nikolas Vidakis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nikolas Vidakis .

Editor information

Editors and Affiliations

  1. Department of Multimedia and Graphic Arts, Cyprus University of Technology, Lemesos, Cyprus

    Panayiotis Zaphiris

  2. Research Center on Interactive Media, Smart Systems and Emerging Technologies (CYENS), Cyprus University of Technology, Limassol, Cyprus

    Andri Ioannou

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Logothetis, I., Papadourakis, G., Katsaris, I., Katsios, K., Vidakis, N. (2021). Transforming Classic Learning Games with the Use of AR: The Case of the Word Hangman Game. In: Zaphiris, P., Ioannou, A. (eds) Learning and Collaboration Technologies: Games and Virtual Environments for Learning. HCII 2021. Lecture Notes in Computer Science(), vol 12785. Springer, Cham. https://doi.org/10.1007/978-3-030-77943-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77943-6_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77942-9

  • Online ISBN: 978-3-030-77943-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation