The Design of an Experiment to Evaluate the Effect of Spatial Sound on Memory Recall in a Virtual Reality Learning Environment
Article No.: 5, Pages 1 - 5
Abstract
With the widespread availability of affordable consumer devices, Virtual Reality is fast becoming a valid solution for enabling accessible and immersive teaching and learning experiences. VR presents many educational opportunities but there are still aspects that need further investigation, one being the utilisation of sound within VR, and the effect it has on memory recall. In the context of the online learning, this paper outlines a planned experiment design to investigate the relationship between spatial sound used within an online Virtual Reality Learning Environment (VRLE) and its effect on immediate memory recall. The experiment uses an immersive, web-based platform exploiting the WebXR application programming interface, and built using Three.js and Resonance Audio JavaScript libraries. Using different audio conditions, an adapted Logic Memory test, in-VR questionnaires, and both between-group and within-group analysis, the goal of the experiment is to examine the effect of spatial audio on immediate memory recall, when compared to non-spatial audio.
References
[1]
Jessica J. Baldis. 2001. Effects of Spatial Audio on Memory, Comprehension, and Preference During Desktop Conferences. In Proceedings of the SIGCHI conference on Human factors in computing systems. 166–173.
[2]
Mary Jean Bishop and Ward Mitchell Cates. 2001. A Framework for Researching Sound’s Use in Multimedia Instruction To Enhance Learning. (April 2001). https://eric.ed.gov/?id=ED453243
[3]
Hongchan Choi. 2018. Audioworklet: The Future of Web Audio. In ICMC.
[4]
Barney Dalgarno and Mark JW Lee. 2010. What Are the Learning Affordances of 3-D Virtual Environments?British Journal of Educational Technology 41, 1 (2010), 10–32. Publisher: Wiley Online Library.
[5]
Christian Dibbern, Manuela Uhr, Dennis Krupke, and Frank Steinicke. 2018. Can WebVR Further the Adoption of Virtual Reality?Mensch und computer 2018-usability professionals (2018). Publisher: Gesellschaft für Informatik eV Und German UPA eV.
[6]
Jos Dirksen. 2013. Learning Three.js: The JavaScript 3D Library for WebGL. Packt Publishing Ltd.
[7]
Moria Engberg, Jay David Bolter, and Blair Maclntyre. 2018. RealityMedia: An Experimental Digital Book in WebXR. In 2018 IEEE international symposium on mixed and augmented reality adjunct (ISMAR-Adjunct). IEEE, 324–327.
[8]
Bruno Fanini, Daniele Ferdani, and Emanuel Demetrescu. 2021. Temporal Lensing: An Interactive and Scalable Technique for Web3D/WebXR Applications in Cultural Heritage. Heritage 4, 2 (2021), 710–724. Publisher: Multidisciplinary Digital Publishing Institute.
[9]
Michael A. Gerzon. 1973. Periphony: With-Height Sound Reproduction. Journal of the audio engineering society 21, 1 (1973), 2–10. Publisher: Audio Engineering Society.
[10]
Jari Kleimola and Oliver Larkin. 2015. Web Audio Modules. In Proc. 12th Sound and Music Computing Conference.
[11]
Oliver Larkin, Alex Harker, and Jari Kleimola. 2018. iPlug 2: Desktop Plug-in Framework Meets Web Audio Modules. In Proceedings of the 4th Web Audio Conference.
[12]
Blair Maclntyre and Trevor F. Smith. 2018. Thoughts on the Future of WebXR and the Immersive Web. In 2018 IEEE international symposium on mixed and augmented reality adjunct (ISMAR-Adjunct). IEEE, 338–342.
[13]
David G. Malham and Anthony Myatt. 1995. 3-D Sound Spatialization Using Ambisonic Techniques. Computer Music Journal 19, 4 (1995), 58–70. https://doi.org/10.2307/3680991 Publisher: The MIT Press.
[14]
Tony Parisi. 2012. WebGL: Up and Running. ” O’Reilly Media, Inc.”.
[15]
Susanne Putze, Dmitry Alexandrovsky, Felix Putze, Sebastian Höffner, Jan David Smeddinck, and Rainer Malaka. 2020. Breaking The Experience: Effects of Questionnaires in VR User Studies. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376144
[16]
Laura A. Rabin, Emily Paolillo, and William B. Barr. 2016. Stability in Test-Usage Practices of Clinical Neuropsychologists in the United States and Canada Over a 10-Year Period: A Follow-Up Survey of INS and NAN Members. Archives of Clinical Neuropsychology 31, 3 (May 2016), 206–230. https://doi.org/10.1093/arclin/acw007
[17]
Fabio Cortés Rodríguez, Matteo Dal Peraro, and Luciano A. Abriata. 2021. Democratizing Interactive, Immersive Experiences for Science Education with WebXR. Nature Computational Science 1, 10 (2021), 631–632. Publisher: Nature Publishing Group.
[18]
Saeed Safikhani, Michael Holly, Alexander Kainz, and Johanna Pirker. 2021. The Influence of in-VR Questionnaire Design on the User Experience. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology(VRST ’21). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3489849.3489884
[19]
Mel Slater. 2004. How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments. Presence 13, 4 (2004), 484–493. Publisher: MIT Press.
[20]
Mel Slater, Andrea Brogni, and Anthony Steed. 2003. Physiological Responses to Breaks in Presence: A Pilot Study. In Presence 2003: The 6th annual international workshop on presence, Vol. 157. Citeseer.
[21]
Boris Smus. 2013. Web Audio API: Advanced Sound for Games and Interactive Apps. ” O’Reilly Media, Inc.”.
[22]
Karen Sullivan. 2005. Alternate Forms of Prose Passages for the Assessment of Auditory–Verbal Memory. Archives of Clinical Neuropsychology 20, 6 (Aug. 2005), 745–753. https://doi.org/10.1016/j.acn.2005.04.006
[23]
David Wechsler. 2009. WMS-IV: Wechsler Memory Scale. Pearson.
[24]
Wen Zhang, Parasanga N. Samarasinghe, Hanchi Chen, and Thushara D. Abhayapala. 2017. Surround by Sound: A Review of Spatial Audio Recording and Reproduction. Applied Sciences 7, 5 (2017), 532. Publisher: Multidisciplinary Digital Publishing Institute.
Index Terms
- The Design of an Experiment to Evaluate the Effect of Spatial Sound on Memory Recall in a Virtual Reality Learning Environment
Recommendations
Thinning trainer based on forest-growth model, virtual reality and computer-aided virtual environment
Immersive virtual reality is applied in many human activities. This virtual reality can be used as a training tool for thinning operations in forests. The aim of this study is to describe the complex solution of Thinning Trainer, that we developed. This ...
Spatial sound localization in an augmented reality environment
OZCHI '06: Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and EnvironmentsAugmented Reality (AR), the overlay of virtual images onto the real world, is an increasingly popular technique for developing new human-computer interfaces. As human navigation and orientation in different environments depend on both visual and ...
Virtual learning environment for medical education based on VRML and VTK
Virtual reality (VR) is being applied to a wide range of medical areas, including medical education/training, surgery and diagnostics assistance. In the medical education field, VR opens new realms in the teaching of medicine and creates new effective ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2022
183 pages
ISBN:9781450398084
DOI:10.1145/3552327
Copyright © 2022 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 October 2022
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
ECCE 2022
ECCE 2022: 33rd European Conference on Cognitive Ergonomics
October 4 - 7, 2022
Kaiserslautern, Germany
Acceptance Rates
Overall Acceptance Rate 56 of 91 submissions, 62%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 607Total Downloads
- Downloads (Last 12 months)287
- Downloads (Last 6 weeks)30
Reflects downloads up to 16 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in