research-article

Virtual memory palaces: immersion aids recall

Authors:

Catherine Plaisant,

Amitabh VarshneyAuthors Info & Claims

Virtual Reality, Volume 23, Issue 1

Pages 1 - 15

https://doi.org/10.1007/s10055-018-0346-3

Published: 05 March 2019 Publication History

Abstract

Virtual reality displays, such as head-mounted displays (HMD), afford us a superior spatial awareness by leveraging our vestibular and proprioceptive senses, as compared to traditional desktop displays. Since classical times, people have used memory palaces as a spatial mnemonic to help remember information by organizing it spatially and associating it with salient features in that environment. In this paper, we explore whether using virtual memory palaces in a head-mounted display with head-tracking (HMD condition) would allow a user to better recall information than when using a traditional desktop display with a mouse-based interaction (desktop condition). We found that virtual memory palaces in HMD condition provide a superior memory recall ability compared to the desktop condition. We believe this is a first step in using virtual environments for creating more memorable experiences that enhance productivity through better recall of large amounts of information organized using the idea of virtual memory palaces.

References

[1]

3DMarko (2011) Medieval town 01 Dubrovnik. https://www.turbosquid.com/FullPreview/Index.cfm/ID/632415. Retrieved 10 May 2018

[2]

3DMarko (2014) Palace interior 02. https://www.turbosquid.com/FullPreview/Index.cfm/ID/809577. Retrieved 10 May 2018

[3]

Atkinson RC and Shiffrin RM Human memory: a proposed system and its control processes Psychol Learn Motiv 1968 2 89-195

[4]

Baddeley AD and Hitch G Working memory Psychol Learn Motiv 1974 8 47-89

[5]

Barry C, Lever C, Hayman R, Hartley T, Burton S, O’Keefe J, Jeffery K, and Burgess N The boundary vector cell model of place cell firing and spatial memory Rev Neurosci 2006 17 1–2 71-98

[6]

Barsalou LW Grounded cognition Annu Rev Psychol 2008 59 617-645

[7]

Baumann O and Mattingley JB Medial parietal cortex encodes perceived heading direction in humans J Neurosci 2010 30 39 12,897-12,901

[8]

Bowman DA and McMahan RP Virtual reality: how much immersion is enough? Computer 2007 40 7 36-43

[9]

Brooks BM The specificity of memory enhancement during interaction with a virtual environment Memory 1999 7 1 65-78

[10]

Brooks FP Jr, Airey J, Alspaugh J, Bell A, Brown R, Hill C, Nimscheck U, Rheingans P, Rohlf J, Smith D, Turner D, Varshney A, Wang Y, Weber H, Yuan X (1992) Six generations of building walkthrough: final technical report to the National Science Foundation TR92-026, Department of Computer Science. University of North Carolina at Chapel Hill

[11]

Brown MW and Aggleton JP Recognition memory: what are the roles of the perirhinal cortex and hippocampus? Nat Rev Neurosci 2001 2 1 51-61

[12]

Burgess N Spatial cognition and the brain Ann N Y Acad Sci 2008 1124 1 77-97

[13]

Buzsáki G and Moser EI Memory, navigation and theta rhythm in the hippocampal-entorhinal system Nat Neurosci 2013 16 2 130-138

[14]

Ekstrom AD, Kahana MJ, Caplan JB, Fields TA, Isham EA, Newman EL, and Fried I Cellular networks underlying human spatial navigation Nature 2003 425 6954 184-188

[15]

Fassbender E and Heiden W The virtual memory palace J Comput Inf Syst 2006 2 1 457-464

[16]

Gardner H Multiple intelligences: new horizons 2006 New York Basic books

[17]

Godden DR and Baddeley AD Context-dependent memory in two natural environments: on land and underwater Br J Psychol 1975 66 3 325-331

[18]

Godwin-Jones R Emerging technologies from memory palaces to spacing algorithms: approaches to second-language vocabulary learning Lang Learn Technol 2010 14 2 4

[19]

Harman J (2001) Creating a memory palace using a computer. In: CHI ’01 extended abstracts on human factors in computing systems, pp 407–408

[20]

Harman J, Brown R, Johnson D (2017) Improved memory elicitation in virtual reality: new experimental results and insights. In: IFIP conference on human–computer interaction, Springer, pp 128–146

[21]

Harris JE Memory aids people use: two interview studies Mem Cogn 1980 8 1 31-38

[22]

Hartley T, Lever C, Burgess N, and O’Keefe J Space in the brain: how the hippocampal formation supports spatial cognition Philos Trans R Soc B 2014 369 1635 20120,510

[23]

Hok V, Save E, Lenck-Santini P, and Poucet B Coding for spatial goals in the prelimbic/infralimbic area of the rat frontal cortex Proc Natl Acad Sci USA 2005 102 12 4602-4607

[24]

Julian J The origin of consciousness in the breakdown of the bicameral mind 1976 Milan The Adelphi

[25]

Kim Y, Varshney A, Jacobs DW, and Guimbretière F Mesh saliency and human eye fixations ACM Trans Appl Percept (TAP) 2010 7 2 12

[26]

Kim J, Delcasso S, and Lee I Neural correlates of object-in-place learning in hippocampus and prefrontal cortex J Neurosci 2011 31 47 16,991-17,006

[27]

Knauff M Space to reason: a spatial theory of human thought 2013 Cambridge MIT Press

[28]

Legge EL, Madan CR, Ng ET, and Caplan JB Building a memory palace in minutes: equivalent memory performance using virtual versus conventional environments with the method of loci Acta Psychol 2012 141 3 380-390

[29]

Leutgeb S, Leutgeb JK, Moser MB, and Moser EI Place cells, spatial maps and the population code for memory Curr Opin Neurobiol 2005 15 6 738-746

[30]

Lever C, Burton S, Jeewajee A, O’Keefe J, and Burgess N Boundary vector cells in the subiculum of the hippocampal formation J Neurosci 2009 29 31 9771-9777

[31]

Loomis JM, Blascovich JJ, and Beall AC Immersive virtual environment technology as a basic research tool in psychology Behav Res Methods Instrum Comput 1999 31 4 557-564

[32]

Madl T, Chen K, Montaldi D, and Trappl R Computational cognitive models of spatial memory in navigation space: a review Neural Netw 2015 65 18-43

[33]

Mania K and Chalmers A The effects of levels of immersion on memory and presence in virtual environments: a reality centered approach CyberPsychol Behav 2001 4 2 247-264

[34]

Mania K, Troscianko T, Hawkes R, and Chalmers A Fidelity metrics for virtual environment simulations based on spatial memory awareness states Presence Teleoper Virtual Environ 2003 12 3 296-310

[35]

Mayer JD, Salovey P, Caruso DR, and Sitarenios G Emotional intelligence as a standard intelligence Emotion 2001 1 3 232-242

[36]

McCabe JA Location, location, location! Demonstrating the mnemonic benefit of the method of loci Teach Psychol 2015 42 2 169-173

[37]

Miller GA The magical number seven, plus or minus two: some limits on our capacity for processing information Psychol Rev 1956 63 2 81

[38]

Moser EI, Kropff E, and Moser MB Place cells, grid cells, and the brain’s spatial representation system Annu Rev Neurosci 2008 31 69-89

[39]

O’Regan JK and Noë A A sensorimotor account of vision and visual consciousness Behav Brain Sci 2001 24 5 939-973

[40]

Parsons TD Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences Front Hum Neurosci 2015 9 660

[41]

Pausch R, Proffitt D, Williams G (1997) Quantifying immersion in virtual reality. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques, SIGGRAPH ’97, pp 13–18

[42]

Perrault ST, Lecolinet E, Bourse YP, Zhao S, Guiard Y (2015) Physical loci: leveraging spatial, object and semantic memory for command selection. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, CHI ’15, pp 299–308

[43]

Ragan ED, Sowndararajan A, Kopper R, and Bowman DA The effects of higher levels of immersion on procedure memorization performance and implications for educational virtual environments Presence Teleoper Virtual Environ 2010 19 6 527-543

[44]

Repetto C, Serino S, Macedonia M, and Riva G Virtual reality as an embodied tool to enhance episodic memory in elderly Front Psychol 2016 7 1839:1-1839:4

[45]

Richardson AE, Montello DR, and Hegarty M Spatial knowledge acquisition from maps and from navigation in real and virtual environments Mem Cognit 1999 27 4 741-750

[46]

Roediger HL Implicit and explicit memory models Bull Psychon Soc 1979 13 6 339-342

[47]

Ruddle RA, Payne SJ, and Jones DM Navigating large-scale virtual environments: what differences occur between helmet-mounted and desktop displays? Presence Teleoper Virtual Environ 1999 8 2 157-168

[48]

Sanchez-Vives MV and Slater M From presence to consciousness through virtual reality Nat Rev Neurosci 2005 6 4 332-339

[49]

Shapiro L Embodied cognition 2010 New York Routledge

[50]

Skarbez R, Brooks FP Jr, and Whitton MC A survey of presence and related concepts ACM Comput Surv 2017 50 6 96:1-96:39

[51]

Slater M Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments Philos Trans R Soc Lond B Biol Sci 2009 364 1535 3549-3557

[52]

Sowndararajan A, Wang R, Bowman DA (2008) Quantifying the benefits of immersion for procedural training. In: Proceedings of the 2008 workshop on immersive projection technologies/emerging display technologies, IPT/EDT ’08, pp 2:1–2:4

[53]

Wraga M, Creem-Regehr SH, and Proffitt DR Spatial updating of virtual displays Mem Cognit 2004 32 3 399-415

[54]

Yates FA The art of memory 1992 New York Random House

Cited By

Siqueira Rodrigues LSchmidt TNyakatura JZachow SIsrael JKosch T(2024)Assessing the Effects of Sensory Modality Conditions on Object Retention across Virtual Reality and Projected Surface Display EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/36981378:ISS(255-282)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698137
Li XHe WJin SGugenheimer JHui PLiang HKristensson P(2024)Investigating Creation Perspectives and Icon Placement Preferences for On-Body Menus in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981368:ISS(236-254)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698136
Bampouni EAhmad AXi NLegaki NHamari J(2024)Effects of Immersion and Embodiment on Memory in Virtual RealityProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3681724(58-67)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3681724
Show More Cited By

Index Terms

Virtual memory palaces: immersion aids recall
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Index terms have been assigned to the content through auto-classification.

Recommendations

Spatial Mnemonics using Virtual Reality
ICCAE 2018: Proceedings of the 2018 10th International Conference on Computer and Automation Engineering

Virtual reality displays, such as head-mounted displays (HMD) can provide superior spatial awareness by leveraging the vestibular and proprioceptive senses. Since the classical times, people have used memory palaces as a spatial mnemonic to help ...
Quantifying VR cybersickness using EEG
Abstract
Current techniques for characterizing cybersickness (visually induced motion sickness) in virtual environments rely on qualitative questionnaires. For interactive graphics to create visual experiences that enhance the illusion of presence while ...
Immersion, presence and performance in virtual environments: an experiment with tri-dimensional chess
VRST '96: Proceedings of the ACM Symposium on Virtual Reality Software and Technology

This paper describes an experiment to assess the influence of immersion on performance in immersive virtual environments. The task involved Tri-Dimensional Chess, and required subjects to reproduce on a real chess board the state of board learned from a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Virtual Reality

Virtual Reality Volume 23, Issue 1

Mar 2019

115 pages

ISSN:1359-4338

EISSN:1434-9957

Issue’s Table of Contents

© The Author(s) 2018.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 05 March 2019

Accepted: 03 May 2018

Received: 21 October 2016

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

69
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Siqueira Rodrigues LSchmidt TNyakatura JZachow SIsrael JKosch T(2024)Assessing the Effects of Sensory Modality Conditions on Object Retention across Virtual Reality and Projected Surface Display EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/36981378:ISS(255-282)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698137
Li XHe WJin SGugenheimer JHui PLiang HKristensson P(2024)Investigating Creation Perspectives and Icon Placement Preferences for On-Body Menus in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981368:ISS(236-254)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698136
Bampouni EAhmad AXi NLegaki NHamari J(2024)Effects of Immersion and Embodiment on Memory in Virtual RealityProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3681724(58-67)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3681724
Siqueira Rodrigues LSchmidt TIsrael JZachow SNyakatura JKosch T(2024)Comparing the Effects of Visual, Haptic, and Visuohaptic Encoding on Memory Retention of Digital Objects in Virtual RealityProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685349(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685349
Jubran OMonaco EMuntini LLachmann T(2024)The "bizarre" object effect in Virtual Reality: A comparative serial recall studyProceedings of the European Conference on Cognitive Ergonomics 202410.1145/3673805.3673806(1-7)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3673805.3673806
Bito KIshiguro YTakeda K(2024)Evaluation of a Virtual Experience System for RestaurantsProceedings of the 29th International ACM Conference on 3D Web Technology10.1145/3665318.3677164(1-10)Online publication date: 25-Sep-2024
https://dl.acm.org/doi/10.1145/3665318.3677164
Daeijavad P(2024)Investigating the Impact of Multiple View Layouts on Users' Visual Task Performance in Extended RealityProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656756(1-3)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656756
Numan NRajaram SKumaravel BMarquardt NWilson A(2024)SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene BlendingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676361(1-25)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676361
Salehi PHassan SBaugerud GPowell MCano MJohnson MRøed RJohansen DSabet SRiegler MHalvorsen P(2024)Immersive Virtual Reality in Child Interview Skills TrainingProceedings of the 16th International Workshop on Immersive Mixed and Virtual Environment Systems10.1145/3652212.3652219(1-7)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3652212.3652219
Medlar ALehtikari MGlowacka D(2024)Behind the Scenes: Adapting Cinematography and Editing Concepts to Navigation in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642412(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642412
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents