Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Enhancing human indoor cognitive map development and wayfinding performance with immersive augmented reality-based navigation systems

Published: 01 October 2021 Publication History

Abstract

Augmented reality (AR) is an interactive experience where computer-generated perceptual information is superimposed into the real-world environment. Most existing research in AR-based wayfinding has focused on the technological aspects of developing AR-based software or devices to realize navigation. No previous investigations have focused on understanding the impact of immersive augmented reality (IAR)–based systems on human wayfinding performance from the cognitive perspective. Aimed at investigating the influence of IAR-based systems on people’s cognitive map development and their subsequent wayfinding performance as well as the effect of using three-dimensional (3D) layout models in IAR environments in addition to superimposed guideposts, an experiment was carried out in a building with a complex floor plan. A total of 54 university students were evenly divided into three groups: a control group with no IAR assistance, a second group using an IAR-based navigation system that includes only superimposed guideposts, and a third group using an IAR-based navigation system that includes both guideposts and a 3D layout model. Each participant was asked to conduct a spatial exploration task in the environment, sketch a floor map based on their spatial cognition, and perform a wayfinding task to find eight specific locations in the building. An analysis of the participants’ performance and responses to a number of self-evaluation questionnaires collected in the experiment indicates that IAR technology can help people develop their cognitive maps more effectively and can substantially improve their wayfinding performance with a much lower workload. A second finding is that adding a 3D layout model can enhance the effect of an IAR-based navigation system in terms of cognitive map development. The findings from this research extend the existing knowledge about IAR-based navigation and further verify that AR technology has the potential to reduce human workload for cognitive tasks. The results also could support its more effective application in various scenarios that require assisted wayfinding and cognitive map training, such as emergency evacuation drills.

References

[1]
Conroy, R., Spatial navigation in immersive virtual environments. Unpublished doctoral dissertation, University of London, 2001.
[2]
J. Carpman, M.A. Grant, Design that Cares: Planning Health Facilities for Patients and Visitors, American Hospital Publishing Inc., Chicago, Ill, 1993.
[3]
B. Jiang, C. Claramunt, Integration of space syntax into GIS: New perspectives for urban morphology, Transactions in GIS 6 (3) (2002) 295–309.
[4]
J.R. Carpman, M.A. Grant, Wayfinding: A broad view, in: R.B. Bechtel, A. Churchman (Eds.), Handbook of Environmental Psychology, 1st Edition, Wiley & Sons, New York, 2002, pp. 427–442.
[5]
E. Vilar, F. Rebelo, P. Noriega, Indoor human wayfinding performance using vertical and horizontal signage in virtual reality, Hum. Factors Ergon. Manuf. Serv. Ind. 24 (6) (2014) 601–615.
[6]
J.L. Nasar, Environmental factors, perceived distance and spatial behavior, Environ. Plan. B Plan. Des. 10 (3) (1983) 275–281.
[7]
J. Weisman, Evaluating architectural legibility: Way-finding in the built environment, Environ. Behav. 13 (2) (1981) 189–204.
[8]
E. Cubukcu, J.L. Nasar, Relation of physical form to spatial knowledge in largescale virtual environments, Environ. Behav. 37 (3) (2005) 397–417.
[9]
E. Cubukcu, J.L. Nasar, L, Influence of physical characteristics of routes on distance cognition in virtual environments, Environ. Plan. B Plan. Des. 32 (5) (2005) 777–785.
[10]
C.A. Lawton, J. Kallai, Gender differences in wayfinding strategies and anxiety about wayfinding: A cross-cultural comparison, Sex Roles 47 (9–10) (2002) 389–401.
[11]
Blackman, T., P.V. Schaik, and A. Martyr, Outdoor environments for people with dementia: An exploratory study using virtual reality. Ageing and Society, 2007. 27(6): 811–825.
[12]
J. Lin, L. Cao, N. Li, Assessing the influence of repeated exposures and mental stress on human wayfinding performance in indoor environments using virtual reality technology, Adv. Eng. Inf. 39 (2019) 53–61.
[13]
R.M. Kitchin, Cognitive maps: What are they and why study them?, J. Environ. Psychol. 14 (1) (1994) 1–19.
[14]
J.L. Chen, K.M. Stanney, A theoretical model of wayfinding in virtual environments: Proposed strategies for navigational aiding, Presence 8 (6) (1999) 671–685.
[15]
R.G. Golledge, Wayfinding Behavior: Cognitive Mapping and other Spatial Processes, Johns Hopkins University Press, Baltimore, 1999.
[16]
E.C. Tolman, Cognitive maps in rats and men, Psychol. Rev. 55 (4) (1948) 189–208.
[17]
R.G. Golledge, R.D. Jacobson, R. Kitchin, M. Blades, Cognitive maps, spatial abilities, and human wayfinding, Geographical Review of Japan, Series B. 73 (2) (2000) 93–104.
[18]
C. Ellard, You Are Here: Why We Can Find Our Way to the Moon, but Get Lost in the Mall, Knopf Doubleday Publishing Group, New York, 2009.
[19]
H. Huang, G. Gartner, J.M. Krisp, M. Raubal, N. Van de Weghe, Location based services: Ongoing evolution and research agenda, J. Location Based Serv. 12 (2) (2018) 63–93.
[20]
Furukawa, H., C.L. Baldwin, and E.M. Carpenter, supporting drivers' cognitive map construction with visual geo-centered and auditory ego-centered guidance: Interference or improved performance? In: Human Performance, Situation Awareness and Automation: Current Research and Trends, Vol. II. D.A. Vincenzi, M. Mouloua, and P.A. Hancock (eds.). New York: Psychology Press, 2004: 124–129.
[21]
Cope, J., et al., Firefighters’ strategies for processing spatial information during emergency rescue searches. In: Information in Contemporary Society. N. Taylor, C. Christian-Lamb, M. Martin, B. Nardi (eds.) iConference 2019. Lecture Notes in Computer Science, 11420.2019: 699–705.
[22]
T. Ishikawa, H. Fujiwara, O. Imai, A. Okabe, Wayfinding with a GPS-based mobile navigation system: A comparison with maps and direct experience, J. Environ. Psychol. 28 (1) (2008) 74–82.
[23]
S. Munzer, H.D. Zimmer, J. Baus, Navigation assistance: A trade-off between wayfinding support and configural learning support, J. Experim. Psychol. Appl. 18 (1) (2012) 18–37.
[24]
S. Münzer, H.D. Zimmer, M. Schwalm, J. Baus, I. Aslan, Computer-assisted navigation and the acquisition of route and survey knowledge, J. Environ. Psychol. 26 (4) (2006) 300–308.
[25]
K.S. Willis, C. Hölscher, G. Wilbertz, C. Li, A comparison of spatial knowledge acquisition with maps and mobile maps, Comput. Environ. Urban Syst. 33 (2) (2009) 100–110.
[26]
C.-H. Chen, W.-C. Chang, W.-T. Chang, Gender differences in relation to wayfinding strategies, navigational support design, and wayfinding task difficulty, J. Environ. Psychol. 29 (2) (2009) 220–226.
[27]
A.S. Nossum, Indoor tubes a novel design for indoor maps, Cartography Geograph. Inf. Sci. 38 (2) (2011) 192–200.
[28]
Chittaro, L. and S. Venkataraman, Navigation aids for multi-floor virtual buildings: A comparative evaluation of two approaches. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST 2006, Limassol, Cyprus, November 2006.
[29]
Li, H. and N.A. Giudice, The effects of 2D and 3D maps on learning virtual multi-level indoor environments. In: Proceedings of the 1st ACM SIGSPATIAL International Workshop on MapInteraction - MapInteract '13. November 2013: 7–12.
[30]
J.M. Davila Delgado, L. Oyedele, P. Demian, T. Beach, A research agenda for augmented and virtual reality in architecture, engineering and construction, Adv. Eng. Inf. 45 (2020) 101122,.
[31]
Gruenefeld, U., et al., Visualizing out-of-view objects in head-mounted augmented reality. In: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. 2017. 81: 1–7.
[32]
Schankin, A., et al., [POSTER] The impact of the frame of reference on attention shifts between augmented reality and real-world environment, In: 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct). 2017: 25–30.
[33]
Nicolas Wenk, et al., Reaching in several realities: Motor and cognitive benefits of different visualization technologies. In: 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR). 24–28 June 2019 :1037–1042.
[34]
Weng, N.G. and A.L.L. Sing, Perception and skill learning for augmented and virtual reality learning environments. In: Computational Science and Technology, R. Alfred, Y. Lim, A. Ibrahim, P. Anthony (eds). Lecture Notes in Electrical Engineering, 2019. 481: 391–400.
[35]
R. McKendrick, R. Parasuraman, R. Murtza, A. Formwalt, W. Baccus, M. Paczynski, H. Ayaz, Into the wild: Neuroergonomic differentiation of hand-held and augmented reality wearable displays during outdoor navigation with functional near infrared spectroscopy, Front. Hum. Neurosci. 10 (2016),.
[36]
Liu, K.X., G. Motta, and T.Y. Ma, XYZ indoor navigation through augmented reality: a research in progress. In: Proceedings 2016 IEEE International Conference on Services Computing, J. Zhang, J.A. Miller, and X. Xu (eds.). 27 June–2 July, 2016: 299–306.
[37]
M.J. Kim, X. Wang, S. Han, Y. Wang, Implementing an augmented reality-enabled wayfinding system through studying user experience and requirements in complex environments, Visualization Eng. 3 (1) (2015),.
[38]
Ahn, J. and R. Han. RescueMe: An indoor mobile augmented-reality evacuation system by personalized pedometry. In: 2011 IEEE Asia-Pacific Services Computing Conference. 12–15 December 2011, Jeju, Korea (South).
[39]
S.-H. Lee, E.-J. Song, A study on application of virtual augmented reality technology for rescue in case of fire disaster, J. Digit. Contents Soc. 20 (1) (2019) 59–64.
[40]
Sharma, S. and S. Jerripothula, An indoor augmented reality mobile application for simulation of building evacuation. In: Proc. SPIE 9392, The Engineering Reality Of Virtual Reality 2015, M. Dolinsky and I.E. McDowall (eds.). 2015, 939208.
[41]
Mulloni, A., H. Seichter, and D. Schmalstieg. Handheld augmented reality indoor navigation with activity-based instructions. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. Aug 30–Sept 2, 2011, Stockholm, Sweden.
[42]
Stigall, J., et al. Building evacuation using microsoft HoloLens. In: Proc. of 27th International Conference on Software Engineering and Data Engineering, New Orleans, La., 8–10 October 2018.
[43]
Chen, M.-C. and J.-M. Wang, Mobile augmented reality based lost-prevention system. DEStech Transactions on Engineering and Technology Research, 2016(imeia).
[44]
Y.H. Yu, Study on intelligent augmented reality tourist guide application based on android smart phone, in: W. Ge (Ed.), Mechanical Components and Control Engineering III, Trans Tech Publications Ltd., Stafa-Zurich, 2014, pp. 1399–1402.
[45]
C.C. Smith, D.F. Cihak, B. Kim, D.D. McMahon, R. Wright, Examining augmented reality to improve navigation skills in postsecondary students with intellectual disability, J. Special Educ. Technol. 32 (1) (2017) 3–11.
[46]
Y.A. Sekhavat, J. Parsons, The effect of tracking technique on the quality of user experience for augmented reality mobile navigation, Multimedia Tools Appl. 77 (10) (2018) 11635–11668.
[47]
Mulloni, A., et al., User experiences with augmented reality aided navigation on phones, In: 10th IEEE International Symposium on Mixed And Augmented Reality. Basel, Switzerland, 26–29 October 2011.
[48]
M. Hegarty, et al., Development of a self-report measure of environmental spatial ability, Intelligence 30 (5) (2002) 425–447.
[49]
M.J. Rovine, G.D. Weisman, Sketch-map variables as predictors of way-finding performance, J. Environ. Psychol. 9 (3) (1989) 217–232.
[50]
F. Paas, J.E. Tuovinen, H. Tabbers, P.W.M. Van Gerven, Cognitive Load Measurement as a Means to Advance Cognitive Load Theory, Educational Psychologist 38 (1) (2003) 63–71.
[51]
S. Kalyuga, P. Chandler, J. Tuovinen, J. Sweller, When problem solving is superior to studying worked examples, J. Educ. Psychol. 93 (3) (2001) 579–588.
[52]
P.W.M. van Gerven, F. Paas, J.J.G. van Merriënboer, H.G. Schmidt, Modality and variability as factors in training the elderly, Appl. Cogn. Psychol. 20 (3) (2006) 311–320.
[53]
G. Taylor, A., Develop Microsoft HoloLens Apps Now. 1st Edition. Berkeley, Calif.: Apress Media LLC. 2016.
[54]
Derakhshani D, D.R.L., Autodesk 3ds Max 2013 Essentials. Hoboken, New Jersey: John Wiley & Sons, 2012.
[55]
PTC. Vuforia Engine Library. 2011. Available at: https://library.vuforia.com/. Accessed on 2021.05.15.
[56]
L. Sun, S.M. Frank, R.A. Epstein, P.U. Tse, The parahippocampal place area and hippocampus encode the spatial significance of landmark objects, Neuroimage 236 (2021) 118081,.
[57]
S.G. Hart, L.E. Staveland, Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research, Adv. Psychol. 52 (1988) 139–183.
[58]
J. Lin, L. Cao, N. Li, How the completeness of spatial knowledge influences the evacuation behavior of passengers in metro stations: A VR-based experimental study, Autom. Constr. 113 (2020) 103136,.
[59]
S.D. Moeser, Cognitive mapping in a complex building, Environ. Behav. 20 (1) (1988) 21–49.
[60]
T. Jokela, et al., The standard of user-centered design and the standard definition of usability: analyzing ISO 13407 against ISO 9241–11, In: Proceedings of the Latin American Conference on Human-Computer Interaction , 2003.
[61]
M.J. O'Neill, Effects of familiarity and plan complexity on wayfinding in simulated buildings, J. Environ. Psychol. 12 (4) (1992) 319–327.
[62]
G.W. Evans, J. Fellows, M. Zorn, K. Doty, Cognitive mapping and architecture, J. Appl. Psychol. 65 (4) (1980) 474–478.
[63]
M. Blades, The reliability of data collected from sketch maps, J. Environ. Psychol. 10 (4) (1990) 327–339.
[64]
B.G. Witmer, J.H. Bailey, B.W. Knerr, K.C. Parsons, Virtual spaces and real world places: Transfer of route knowledge, Int. J. Hum Comput Stud. 45 (4) (1996) 413–428.
[65]
R.A. Ruddle, S.J. Payne, D.M. Jones, Navigating buildings in “desk-top” virtual environments: Experimental investigations using extended navigational experience, J. Experim. Psychol. Appl. 3 (2) (1997) 143–159.
[66]
M.J. O'Neill, Evaluation of a conceptual model of architectural legibility, Environ. Behav. 23 (3) (1991) 259–284.
[67]
Montello, D.R., A new framework for understanding the acquisition of spatial knowledge in large-scale environments. In: Spatial and Temporal Reasoning in Geographic Information Systems. I.M.J. Egenhofer and R.G. Golledge, eds. New York: Oxford University Press, 1998.
[68]
R.G. Golledge, Cognition of physical and built environments, in: I.T. Gärling, G.W. Evans (Eds.), Environment, Cognition, and Action: An Integrated Approach, Oxford University Press, New York, 1991.
[69]
J.F. Herman, S.L. Blomquist, C.A. Klein, Children's and adults' cognitive maps of very large unfamiliar environments, British J. Developm. Psychol. 5 (1) (1987) 61–72.
[70]
J. Frankenstein, et al., Is the map in our head oriented north?, Psychol. Sci. 23 (2) (2012) 120–125.
[71]
T. Meilinger, J. Frankenstein, H.H. Bulthoff, Learning to navigate: Experience versus maps, Cognition 129 (1) (2013) 24–30.
[72]
E.J. Arthur, P.A. Hancock, S.T. Chrysler, The perception of spatial layout in real and virtual worlds, Ergonomics 40 (1) (1997) 69–77.
[73]
S. Münzer, B.C.O.F. Fehringer, T. Kühl, Validation of a 3-factor structure of spatial strategies and relations to possession and usage of navigational aids, J. Environ. Psychol. 47 (2016) 66–78.
[74]
Robinson, T., Wayfinding in Zero Visibility. [Web page]. 12 December 2013. Available from: https://www.fireengineering.com/firefighting/wayfinding-in-zero-visibility/#gref. Accessed on 17 April 2021.
[75]
H.-L. Chi, S.-C. Kang, X. Wang, Research trends and opportunities of augmented reality applications in architecture, engineering, and construction, Autom. Constr. 33 (2013) 116–122.
[76]
F. Kreuter, S. Presser, R. Tourangeau, Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity, Public Opinion Quarterly 72 (5) (2009) 847–865.
[77]
D. Head, M. Isom, Age effects on wayfinding and route learning skills, Behav. Brain Res. 209 (1) (2010) 49–58.
[78]
R. Palmarini, et al., A systematic review of augmented reality applications in maintenance, Rob. Comput. Integr. Manuf. 49 (2018) 215–228.

Cited By

View all
  • (2024)Navigating the Virtuality-Reality Clash: Reflection and Design Patterns for Industrial Mixed Reality ApplicationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660700(2247-2266)Online publication date: 1-Jul-2024
  • (2024)Reference-based super-resolution reconstruction of remote sensing images based on a coarse-to-fine feature matching transformerEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108787135:COnline publication date: 1-Sep-2024
  • (2024)Augmented reality applications in construction productivityAdvanced Engineering Informatics10.1016/j.aei.2024.10279862:PCOnline publication date: 1-Oct-2024
  • Show More Cited By

Index Terms

  1. Enhancing human indoor cognitive map development and wayfinding performance with immersive augmented reality-based navigation systems
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image Advanced Engineering Informatics
          Advanced Engineering Informatics  Volume 50, Issue C
          Oct 2021
          1047 pages

          Publisher

          Elsevier Science Publishers B. V.

          Netherlands

          Publication History

          Published: 01 October 2021

          Author Tags

          1. Immersive augmented reality (IAR)
          2. Navigation
          3. Wayfinding
          4. Cognitive map
          5. Workload

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 13 Feb 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Navigating the Virtuality-Reality Clash: Reflection and Design Patterns for Industrial Mixed Reality ApplicationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660700(2247-2266)Online publication date: 1-Jul-2024
          • (2024)Reference-based super-resolution reconstruction of remote sensing images based on a coarse-to-fine feature matching transformerEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108787135:COnline publication date: 1-Sep-2024
          • (2024)Augmented reality applications in construction productivityAdvanced Engineering Informatics10.1016/j.aei.2024.10279862:PCOnline publication date: 1-Oct-2024
          • (2023)3D Building Plans: Supporting Navigation by People who are Blind or have Low Vision in Multi-Storey BuildingsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581389(1-19)Online publication date: 19-Apr-2023
          • (2023)Ontology for experimentation of human-building interactions using virtual realityAdvanced Engineering Informatics10.1016/j.aei.2023.10190355:COnline publication date: 1-Jan-2023
          • (2023)X-Board: an egocentric adaptive AR assistant for perception in indoor environmentsVirtual Reality10.1007/s10055-022-00742-327:2(1327-1343)Online publication date: 1-Jun-2023
          • (2023)How to Design a Successful Training Application with Used Mobile Augmented RealityHCI International 2023 – Late Breaking Papers10.1007/978-3-031-48060-7_16(203-216)Online publication date: 23-Jul-2023

          View Options

          View options

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media