Abstract
In recent years, outdoor hiking has gained popularity, driven by increasing health awareness. However, enthusiasts of hiking encounter challenges related to equipment carrying, long-distance journeys, and environmental uncertainties. These challenges include the limitation of frequently checking routes on mobile devices due to the use of trekking poles. To address these obstacles, we undertake research and design efforts that integrate outdoor scenarios with Augmented Reality (AR) technology. Our approach involves establishing AR user interface design guidelines and design strategies tailored for outdoor scenarios, derived from a comprehensive systematic literature review. We propose a multimodal AR system solution that leverages AR glasses and trekking poles as dual inputs. The system incorporates multimodal interaction and natural information presentation, aiming to create a multilevel interactive experience enriched with tangible physical evidence. The goal is to establish a seamless connection between the virtual and real worlds, mitigating the challenges faced by hiking enthusiasts. Evaluation experiments conducted demonstrate that the system successfully meets user needs and expectations in terms of multimodal input, visual information recognizability, and the rationality of user interface layout. The system is noted for its close alignment with the usage scene, exhibiting enhanced user-friendliness in practical applications. This study provides valuable insights into the design of AR systems in outdoor sports scenes, offering a reference point for future endeavors in this domain.
C. Chen, H. Zhang and Q. Li—These authors contributed equally to this work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Dubey, S., Biswas, P., Ghosh, R., et al.: Psychosocial impact of COVID-19. Diab. Metab. Syndr. Clin. Res. Rev. 14(5), 779–788 (2020)
Mitchell, R.: Is physical activity in natural environments better for mental health than physical activity in other environments? Soc. Sci. Med. 91, 130–134 (2013)
Molokáč, M., Hlaváčová, J., Tometzová, D., et al.: The preference analysis for hikers’ choice of hiking trail. Sustainability 14(11), 6795 (2022)
Dağ, K., Çavuşoğlu S., Durmaz, Y.: The effect of immersive experience, user engagement and perceived authenticity on place satisfaction in the context of augmented reality. Library Hi Tech (2023)
Azuma, R.T.: A survey of augmented reality. Presence Teleoperators Virtual Environ. 6(4), 355–385 (1997)
Lam, K.Y., Lee, L.H., Braud, T., et al.: M2a: a framework for visualizing information from mobile web to mobile augmented reality. In: 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 1–10. IEEE (2019)
Edwards-Stewart, A., Hoyt, T., Reger, G.: Classifying different types of augmented reality technology. Annu. Rev. Cyberther. Telemed. 14, 199–202 (2016)
McNamara, A., Kabeerdoss, C.: Mobile augmented reality: Placing labels based on gaze position. In: 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), pp. 36–37. IEEE (2016)
Ang, S.Y., Ng, G.W.: A study on the effect of the real-world backgrounds using colour blending technique on optical see-through AR user interface design. In: 2020 6th International Conference on Interactive Digital Media (ICIDM), pp. 1–4. IEEE (2020)
Haeuslschmid, R., Klaus, C., Butz, A.: Presenting information on the driver’s demand on a head-up display. In: Bernhaupt, R., Dalvi, G., Joshi, A., Balkrishan, D.K., O’Neill, J., Winckler, M. (eds.) INTERACT 2017, Part II. LNCS, vol. 10514, pp. 245–262. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67684-5_15
Bauer, M., Bruegge, B., Klinker, G., et al.: Design of a component-based augmented reality framework. In: Proceedings IEEE and ACM International Symposium on Augmented Reality, pp. 45–54. IEEE (2001)
Kölsch, M., Bane, R., Höllerer, T., et al.: Touching the visualized invisible: wearable AR with a multimodal interface. IEEE Comput. Graphics Appl. 26(3), 62–71 (2006)
Zhao, G., Orlosky, J., Gabbard, J., et al.: HazARdSnap: gazed-based augmentation delivery for safe information access while cycling. IEEE Trans. Vis. Comput. Graph. 01, 1–10 (2023)
Krauß, V., et al.: Current practices, challenges, and design implications for collaborative AR/VR application development. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (2021)
Dünser, A., et al.: Applying HCI principles to AR systems design (2007)
Gabbard, J.L., et al.: More than meets the eye: an engineering study to empirically examine the blending of real and virtual color spaces. In: 2010 IEEE Virtual Reality Conference (VR), IEEE (2010)
Gabbard, J.L., et al.: An empirical user-based study of text drawing styles and outdoor background textures for augmented reality. In: IEEE Proceedings. VR 2005. Virtual Reality, IEEE (2005)
Peterson, S.D., Magnus, A., Stephen, R.S.: Label segregation by remapping stereoscopic depth in far-field augmented reality. In: 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE (2008)
Kerr, S.J., et al.: Wearable mobile augmented reality: evaluating outdoor user experience. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry (2011)
Kwak, S., Choe, J., Seo, S.: Harmonic rendering for visual coherence on mobile outdoor AR environment. Multimedia Tools Appl. 79, 16141–16154 (2020)
Radford, A., et al.: Learning transferable visual models from natural language supervision. In: International Conference on Machine Learning, PMLR (2021)
Green, C., Jiang, Y., Isaacs, J.: Modular 3D interface design for accessible VR applications. In: Chen, J.Y.C., Fragomeni, G. (eds.) Virtual, Augmented and Mixed Reality. HCII 2023, LNCS, vol. 14027, pp. 15–32. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-35634-6_2
Pham, T., et al.: Scale impacts elicited gestures for manipulating holograms: implications for AR gesture design. In: Proceedings of the 2018 Designing Interactive Systems Conference (2018)
Weinstein, N., Przybylski, A.K., Ryan, R.M.: Can nature make us more caring? Effects of immersion in nature on intrinsic aspirations and generosity. Pers. Soc. Psychol. Bull. 35(10), 1315–1329 (2009)
Hull, R.B., IV., Stewart, W.P., Yi, Y.K.: Experience patterns: capturing the dynamic nature of a recreation experience. J. Leis. Res. 24(3), 240–252 (1992)
Vidon, E.S., Rickly, J.M.: Alienation and anxiety in tourism motivation. Ann. Tour. Res. 69, 65–75 (2018)
Wickens, C.D., Helton, W.S., Hollands, J.G., et al.: Engineering Psychology and Human Performance. Routledge, vol. 36 (2021)
Haeuslschmid, R., Klaus, C., Butz, A.: Presenting information on the driver’s demand on a head-up display. In: Bernhaupt, R., Dalvi, G., Joshi, A., K. Balkrishan, D., O’Neill, J., Winckler, M. (eds.) Human-Computer Interaction - INTERACT 2017. INTERACT 2017, LNCS, Part II, vol. 10514, pp. 245–262. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67684-5_15
Kerr, S.J., Rice, M.D., Teo, Y., et al.: Wearable mobile augmented reality: evaluating outdoor user experience. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, pp. 209–216 (2011)
Pritchard, A., Richardson, M., Sheffield, D., et al.: The relationship between nature connectedness and Eudaimonic well-being: a meta-analysis. J. Happiness Stud. 21, 1145–1167 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Hong, L., Hou, W., Chen, C., Zhang, H., Li, Q. (2024). MAR Enhanced Hiking Experience: Exploring Multimodal Experience Design in Outdoor Scenarios. In: Streitz, N.A., Konomi, S. (eds) Distributed, Ambient and Pervasive Interactions. HCII 2024. Lecture Notes in Computer Science, vol 14719. Springer, Cham. https://doi.org/10.1007/978-3-031-60012-8_22
Download citation
DOI: https://doi.org/10.1007/978-3-031-60012-8_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60011-1
Online ISBN: 978-3-031-60012-8
eBook Packages: Computer ScienceComputer Science (R0)