research-article

Experimental evaluation of user interfaces for visual indoor navigation

Authors:

Andreas Möller,

Matthias Kranz,

Stefan Diewald,

Tobias Stockinger,

Patrick A. LindemannAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 3607 - 3616

https://doi.org/10.1145/2556288.2557003

Published: 26 April 2014 Publication History

Abstract

Mobile location recognition by capturing images of the environment (visual localization) is a promising technique for indoor navigation in arbitrary surroundings. However, it has barely been investigated so far how the user interface (UI) can cope with the challenges of the vision-based localization technique, such as varying quality of the query images. We implemented a novel UI for visual localization, consisting of Virtual Reality (VR) and Augmented Reality (AR) views that actively communicate and ensure localization accuracy. If necessary, the system encourages the user to point the smartphone at distinctive regions to improve localization quality. We evaluated the UI in a experimental navigation task with a prototype, informed by initial evaluation results using design mockups. We found that VR can contribute to efficient and effective indoor navigation even at unreliable location and orientation accuracy. We discuss identified challenges and share lessons learned as recommendations for future work.

References

[1]

Azuma, R. A survey of augmented reality. Presence-Teleoperators and Virtual Environments 6, 4 (1997), 355--385.

Digital Library

[2]

Beeharee, A. K., and Steed, A. A natural wayfinding exploiting photos in pedestrian navigation systems. In Proc. of the 8th Conf. on Human-Computer Interaction with Mobile Devices and Services (MobileHCI), ACM (2006), 81--88.

Digital Library

[3]

Butz, A., Baus, J., Krüger, A., and Lohse, M. A hybrid indoor navigation system. In Proc. of the 6th Intl. Conf. on Intelligent User Interfaces (IUI), ACM (2001), 25--32.

Digital Library

[4]

Hile, H., and Borriello, G. Positioning and orientation in indoor environments using camera phones. Computer Graphics and Applications, IEEE 28, 4 (2008), 32--39.

Digital Library

[5]

Hile, H., Vedantham, R., Cuellar, G., Liu, A., Gelfand, N., Grzeszczuk, R., and Borriello, G. Landmark-based pedestrian navigation from collections of geotagged photos. In Proc. of the 7th Intl. Conference on Mobile and Ubiquitous Multimedia (MUM), ACM (2008), 145--152.

Digital Library

[6]

Kelley, J. F. An empirical methodology for writing user-friendly natural language computer applications. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (CHI), ACM (1983), 193--196.

Digital Library

[7]

Kray, C., Elting, C., Laakso, K., and Coors, V. Presenting route instructions on mobile devices. In Proc. of the 8th Intl. Conf. on Intelligent User Interfaces (IUI), ACM (2003), 117--124.

Digital Library

[8]

Kray, C., and Kortuem, G. Interactive positioning based on object visibility. In Mobile Human-Computer Interaction (MobileHCI), S. Brewster and M. Dunlop, Eds., vol. 3160 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2004, 276--287.

[9]

Li, B., Salter, J., Dempster, A., and Rizos, C. Indoor positioning techniques based on wireless LAN. In 1st IEEE Intl. Conf. on Wireless Broadband and Ultra Wideband Communications (2006), 13--16.

[10]

Lim, H., Kung, L., Hou, J., and Luo, H. Zero-configuration, robust indoor localization: Theory and experimentation. Tech. rep., Univ. of Illinois, 2005.

[11]

Liu, A., Hile, H., Kautz, H., Borriello, G., Brown, P., Harniss, M., and Johnson, K. Indoor wayfinding: Developing a functional interface for individuals with cognitive impairments. Disability & Rehabilitation: Assistive Technology 3, 1--2 (2008), 69--81.

[12]

Miyashita, T., Meier, P., Tachikawa, T., Orlic, S., Eble, T., Scholz, V., Gapel, A., Gerl, O., Arnaudov, S., and Lieberknecht, S. An augmented reality museum guide. In Proc. of the 7th IEEE/ACM Intl. Symposium on Mixed and Augmented Reality, IEEE (2008), 103--106.

Digital Library

[13]

Miyazaki, Y., and Kamiya, T. Pedestrian navigation system for mobile phones using panoramic landscape images. In Intl. Symposium on Applications and the Internet (SAINT), IEEE (2006).

Digital Library

[14]

Möller, A., Kranz, M., Huitl, R., Diewald, S., and Roalter, L. A mobile indoor navigation system interface adapted to vision-based localization. In Proc. of the 11th Intl. Conf. on Mobile and Ubiquitous Multimedia (MUM), ACM (2012), 4:1--4:10.

Digital Library

[15]

Möller, A., Kray, C., Roalter, L., Diewald, S., and Kranz, M. Tool support for prototyping interfaces for vision-based indoor navigation. In Workshop on Mobile Vision and HCI (MobiVis) on MobileHCI 2012 (2012).

[16]

Mulloni, A., Seichter, H., Dünser, A., Baudisch, P., and Schmalstieg, D. 360 -- panoramic overviews for location-based services. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (CHI), ACM (2012), 2565--2568.

Digital Library

[17]

Mulloni, A., Wagner, D., Barakonyi, I., and Schmalstieg, D. Indoor positioning and navigation with camera phones. Pervasive Computing, IEEE 8, 2 (2009), 22--31.

Digital Library

[18]

Narzt, W., Pomberger, G., Ferscha, A., Kolb, D., Müller, R., Wieghardt, J., Hörtner, H., and Lindinger, C. Augmented reality navigation systems. Universal Access in the Information Society 4, 3 (2006), 177--187.

Digital Library

[19]

Schroth, G., Huitl, R., Chen, D., Abu-Alqumsan, M., Al-Nuaimi, A., and Steinbach, E. Mobile visual location recognition. IEEE Signal Processing Magazine 28, 4 (2011), 77--89.

[20]

Walther-Franks, B., and Malaka, R. Evaluation of an augmented photograph-based pedestrian navigation system. In Smart Graphics, Springer (2008), 94--105.

Digital Library

Cited By

Zhou JYang HShen JZhu L(2024)Indoor navigation map design based on spatial complexityCartography and Geographic Information Science10.1080/15230406.2024.2339296(1-13)Online publication date: 21-May-2024
https://doi.org/10.1080/15230406.2024.2339296
Berglund EKlompstra LOrädd HFallström JStrömberg AJaarsma TBerglund A(2023)The Rationale Behind the Design Decisions in an Augmented Reality Mobile e-Health Exergame to Increase Physical Activity for Inactive Older People with Heart Failure (Preprint)JMIR Serious Games10.2196/50066Online publication date: 18-Jun-2023
https://doi.org/10.2196/50066
Mazurkiewicz BGalvão MGiannopoulos I(2023)BeeAR: Augmented Reality Beeline Navigation for Spatial Knowledge AcquisitionProceedings of the ACM on Human-Computer Interaction10.1145/36042467:MHCI(1-17)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604246
Show More Cited By

Index Terms

Experimental evaluation of user interfaces for visual indoor navigation
1. Human-centered computing

Recommendations

Handheld augmented reality indoor navigation with activity-based instructions
MobileHCI '11: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services

We present a novel design of an augmented reality interface to support indoor navigation. We combine activity-based instructions with sparse 3D localisation at selected info points in the building. Based on localisation accuracy and the users' ...
A mobile indoor navigation system interface adapted to vision-based localization
MUM '12: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia

Vision-based approaches for mobile indoor localization do not rely on the infrastructure and are therefore scalable and cheap. The particular requirements to a navigation user interface for a vision-based system, however, have not been investigated so ...
Indoor navigation with mixed reality world-in-miniature views and sparse localization on mobile devices
AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

We present the design of an interface that provides continuous navigational support for indoor scenarios where localization is only available at sparse, discrete locations (info points). Our interface combines turn-by-turn instructions with a World-in-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
1,371
Total Downloads

Downloads (Last 12 months)76
Downloads (Last 6 weeks)7

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou JYang HShen JZhu L(2024)Indoor navigation map design based on spatial complexityCartography and Geographic Information Science10.1080/15230406.2024.2339296(1-13)Online publication date: 21-May-2024
https://doi.org/10.1080/15230406.2024.2339296
Berglund EKlompstra LOrädd HFallström JStrömberg AJaarsma TBerglund A(2023)The Rationale Behind the Design Decisions in an Augmented Reality Mobile e-Health Exergame to Increase Physical Activity for Inactive Older People with Heart Failure (Preprint)JMIR Serious Games10.2196/50066Online publication date: 18-Jun-2023
https://doi.org/10.2196/50066
Mazurkiewicz BGalvão MGiannopoulos I(2023)BeeAR: Augmented Reality Beeline Navigation for Spatial Knowledge AcquisitionProceedings of the ACM on Human-Computer Interaction10.1145/36042467:MHCI(1-17)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604246
Wu CHuang MSun WYang R(2023)Feeling of Control in Augmented Reality and Virtual Reality for Virtual Object Manipulation2023 9th International Conference on Virtual Reality (ICVR)10.1109/ICVR57957.2023.10169460(193-199)Online publication date: 12-May-2023
https://doi.org/10.1109/ICVR57957.2023.10169460
Lee JJin FKim YLindlbauer D(2022)User Preference for Navigation Instructions in Mixed Reality2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00102(802-811)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00102
De Cock LVan de Weghe NOoms KSaenen IVan Kets NVan Wallendael GLambert PDe Maeyer P(2022)Linking the cognitive load induced by route instruction types and building configuration during indoor route guidance, a usability study in VRInternational Journal of Geographical Information Science10.1080/13658816.2022.203208036:10(1978-2008)Online publication date: 4-Mar-2022
https://doi.org/10.1080/13658816.2022.2032080
Rehman IUllah SAli NRabbi IKhan R(2022)Gesture-based guidance for navigation in virtual environmentsJournal on Multimodal User Interfaces10.1007/s12193-022-00395-116:4(371-383)Online publication date: 29-Sep-2022
https://doi.org/10.1007/s12193-022-00395-1
De Cock LVan de Weghe NOoms KVanhaeren NRidolfi MDe Poorter EDe Maeyer P(2021)Taking a closer look at indoor route guidance; usability study to compare an adapted and non-adapted mobile prototypeSpatial Cognition & Computation10.1080/13875868.2021.188541122:1-2(51-73)Online publication date: 14-Feb-2021
https://doi.org/10.1080/13875868.2021.1885411
Dasler PMalik SMauriello M(2021)“Just Follow the Lights”International Journal of Human-Computer Studies10.1016/j.ijhcs.2021.102692155:COnline publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1016/j.ijhcs.2021.102692
Paetow TWichmann JWißotzki M(2021)Campus-Navigation-System Design for Universities – A Method Approach for Wismar Business SchoolHuman Centred Intelligent Systems10.1007/978-981-16-3264-8_1(3-12)Online publication date: 29-May-2021
https://doi.org/10.1007/978-981-16-3264-8_1
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents