research-article

Evaluating dual-view perceptual issues in handheld augmented reality: device vs. user perspective rendering

Authors:

Klen Čopič Pucihar,

Jason AlexanderAuthors Info & Claims

ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interaction

Pages 381 - 388

https://doi.org/10.1145/2522848.2522885

Published: 09 December 2013 Publication History

Abstract

In handheld Augmented Reality (AR) the magic-lens paradigm is typically implemented by rendering the video stream captured by the back-facing camera onto the device's screen. Unfortunately, such implementations show the real world from the device's perspective rather than the user's perspective. This dual-perspective results in misaligned and incorrectly scaled imagery, a predominate cause for the dual-view problem with potential to distort user's spatial perception. This paper presents a user study that analyzes users' expectations, spatial-perception, and their ability to deal with the dual-view problem, by comparing device-perspective and fixed Point-of-View (POV) user-perspective rendering. The results confirm the existence of the dual-view perceptual issue and that the majority of participants expect user-perspective rendering irrespective of their previous AR experience. Participants also demonstrated significantly better spatial perception and preference of the user-perspective view.

References

[1]

Arthur, K. W., Booth, K. S., and Ware, C. "Evaluating 3D task performance for fish tank virtual worlds," ACM Transactions on Information Systems, vol. 11, no. 3, pp. 239--265, 1993.

Digital Library

[2]

Asteriadis, S., Karpouzis, K., and Kollias, S., "Head pose estimation with one camera, in uncalibrated environments," In EGIHMI '10, pp. 55--62.

Digital Library

[3]

Baričević, D., Lee, C., Tobias, H., and Bowman, D.A., "A Hand-Held AR Magic Lens with User-Perspective Rendering," In ISMAR'12, pp. 197--206.

Digital Library

[4]

Baudisch, P., Good, N., Bellotti, V., and Schraedley, P., "Keeping Things in Context: A Comparative Evaluation of Focus Plus Context Screens, Overviews, and Zooming," In SIGCHI '02, 2002, pp. 259--266.

Digital Library

[5]

Bier, E.A., Stone, M.C., Pier, K., Buxton, W., and DeRose, T. D., "Toolglass and magic lens: the see- through interface," In SIGGRAPH '93, pp. 73--80.

Digital Library

[6]

Čopič, P., K., Coulton, P. and Hutchinson, D., Utilizing Sensor Fusion in Markerless Mobile Augmented Reality. In MobileHCI '11, pp. 663--666.

Digital Library

[7]

Čopič, P., K., Coulton, P., and Alexander, J., "Creating a Stereoscopic Magic-lens to Improve Depth Perception in Handheld Augmented Reality". In MobileHCI '13, pp. 448--451.

Digital Library

[8]

Cutting, J., "Reconceiving Perceptual Space, in Perceiving Pictures: An Interdisciplinary Approach to Pictorial Space", MIT Press: Cambridge, pp. 215--238, 2003.

[9]

Hart, S. and Staveland, L., "Development of NASA- TLX (Task Load Index): Results of empirical and theoretical research," Human Mental Workload, 1, 1988.

[10]

Henze, N., Boll, S., "Who's That Girl? Handheld Augmented Reality for Printed Photo Books", In INTERACT '11, pp. 134--151.

Digital Library

[11]

Hill, A., Wilson, J., Davidson, B., Gandy, M., and Macintyre, B., "Virtual Transparency: Introducing Parallax View into Video See-through AR," In ISMAR '11, pp. 239--240.

Digital Library

[12]

Izadi, S., Kim, D., and Hilliges, O., "KinectFusion: Real-time 3D Reconstruction and Interaction Using a Moving Depth Camera," In UIST '11, pp. 559--568.

Digital Library

[13]

Klein, G. and Murray, D., "Parallel tracking and mapping on a camera phone," In ISMAR '09, pp. 83--86.

Digital Library

[14]

Kruijff, E. and Ii, J. E. S., "Perceptual Issues in Augmented Reality Revisited," In ISMAR '09, pp. 3--12.

[15]

Kurz, D. and Benhimane, S., "Gravity-Aware Handheld Augmented Reality," In ISMAR '11, pp. 111--120.

Digital Library

[16]

Lee, W., Park, Y., Lepetit, V., and Woo, W., "Point-and-shoot for ubiquitous tagging on mobile phones," In ISMAR '10, pp. 57--64.

[17]

Liao, C., Liu, Q., 13Liew, B., and Wilcox, L., "Pacer: fine-grained interactive paper via camera-touch hybrid gestures on a cell phone," In CHI '10, pp. 2441--2450.

Digital Library

[18]

Mehra, S., Werkhoven, P., and Worring, M., "Navigating on Handheld Displays: Dynamic versus Static Peephole Navigation," In TOCHI '06, pp. 448--457.

Digital Library

[19]

Newcombe, R., Lovegrove, S., and Davison, A., "DTAM: Dense tracking and mapping in real-time," In ICCV '11, pp. 2320--2327.

Digital Library

[20]

Norman, D. A. The Design of Everyday Things. Published by Basic Books, September 17, 2002. ISBN- 10: 0465067107.

Digital Library

[21]

Oh, J. and Hua, H., "User evaluations on form factors of tangible magic lens," In ISMAR '06, pp. 23--32.

Digital Library

[22]

Olsson T., and Salo M., "Online user survey on current mobile augmented reality applications". In ISMAR '11, pp. 75--84.

Digital Library

[23]

Robbins, D. C., Cutrell E., Sarin R., and Horvitz E., "ZoneZoom: map navigation for smartphones with recursive view segmentation," In AVI '04, 2004, pp. 231--234.

Digital Library

[24]

Rohs, M., Schöning, M., Raubal, G., Essl, and A. Krüger, "Map Navigation with Mobile Devices: Virtual versus Physical Movement with and without Visual Context Categories and Subject Descriptors," In ICMI' 07, pp. 146--153.

Digital Library

[25]

Rohs, M., Schöning, J., Schleicher, R., Essl, G., Naumann, A., and Krüger, A., "Impact of Item Density on Magic Lens Interactions," In MobileHCI '09, pp. 1--4.

Digital Library

[26]

Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., and Schmalstieg, D., "Pose tracking from natural features on mobile phones," In ISMAR '08, pp. 125--134.

Digital Library

Cited By

Hueber SWilhelm JSchäfer RVoelker SBorchers J(2023)User-Aware Rendering: Merging the Strengths of Device- and User-Perspective Rendering in Handheld ARProceedings of the ACM on Human-Computer Interaction10.1145/36042787:MHCI(1-18)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604278
Emsenhuber GLanglotz TKalkofen DSutton JTatzgern M(2023)Eye-Perspective View Management for Optical See-Through Head-Mounted DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581059(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581059
Qin YYu CYao WYao JLiang CWeng YYan YShi Y(2023)Selecting Real-World Objects via User-Perspective Phone OcclusionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580696(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580696
Show More Cited By

Index Terms

Evaluating dual-view perceptual issues in handheld augmented reality: device vs. user perspective rendering
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

The use of surrounding visual context in handheld AR: device vs. user perspective rendering
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

The magic lens paradigm, a commonly used descriptor for handheld Augmented Reality (AR), presents the user with dual views: the augmented view (magic lens) that appears on the device, and the real view of the surroundings (what the user can see around ...
Creating a stereoscopic magic-lens to improve depth perception in handheld augmented reality
MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

Handheld Augmented Reality (AR) is often presented using the magic-lens paradigm where the handheld device is portrayed as if it was transparent. Such a virtual transparency is usually implemented using video captured by a single camera rendered on the ...
Enhanced virtual transparency in handheld ar: digital magnifying glass
MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

Handheld Augmented Reality (AR) is often presented using the magic-lens paradigm in which a magic-lens is a transparent interface. Such transparency is usually implemented by rendering camera captured video on the device's screen. The transparency ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interaction

December 2013

630 pages

ISBN:9781450321297

DOI:10.1145/2522848

General Chairs:
Julien Epps
The University of New South Wales, Australia
,
Fang Chen
National ICT Australia, Australia
,
Sharon Oviatt
Incaa Designs, USA
,
Kenji Mase
Nagoya University, Japan
,
Program Chairs:
Andrew Sears
Rochester Institute of Technology, USA
,
Kristiina Jokinen
University of Helsinki, Finland
,
Björn Schuller
Technische Universität München, Germany

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 December 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI '13

Sponsor:

SIGCHI

ICMI '13: 2013 International Conference on Multimodal Interaction

December 9 - 13, 2013

Sydney, Australia

Acceptance Rates

ICMI '13 Paper Acceptance Rate 49 of 133 submissions, 37%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
404
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)2

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hueber SWilhelm JSchäfer RVoelker SBorchers J(2023)User-Aware Rendering: Merging the Strengths of Device- and User-Perspective Rendering in Handheld ARProceedings of the ACM on Human-Computer Interaction10.1145/36042787:MHCI(1-18)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604278
Emsenhuber GLanglotz TKalkofen DSutton JTatzgern M(2023)Eye-Perspective View Management for Optical See-Through Head-Mounted DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581059(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581059
Qin YYu CYao WYao JLiang CWeng YYan YShi Y(2023)Selecting Real-World Objects via User-Perspective Phone OcclusionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580696(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580696
Grubert J(2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_5
Safari Bazargani JZafari MSadeghi-Niaraki AChoi S(2022)A Survey of GIS and AR Integration: ApplicationsSustainability10.3390/su14161013414:16(10134)Online publication date: 16-Aug-2022
https://doi.org/10.3390/su141610134
Qian JZhou TYoung-Ng MMa JCheung ALi XGonsher IHuang J(2021)Portalware: Exploring Free-Hand AR Drawing with a Dual-Display Smartphone-Wearable ParadigmProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462098(205-219)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462098
Liu RPeng CZhang YHusarek HYu Q(2021)A survey of immersive technologies and applications for industrial product developmentComputers and Graphics10.1016/j.cag.2021.07.023100:C(137-151)Online publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1016/j.cag.2021.07.023
Nomura RKomuro TYamamoto STsumura N(2020)[Paper] Object Manipulation for Perceiving a Sense of Material using User-Perspective Mobile Augmented RealityITE Transactions on Media Technology and Applications10.3169/mta.8.2458:4(245-251)Online publication date: 2020
https://doi.org/10.3169/mta.8.245
Simeone AKhamis MEsteves ADaiber FKljun MČopič Pucihar KIsokoski PGugenheimer JJorge JFerreira AMarquardt NChevalier F(2020)International Workshop on Cross-Reality (XR) InteractionCompanion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces10.1145/3380867.3424551(111-114)Online publication date: 8-Nov-2020
https://dl.acm.org/doi/10.1145/3380867.3424551
Wacker PWagner AVoelker SBorchers JBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Heatmaps, Shadows, Bubbles, Rays: Comparing Mid-Air Pen Position Visualizations in Handheld ARProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376848(1-11)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376848
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents