research-article

Target acquisition with camera phones when used as magic lenses

Authors:

Antti OulasvirtaAuthors Info & Claims

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1409 - 1418

https://doi.org/10.1145/1357054.1357275

Published: 06 April 2008 Publication History

Abstract

When camera phones are used as magic lenses in handheld augmented reality applications involving wall maps or posters, pointing can be divided into two phases: (1) an initial coarse physical pointing phase, in which the target can be directly observed on the background surface, and (2) a fine-control virtual pointing phase, in which the target can only be observed through the device display. In two studies, we show that performance cannot be adequately modeled with standard Fitts' law, but can be adequately modeled with a two-component modification. We chart the performance space and analyze users' target acquisition strategies in varying conditions. Moreover, we show that the standard Fitts' law model does hold for dynamic peephole pointing where there is no guiding background surface and hence the physical pointing component of the extended model is not needed. Finally, implications for the design of magic lens interfaces are considered.

References

[1]

Baudisch, P., Good, N., Bellotti, V., and Schraedley, P. Keeping things in context: a comparative evaluation of focus plus context screens, overviews, and zooming. In Proc. CHI 2002, ACM Press (2002), 259--266.

Digital Library

[2]

Baudisch, P. and Rosenholtz, R. Halo: A technique for visualizing off-screen objects. In Proc. CHI 2003, ACM Press (2003), 481--488.

Digital Library

[3]

Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. Toolglass and magic lenses: the see-through interface. In Proc. SIGGRAPH 1993, ACM Press (1993), 73--80.

Digital Library

[4]

Card, S. K., Newell, A., and Moran, T. P. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, Inc., Mahwah, NJ, USA, 1983.

Digital Library

[5]

Crossman, E. R. F. W. and Goodeve, P. J. Feedback control of hand-movement and Fitts' law. Quarterly J. Experiment. Psych. 35A (1983/1963), 251--278.

[6]

Fitts, P. M. The information capacity of the human motor-system in controlling the amplitude of movement. J. Exp. Psychol. 47 (1954), 381--391.

[7]

Fitzmaurice, G. W., Zhai, S., and Chignell, M. H. Virtual reality for palmtop computers. ACM Trans. Inf. Syst. 11, 3 (1993), 197--218.

Digital Library

[8]

Graham, E. D. and MacKenzie, C. L. Physical versus virtual pointing. In Proc. CHI 1996, ACM Press (1996), 292--299.

Digital Library

[9]

Grossman, T. and Balakrishnan, R. Pointing at trivariate targets in 3D environments. In Proc. CHI 2004, ACM Press (2004), 447--454.

Digital Library

[10]

Guiard, Y. and Beaudouin-Lafon, M. Preface: Fitts' law 50 years later: Applications and contributions from human-computer interaction. Int. J. Hum.-Comput. Stud. 61, 6 (2004), 747--750.

Digital Library

[11]

Guiard, Y., and Beaudouin-Lafon, M. Target acquisition in multiscale electronic worlds. Int. J. Hum.-Comput. Stud. 61, 6 (2004), 875--905.

Digital Library

[12]

Hecht, B., Rohs, M., Schöning, J., and Krüger, A. Wikeye -- Using magic lenses to explore georeferenced Wikipedia content. In Proc. 3rd Intl. Workshop on Pervasive Mobile Interaction Devices (PERMID), 2007.

[13]

International Organization for Standardization. Ergonomic requirements for office work with visual display terminals (VDTs) -- Requirements for non-keyboard input devices. ISO/IEC 9241--9, 2000.

[14]

MacKenzie, I. S. Fitts' law as a research and design tool in human-computer interaction. Human-Computer Interaction 7, 1 (1992), 91--139.

Digital Library

[15]

Mehra, S., Werkhoven, P., and Worring, M. Navigating on handheld displays: Dynamic versus static peephole navigation. ACM Trans. Comput.-Hum. Interact. 13, 4 (2006), 448--457.

Digital Library

[16]

Murata, A., and Iwase, H. Extending Fitts' law to a three-dimensional pointing task. Human Movement Science 20, 6 (2001), 791--805.

[17]

Rohs, M. Marker-based embodied interaction for handheld augmented reality games. Journal of Virtual Reality and Broadcasting 4, 5 (2007).

[18]

Rohs, M., Schöning, J., Krüger, A., and Hecht, B. Towards real-time markerless tracking of magic lenses on paper maps. Advances in Pervasive Computing. Austrian Computer Society (2007), 69--72.

[19]

Sears, A. and Shneiderman, B. High precision touchscreens: Design strategies and comparisons with a mouse. Int. J. Man-Mach. Stud. 34, 4 (1991), 593--613.

Digital Library

[20]

Silfverberg, M., MacKenzie, I. S., and Kauppinen, T. An isometric joystick as a pointing device for handheld information terminals. In Proc. Graphics Interface 2001, Canadian Information Processing Society (2001), 119--126.

Digital Library

[21]

Soukoreff, R. W. and MacKenzie, I. S. Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. Int. J. Hum.-Comput. Stud. 61, 6 (2004), 751--789.

Digital Library

[22]

Wang, J., Zhai, S., and Canny, J. Camera phone based motion sensing: interaction techniques, applications and performance study. In Proc. UIST 2006, ACM Press (2006), 101--110.

Digital Library

[23]

Ware, C. and Balakrishnan, R. Reaching for objects in VR displays: lag and frame rate. ACM Trans. Comput.-Hum. Interact. 1, 4 (1994), 331--356.

Digital Library

[24]

Yee, K.-P. Peephole displays: Pen interaction on spatially aware handheld computers. In Proc. CHI 2003, ACM Press (2003), 1--8.

Digital Library

Cited By

Shimon SNeshati ASun JXu QZhao J(2024)Exploring Uni-manual Around Ear Off-Device Gestures for EarablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435138:1(1-29)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643513
Qin YYu CYao WYao JLiang CWeng YYan YShi Y(2023)Selecting Real-World Objects via User-Perspective Phone OcclusionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580696(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580696
Ullah ADelamare WHasan K(2023)Exploring Users Pointing Performance on Large Displays with Different Curvatures in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332024229:11(4535-4545)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320242
Show More Cited By

Index Terms

Target acquisition with camera phones when used as magic lenses
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Interaction with magic lenses: real-world validation of a Fitts' Law model
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Rohs and Oulasvirta (2008) proposed a two-component Fitts' law model for target acquisition with magic lenses in mobile augmented reality (AR) with 1) a physical pointing phase, in which the target can be directly observed on the background surface, and ...
A lightweight approach for augmented reality on camera phones using 2D images to simulate 3D
MUM '07: Proceedings of the 6th international conference on Mobile and ubiquitous multimedia

We describe a lightweight augmented reality approach enabling arbitrarily complex virtual models to be operated even on low end camera phones. For optimal performance we apply simple motion tracking with manual initialization, and sequences of 2D images ...
Eyes-Free Target Acquisition in Interaction Space around the Body for Virtual Reality
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Eyes-free target acquisition is a basic and important human ability to interact with the surrounding physical world, relying on the sense of space and proprioception. In this research, we leverage this ability to improve interaction in virtual reality (...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2008

1870 pages

ISBN:9781605580111

DOI:10.1145/1357054

General Chairs:
Mary Czerwinski
Microsoft Research, USA
,
Arnie Lund
Microsoft, USA
,
Program Chair:
Desney Tan
Microsoft Research, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '08

Sponsor:

CHI '08: CHI Conference on Human Factors in Computing Systems

April 5 - 10, 2008

Florence, Italy

Acceptance Rates

CHI '08 Paper Acceptance Rate 157 of 714 submissions, 22%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

56
Total Citations
View Citations
1,195
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shimon SNeshati ASun JXu QZhao J(2024)Exploring Uni-manual Around Ear Off-Device Gestures for EarablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435138:1(1-29)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643513
Qin YYu CYao WYao JLiang CWeng YYan YShi Y(2023)Selecting Real-World Objects via User-Perspective Phone OcclusionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580696(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580696
Ullah ADelamare WHasan K(2023)Exploring Users Pointing Performance on Large Displays with Different Curvatures in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332024229:11(4535-4545)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320242
Sidenmark LPrummer FNewn JGellersen H(2023)Comparing Gaze, Head and Controller Selection of Dynamically Revealed Targets in Head-Mounted DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332023529:11(4740-4750)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320235
Yin JWu MBai SLiu HWei S(2023)A scrolling performance model based on two-dimensional touch peephole interactionsBehaviour & Information Technology10.1080/0144929X.2023.222677743:9(1758-1768)Online publication date: 20-Jun-2023
https://doi.org/10.1080/0144929X.2023.2226777
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Walters CMendez OHadfield SBowden R(2022)A Robust Extrinsic Calibration Framework for Vehicles with Unscaled Sensors2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS40897.2019.8968244(36-42)Online publication date: 28-Dec-2022
https://dl.acm.org/doi/10.1109/IROS40897.2019.8968244
Perea PMorand DNigay L(2020)Target Expansion in ContextProceedings of the 2020 International Conference on Advanced Visual Interfaces10.1145/3399715.3399851(1-9)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3399715.3399851
Jin SYin JFu CZhang XLiu T(2020)Modeling Angle-Based Pointing Tasks in Augmented Reality InterfacesIEEE Access10.1109/ACCESS.2020.30319578(192597-192607)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3031957
Kim MLee JBrewster SFitzpatrick GCox AKostakos V(2019)PicMeProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300625(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300625
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten