research-article

Watchpoint: Freehand Pointing with a Smartwatch in a Ubiquitous Display Environment

Authors:

Keiko Katsuragawa,

Krzysztof Pietroszek,

James R. Wallace,

Edward LankAuthors Info & Claims

AVI '16: Proceedings of the International Working Conference on Advanced Visual Interfaces

Pages 128 - 135

https://doi.org/10.1145/2909132.2909263

Published: 07 June 2016 Publication History

Abstract

We describe the design and evaluation of a freehand, smartwatch-based, mid-air pointing and clicking interaction technique, called Watchpoint. Watchpoint enables a user to point at a target on a nearby large display by moving their arm. It also enables target selection through a wrist rotation gesture. We validate the use of Watchpoint by comparing its performance with two existing techniques: Myopoint, which uses a specialized forearm mounted motion sensor, and a camera-based (Vicon) motion capture system. We show that Watchpoint is statistically comparable in speed and error rate to both systems and, in fact, outperforms in terms of error rate for small (high Fitts's ID) targets. Our work demonstrates that a commodity smartwatch can serve as an effective pointing device in ubiquitous display environments.

References

[1]

Android API Guides, Motion Sensors. Retrieved January, 2016, from http://developer.android.com/guide/topics/sensors/sensors_motion.html

[2]

Ballagas, R., Borchers, J., Rohs, M., and Sheridan, J. 2006. The Smart Phone: A Ubiquitous Input Device. IEEE Pervasive Comput. IEEE Pervasive Computing, 5(1), 70--77.

Digital Library

[3]

Bowman, D., Wingrave, C., Campbell, J., and Sy, V. 2001. Using pinch gloves ™ for both natural and abstract interaction techniques in virtual environments. Proceedings of HCI internationall 2001.

[4]

Buxton, W. 1990. A Three-State Model of Graphical Input. In D. Diaper et al. (Eds), Human-Computer Interaction - INTERACT '90. Amsterdam: Elsevier Science Publishers B.V. (North-Holland), 449--456.

Digital Library

[5]

Casiez, G., Roussel, N., and Vogel, D. 2012. 1 € filter. Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems - CHI '12.

[6]

Chen, X., and Davis, J. 2000. Camera Placement Considering Occlusion for Robust Motion Capture. Stanford University Computer Science Technical Report, CS-RT-2000-07

[7]

Fitts, P. M. 1954. 1954. The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement Journal of Experimental Psychology, 47 (6), 381--391.

[8]

Greenberg, S., Marquardt, N., Ballendat, T., Diaz-Marino, R., and Wang, M. 2011. Proxemic interactions. Interactions, 18(1), 42.

Digital Library

[9]

Haque, F., Nancel, M., and Vogel, D. 2015. Myopoint. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15.

[10]

Huang, E. M., Mynatt, E. D., and Trimble, J. P. 2007. When design just isn't enough: The unanticipated challenges of the real world for large collaborative displays. Personal and Ubiquitous Computing, 11(7), 537--547.

Digital Library

[11]

ISO, 2002, Ergonomic requirements for office work with visual display terminals (VDTs) - Part 9: Requirements for non-keyboard input devices. (ISO 9241--9)

[12]

Jota, R., Nacenta, M., Jorge, J., Carpendale, S. and Greenberg, S. 2010. A Comparison of Ray Pointing Techniques for Very Large Displays. GI '10 Proceedings of Graphics Interface 2010

Digital Library

[13]

Myers, B. A. 2001. Using handhelds and PCs together. Communications of the ACM Commun. ACM, 44(11), 34--41.

Digital Library

[14]

Nancel, M., Chapuis, O., Pietriga, E., Yang, X., Irani, P. P., & Beaudouin-Lafon, M. 2013. High-precision pointing on large wall displays using small handheld devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13.

Digital Library

[15]

Pietroszek, K., Kuzminykh, A., Wallace, J. R., and Lank, E. 2014. Smartcasting. Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures the Future of Design - OzCHI '14.

[16]

Pietroszek, K., Wallace, J. R., and Lank, E. 2015. Tiltcasting. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15.

[17]

Raskar, R., Nii, H., deDecker, B., Hashimoto, Y., Summet, J., Moore, D., Zhao, Y., Westhues, J., Dietz, P., Barnwell, J., Nayar, S, Inami, M., Bekaert, P., Noland, M.Branzoi, V. and Bruns, E. 2007. Prakash:Lighting aware motion capture using photosensing markers and multiplexed illuminators. ACM Transactions on Graphics, 26(3), 36.

Digital Library

[18]

Ruiz, J., and Vogel, D. 2015. Soft-Constraints to Reduce Legacy and Performance Bias to Elicit Whole-body Gestures with Low Arm Fatigue. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15.

Digital Library

[19]

Vogel, D., and Balakrishnan, R. 2005. Distant freehand pointing and clicking on very large, high resolution displays. Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology - UIST '05.

Digital Library

[20]

Yee, K. 2003. Peehole displays. Proceedings of the Conference on Human Factors in Computing Systems - CHI '03.

Digital Library

Cited By

Woo RHarley DWallace J(2024)"I'm not alone in that battle": Designing Mobile AR for Mental Health Communication and Community ConnectednessProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661626(328-342)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661626
Shen XYu CWang XLiang CChen HShi Y(2024)MouseRing: Always-available Touchpad Interaction with IMU RingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642225(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642225
Gomes PCastro MNascimento T(2023)Gesture Recognition Methods Using Sensors Integrated into Smartwatches: Results of a Systematic Literature ReviewProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638082(1-11)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3638067.3638082
Show More Cited By

Recommendations

Pointing at a Distance with Everyday Smart Devices
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Large displays are becoming commonplace at work, at home, or in public areas. However, interaction at a distance -- anything greater than arms-length -- remains cumbersome, restricts simultaneous use, and requires specific hardware augmentations of the ...
Flickey: Flick-Based QWERTY Software Keyboard for Ultra-small Touch Screen Devices
Human-Computer Interaction. Interaction Technologies
Abstract
Ultra-small touch screen devices (e.g., smartwatches) are required to be small and lightweight so that they can be worn on the body with no frustration. For this reason, users often have difficulties in selecting the correct keys, and thus ...
Exploring callout design in selection task for ultra-small touch screen devices
OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human Interaction

Ultra-small touch screen devices tend to suffer from occlusion or the fat finger problem owing to their limited input area. A callout could solve these problems by displaying a copy of the occluded area in a non-occluded area. However, callout designs ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

AVI '16: Proceedings of the International Working Conference on Advanced Visual Interfaces

June 2016

400 pages

ISBN:9781450341318

DOI:10.1145/2909132

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

AVI '16

Sponsor:

AVI '16: International Working Conference on Advanced Visual Interfaces

June 7 - 10, 2016

Bari, Italy

Acceptance Rates

AVI '16 Paper Acceptance Rate 20 of 96 submissions, 21%;

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
643
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)3

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Woo RHarley DWallace J(2024)"I'm not alone in that battle": Designing Mobile AR for Mental Health Communication and Community ConnectednessProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661626(328-342)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661626
Shen XYu CWang XLiang CChen HShi Y(2024)MouseRing: Always-available Touchpad Interaction with IMU RingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642225(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642225
Gomes PCastro MNascimento T(2023)Gesture Recognition Methods Using Sensors Integrated into Smartwatches: Results of a Systematic Literature ReviewProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638082(1-11)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3638067.3638082
Kim DMollyn VHarrison C(2023)WorldPoint: Finger Pointing as a Rapid and Natural Trigger for In-the-Wild Mobile InteractionsProceedings of the ACM on Human-Computer Interaction10.1145/36264787:ISS(357-375)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626478
Henderson JNeshati AMizobuchi SZhou WVogel DLank E(2023)Interaction Region Characteristics for Midair Barehand Targeting on a TelevisionExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585877(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585877
Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Fashimpaur JKarlson AJonker TBenko HGupta A(2023)Investigating Wrist Deflection Scrolling Techniques for Extended RealityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580870(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580870
Lang MStrobel CWeckesser FLanglois DKasneci EKozlíková BKrone M(2023)A multimodal smartwatch-based interaction concept for immersive environmentsComputers and Graphics10.1016/j.cag.2023.10.010117:C(85-95)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.cag.2023.10.010
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Li LFang ZJia WZhang F(2022)Hierarchical Pointing on Distant Displays with Smart DevicesInternational Journal of Human–Computer Interaction10.1080/10447318.2022.210855939:19(3859-3874)Online publication date: 6-Sep-2022
https://doi.org/10.1080/10447318.2022.2108559
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents