extended-abstract

'Hop-to-select' traverse with gestural input in an eye-off interaction

Authors:

Ngoc Thi Nguyen,

Hyowon LeeAuthors Info & Claims

OzCHI '17: Proceedings of the 29th Australian Conference on Computer-Human Interaction

Pages 597 - 601

https://doi.org/10.1145/3152771.3156180

Published: 28 November 2017 Publication History

Abstract

We propose¹ a way of leveraging people's familiarity with multitouch gestures, in interacting with displays which are not directly touchable or contactable. By defining a subset of multitouch gestures and implementing it on a smartwatch wirelessly connecting to a separate display screen, a user remains visually focused on the screen while continuing to interact with the system. We characterise this type of interaction and identify 'Hop-to-Select' traverse strategy. Usability testing with ten participants show that the applications are very easy to learn and use, and we report further insights in shaping novel usage scenarios from it.

References

[1]

Christopher Ackad, Martin Tomitsch and Judy Kay. Year. Skeletons and Silhouettes: Comparing User Representations at a Gesture-Based Large Display. In Proceedings of Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2343--2347.

Digital Library

[2]

Florian Alt, Alireza Sahami Shirazi, Thomas Kubitza and Albrecht Schmidt. Year. Interaction Techniques for Creating and Exchanging Content with Public Displays. In Proceedings of Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1709--1718.

Digital Library

[3]

Mark Apperley, Laurie McLeod, Masood Masoodian, Lance Paine, Malcolm Phillips, Bill Rogers and Kirsten Thomson. 2003. Use of Video Shadow for Small Group Interaction Awareness on a Large Interactive Display Surface. In Proceedings of Proceedings of the Fourth Australasian user interface conference on User interfaces 2003 - Volume 18. Australian Computer Society, Inc., Adelaide, Australia, 81--90.

Digital Library

[4]

Rafael Ballagas, Michael Rohs and Jennifer G Sheridan. Year. Sweep and Point and Shoot: Phonecam-Based Interactions for Large Public Displays. In Proceedings of CHI'05 extended abstracts on Human factors in computing systems. ACM, 1200--1203.

Digital Library

[5]

Thomas Baudel and Michel Beaudouin-Lafon. 1993. Charade: Remote Control of Objects Using Free- Hand Gestures. Communications of the ACM 36, 7, 28--35.

Digital Library

[6]

Mark Billinghurst. 1998. Put That Where? Voice and Gesture at the Graphics Interface. SIGGRAPH Comput. Graph. 32, 4, 60--63.

Digital Library

[7]

Richard A Bolt. 1980. "Put-That-There": Voice and Gesture at the Graphics Interface. ACM,

[8]

Richard A. Bolt. 1981. Gaze-Orchestrated Dynamic Windows. In Proceedings of Proceedings of the 8th annual conference on Computer graphics and interactive techniques. ACM, Dallas, Texas, USA, 109--119.

Digital Library

[9]

Keith Cheverst, Alan Dix, Daniel Fitton, Chris Kray, Mark Rouncefield, Corina Sas, George Saslis-Lagoudakis and Jennifer G Sheridan. Year. Exploring Bluetooth Based Mobile Phone Interaction with the Hermes Photo Display. In Proceedings of Proceedings of the 7th international conference on Human computer interaction with mobile devices & services. ACM, 47--54.

Digital Library

[10]

Matthias Geel, Daniel Huguenin and Moira C Norrie. Year. Presishare: Opportunistic Sharing and Presentation of Content Using Public Displays and Qr Codes. In Proceedings of Proceedings of the 2nd ACM International Symposium on Pervasive Displays. ACM, 103--108.

Digital Library

[11]

Luke Hespanhol, Martin Tomitsch, Kazjon Grace, Anthony Collins and Judy Kay. Year. Investigating Intuitiveness and Effectiveness of Gestures for Free Spatial Interaction with Large Displays. In Proceedings of Proceedings of the 2012 International Symposium on Pervasive Displays. ACM, 6.

Digital Library

[12]

Akito Hyakutake, Koichiro Ozaki, Kris Makoto Kitani and Hideki Koike. Year. 3-D Interaction with a Large Wall Display Using Transparent Markers. In Proceedings of Proceedings of the International Conference on Advanced Visual Interfaces. ACM, 97--100.

Digital Library

[13]

Sanshzar Kettebekov and Rajeev Sharma. 2001. Toward Natural Gesture/Speech Control of a Large Display. Engineering for human-computer interaction, 221--234.

Digital Library

[14]

Kento Miyaoku, Suguru Higashino and Yoshinobu Tonomura. 2004. C-Blink: A Hue-Difference-Based Light Signal Marker for Large Screen Interaction Via Any Mobile Terminal. In Proceedings of Proceedings of the 17th annual ACM symposium on User interface software and technology. ACM, Santa Fe, NM, USA, 147--156.

Digital Library

[15]

Kari-Jouko Räihä and Oleg Špakov. Year. Disambiguating Ninja Cursors with Eye Gaze. In Proceedings of Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1411--1414.

Digital Library

[16]

Jayson Turner, Jason Alexander, Andreas Bulling, Dominik Schmidt and Hans Gellersen. 2013. Eye Pull, Eye Push: Moving Objects between Large Screens and Personal Devices with Gaze and Touch. In Human-Computer Interaction - Interact 2013: 14th Ifip Tc 13 International Conference, Cape Town, South Africa, September 2--6, 2013, Proceedings, Part Ii, Paula Kotzé et al. Eds. Springer Berlin Heidelberg, Berlin, Heidelberg, 170--186.

[17]

Daniel Vogel and Ravin Balakrishnan. Year. Distant Freehand Pointing and Clicking on Very Large, High Resolution Displays. In Proceedings of Proceedings of the 18th annual ACM symposium on User interface software and technology. ACM, 33--42.

Digital Library

[18]

Zhiwei Zhu and Qiang Ji. 2004. Eye and Gaze Tracking for Interactive Graphic Display. Machine Vision and Applications 15, 3, 139--148.

Digital Library

Cited By

Nguyen NZuniga ALee HHui PFlores HNurmi P(2020)(M)ad to See Me?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33973244:2(1-26)Online publication date: 15-Jun-2020
https://dl.acm.org/doi/10.1145/3397324
Nguyen NLee H(2019)Understanding Usability Challenges in Shifting between Multiple Devices during a Task2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)10.1109/PERCOMW.2019.8730756(3-8)Online publication date: Mar-2019
https://doi.org/10.1109/PERCOMW.2019.8730756
Nguyen NLee H(2019)Device Transition: Understanding Usability Issues in Shifting a Device During a TaskDesign, User Experience, and Usability. User Experience in Advanced Technological Environments10.1007/978-3-030-23541-3_14(178-191)Online publication date: 3-Jul-2019
https://doi.org/10.1007/978-3-030-23541-3_14
Show More Cited By

Index Terms

'Hop-to-select' traverse with gestural input in an eye-off interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input
  2. Interaction design

Recommendations

Touchless gestural interaction with small displays: a case study
CHItaly '13: Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI

Touchless gestural interaction enables users to interact with digital devices using body movements and gestures, and without the burden of a physical contact with technology (e.g., data gloves, body markers, or remote controllers). Most gesture-based ...
The effects of mobility, encumbrance, and (non-)dominant hand on interaction with smartwatches
ISWC '17: Proceedings of the 2017 ACM International Symposium on Wearable Computers

Smartwatches are designed for short interactions in varying mobile contexts. However little data is available on how present mobile conditions affect interaction with these devices. In this work, we investigate the effects of mobility (walking), ...
Text entry tap accuracy and exploration of tilt controlled layered interaction on Smartwatches
MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services

Design of text entry on small screen devices, e.g. smartwatches, faces two related challenges: trading off a reasonably sized keyboard area against space to display the entered text and the concern over "fat fingers". This paper investigates tap ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '17: Proceedings of the 29th Australian Conference on Computer-Human Interaction

November 2017

678 pages

ISBN:9781450353793

DOI:10.1145/3152771

Conference Chair:
Margot Brereton
Queensland University of Technology
,
Editors:
Alessandro Soro
Queensland University of Technology
,
Dhaval Vyas
Queensland University of Technology
,
Bernd Ploderer
Queensland University of Technology
,
Ann Morrison
University of Southern Queensland
,
Jenny Waycott
University of Melbourne
,
Margot Brereton
Queensland University of Technology

Copyright © 2017 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2017

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

OzCHI '17

OzCHI '17: 29th Australian Conference on Human-Computer Interaction

November 28 - December 1, 2017

Queensland, Brisbane, Australia

Acceptance Rates

OzCHI '17 Paper Acceptance Rate 74 of 157 submissions, 47%;

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
94
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nguyen NZuniga ALee HHui PFlores HNurmi P(2020)(M)ad to See Me?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33973244:2(1-26)Online publication date: 15-Jun-2020
https://dl.acm.org/doi/10.1145/3397324
Nguyen NLee H(2019)Understanding Usability Challenges in Shifting between Multiple Devices during a Task2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops)10.1109/PERCOMW.2019.8730756(3-8)Online publication date: Mar-2019
https://doi.org/10.1109/PERCOMW.2019.8730756
Nguyen NLee H(2019)Device Transition: Understanding Usability Issues in Shifting a Device During a TaskDesign, User Experience, and Usability. User Experience in Advanced Technological Environments10.1007/978-3-030-23541-3_14(178-191)Online publication date: 3-Jul-2019
https://doi.org/10.1007/978-3-030-23541-3_14
Nguyen NLee H(2018)SocioCon: A Social Circle for Your Interactive DevicesDesign, User Experience, and Usability: Designing Interactions10.1007/978-3-319-91803-7_47(623-639)Online publication date: 15-Jul-2018
https://dl.acm.org/doi/10.1007/978-3-319-91803-7_47

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents