short-paper

Correlation between gaze and hovers during decision-making interaction

Authors:

Pierre Weill-Tessier,

Hans GellersenAuthors Info & Claims

ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

Article No.: 5, Pages 1 - 5

https://doi.org/10.1145/3204493.3204567

Published: 14 June 2018 Publication History

Abstract

Taps only consist of a small part of the manual input when interacting with touch-enabled surfaces. Indeed, how the hand behaves in the hovering space is informative of what the user intends to do. In this article, we present a data collection related to hand and eye motion. We tailored a kiosk-like system to record participants' gaze and hand movements. We specifically designed a memory game to detect the decision-making process users may face. Our data collection comprises of 177 trials from 71 participants. Based on a hand movement classification, we extracted 16588 hovers. We study the gaze behaviour during hovers, and we found out that the distance between gaze and hand depends on the target's location on the screen. We also showed how indecision can be deducted from this distance.

References

[1]

Arwa Alabdulkarim. 2014. Towards Hand-Gesture Frustration Detection in Interactive Systems. In 2014 3rd International Conference on User Science and Engineering (i-USEr). 153--157.

[2]

Robert B. Allen. 1997. Mental Models and User Models. In Handbook of Human-Computer Interaction. Elsevier, 49--63.

[3]

Cristian B Calderon, Tom Verguts, and Wim Gevers. 2015. Losing the Boundary: Cognition Biases Action Well After Action Selection. Journal of Experimental Psychology-General 144, 4 (2015), 737--743.

[4]

Craig S. Chapman, Jason P. Gallivan, Daniel K. Wood, Jennifer L. Milne, Jody C. Culham, and Melvyn A. Goodale. 2010. Reaching for the Unknown: Multiple Target Encoding and Real-Time Decision-Making in a Rapid Reach Task. Cognition 116, 2 (aug 2010), 168--176.

[5]

David R. Coghill, Sarah Seth, and Keith Matthews. 2014. A Comprehensive Assessment of Memory, Delay Aversion, Timing, Inhibition, Decision Making and Variability in Attention Deficit Hyperactivity Disorder: Advancing Beyond the Three-Pathway Models. Psychological Medicine 44, 9 (jul 2014), 1989--2001.

[6]

Gerhard Fischer. 2001. User Modeling in Human-Computer Interaction. User Modeling and User-Adapted Interaction 11, 1 (01 Mar 2001), 65--86.

Digital Library

[7]

Paul M. Fitts and Barbara K. Radford. 1966. Information Capacity of Discrete Motor Responses under Different Cognitive Sets. (1966), 475--482 pages.

[8]

Cleotilde Gonzalez. 1996. Does Animation in User Interfaces Improve Decision Making?. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '96). ACM, New York, NY, USA, 27--34.

Digital Library

[9]

Philip Isola, Jianxiong Xiao, Antonio Torralba, and Aude Oliva. 2011. What Makes an Image Memorable?. In CVPR 2011. 145--152.

Digital Library

[10]

Roger Johansson and Mikael Johansson. 2014. Look Here, Eye Movements Playa Functional Role in Memory Retrieval. Psychological Science 25, 1 (2014), 236--242. 24166856.

[11]

Yannick Lufimpu-Luviya, Djamel Merad, Sebastien Paris, Véronique Drai-Zerbib, Thierry Baccino, and Bernard Fertil. 2013. A Regression-based Method for the Prediction of the Indecisiveness Degree Through Eye Movement Patterns. In Proceedings of the 2013 Conference on Eye Tracking South Africa (ETSA '13). ACM, New York, NY, USA, 32--38.

Digital Library

[12]

David E. Meyer, J. E. Keith-Smith, Sylvan Kornblum, Richard A. Abrams, and Charles E. Wright. 1990. Speed-Accuracy Tradeoffs in Aimed Movements: Toward a Theory of Rapid Voluntary Action. In Attention and Performance 13: Motor Representation and Control. Lawrence Erlbaum Associates, Inc, Hillsdale, NJ, US, 173--226.

[13]

Dragana Micic, Howard Ehrlichman, and Rebecca Chen. 2010. Why Do We Move Our Eyes While Trying To Remember? The Relationship Between Non-Visual Gaze Patterns and Memory. Brain and Cognition 74, 3 (2010), 210 -- 224.

[14]

AJung Moon, Chris A. C. Parker, Elizabeth A. Croft, and Hendrik F. M. Van der Loos. 2011. Did You See It Hesitate? - Empirically Grounded Design of Hesitation Trajectories for Collaborative Robots. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. 1994--1999.

[15]

Xiangwei Mu, Yan Chen, Jian Yang, and Jingjing Jiang. 2010. An Improved Similarity Algorithm Based on Hesitation Degree for User-based Collaborative Filtering. In Proceedings of the 5th International Conference on Advances in Computation and Intelligence (ISICA'10). Springer-Verlag, Berlin, Heidelberg, 261--271. http://dl.acm.org/citation.cfm?id=1926680.1926712

Digital Library

[16]

Andrea L. Patalano, Barbara J. Juhasz, and Joanna Dicke. 2010. The Relationship Between Indecisiveness and Eye Movement Patterns in a Decision Making Informational Search Task. Journal of Behavioral Decision Making 23, 4 (2010), 353--368.

[17]

Joo-Hyun Song and Ken Nakayama. 2009. Hidden Cognitive States Revealed in Choice Reaching Tasks. Trends in Cognitive Sciences 13, 8 (2009), 360--366.

[18]

Tobias Tempel and Christian Frings. 2016. How Motor Practice Shapes Memory: Retrieval But Not Extra Study Can Cause Forgetting. Memory (Hove, England) 24, 7 (aug 2016), 903--915.

[19]

Tomaž Vodlan and Andrej Košir. 2015. Methodology for Transformation of Behavioural Cues into Social Signals in Human-Computer Interaction. In Handbook of Research on Interactive Information Quality in Expanding Social Network Communications, Francisco V Cipolla-Ficarra (Ed.). IGI Global, 104--118.

[20]

Tomaž Vodlan, Marko Tkalčič, and Andrej Košir. 2015. The Impact of Hesitation, a Social Signal, on a User's Quality of Experience in Multimedia Content Retrieval. Multimedia Tools Appl. 74, 17 (sep 2015), 6871--6896.

Digital Library

[21]

Daniel Vogel and Ravin Balakrishnan. 2005. Distant Freehand Pointing and Clicking on Very Large, High Resolution Displays. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05). ACM, New York, NY, USA, 33--42.

Digital Library

[22]

Pierre Weill-Tessier, Jayson Turner, and Hans Gellersen. 2016. How Do You Look at What You Touch?: A Study of Touch Interaction and Gaze Correlation on Tablets. In Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications (ETRA '16). ACM, New York, NY, USA, 329--330.

Digital Library

[23]

Wayne W. Zachary and Joan M. Ryder. 1997. Chapter 52 - Decision Support Systems: Integrating Decision Aiding And Decision Training. Handbook of Human-Computer Interaction (1997), 1235--1258.

Cited By

Kaduk TGoeke CFinger HKönig P(2023)Webcam eye tracking close to laboratory standards: Comparing a new webcam-based system and the EyeLink 1000Behavior Research Methods10.3758/s13428-023-02237-856:5(5002-5022)Online publication date: 11-Oct-2023
https://doi.org/10.3758/s13428-023-02237-8
Gursesli MCalà FTarchi PFrassineti LGuazzini ALanatà A(2023)Eyetracking Correlated in the Matching Pairs Game2023 IEEE Gaming, Entertainment, and Media Conference (GEM)10.1109/GEM59776.2023.10390418(1-6)Online publication date: 19-Nov-2023
https://doi.org/10.1109/GEM59776.2023.10390418
Liu JWang PTversky BFeiner S(2022)Adaptive Visual Cues for Guiding a Bimanual Unordered Task in Virtual Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00059(431-440)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00059
Show More Cited By

Index Terms

Correlation between gaze and hovers during decision-making interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models

Recommendations

Gaze behaviour on interacted objects during hand interaction in virtual reality for eye tracking calibration
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

In this paper, we investigate the probability and timing of attaining gaze fixations on interacted objects during hand interaction in virtual reality, with the main purpose for implicit and continuous eye tracking re-calibration. We conducted an ...
Gaze and Touch Interaction on Tablets
UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

We explore how gaze can support touch interaction on tablets. When holding the device, the free thumb is normally limited in reach, but can provide an opportunity for indirect touch input. Here we propose gaze and touch input, where touches redirect to ...
Evaluation of eye gaze interaction
CHI '00: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

Eye gaze interaction can provide a convenient and natural addition to user-computer dialogues. We have previously reported on our interaction techniques using eye gaze [10]. While our techniques seemed useful in demonstration, we now investigate their ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

June 2018

595 pages

ISBN:9781450357067

DOI:10.1145/3204493

Conference Chairs:
Bonita Sharif
Youngstown State University
,
Krzysztof Krejtz
University of Social Sciences and Humanities, Warsaw, Poland

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ETRA '18

Sponsor:

ETRA '18: 2018 Symposium on Eye Tracking Research and Applications

June 14 - 17, 2018

Warsaw, Poland

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
307
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)2

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kaduk TGoeke CFinger HKönig P(2023)Webcam eye tracking close to laboratory standards: Comparing a new webcam-based system and the EyeLink 1000Behavior Research Methods10.3758/s13428-023-02237-856:5(5002-5022)Online publication date: 11-Oct-2023
https://doi.org/10.3758/s13428-023-02237-8
Gursesli MCalà FTarchi PFrassineti LGuazzini ALanatà A(2023)Eyetracking Correlated in the Matching Pairs Game2023 IEEE Gaming, Entertainment, and Media Conference (GEM)10.1109/GEM59776.2023.10390418(1-6)Online publication date: 19-Nov-2023
https://doi.org/10.1109/GEM59776.2023.10390418
Liu JWang PTversky BFeiner S(2022)Adaptive Visual Cues for Guiding a Bimanual Unordered Task in Virtual Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00059(431-440)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00059
Lewien R(2021)GazeHelp: Exploring Practical Gaze-assisted Interactions for Graphic Design ToolsACM Symposium on Eye Tracking Research and Applications10.1145/3450341.3458764(1-4)Online publication date: 25-May-2021
https://dl.acm.org/doi/10.1145/3450341.3458764
Wolf JLohmeyer QHolz CMeboldt M(2021)Gaze Comes in Handy: Predicting and Preventing Erroneous Hand Actions in AR-Supported Manual Tasks2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR52148.2021.00031(166-175)Online publication date: Oct-2021
https://doi.org/10.1109/ISMAR52148.2021.00031

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten