research-article

Pursuits: spontaneous interaction with displays based on smooth pursuit eye movement and moving targets

Authors:

Mélodie Vidal,

Andreas Bulling,

Hans GellersenAuthors Info & Claims

UbiComp '13: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing

Pages 439 - 448

https://doi.org/10.1145/2493432.2493477

Published: 08 September 2013 Publication History

Abstract

Although gaze is an attractive modality for pervasive interactions, the real-world implementation of eye-based interfaces poses significant challenges, such as calibration. We present Pursuits, an innovative interaction technique that enables truly spontaneous interaction with eye-based interfaces. A user can simply walk up to the screen and readily interact with moving targets. Instead of being based on gaze location, Pursuits correlates eye pursuit movements with objects dynamically moving on the interface. We evaluate the influence of target speed, number and trajectory and develop guidelines for designing Pursuits-based interfaces. We then describe six realistic usage scenarios and implement three of them to evaluate the method in a usability study and a field study. Our results show that Pursuits is a versatile and robust technique and that users can interact with Pursuits-based interfaces without prior knowledge or preparation phase.

References

[1]

R. Ballagas, M. Rohs, and J. G. Sheridan. Sweep and point and shoot: phonecam-based interactions for large public displays. In CHI EA '05, pages 1200--1203, 2005. ACM.

Digital Library

[2]

A. Bulling, F. Alt, and A. Schmidt. Increasing the security of gaze-based cued-recall graphical passwords using saliency masks. In CHI '12, pages 3011--3020, 2012. ACM.

Digital Library

[3]

K. Cheverst, A. Dix, D. Fitton, C. Kray, M. Rouncefield, C. Sas, G. Saslis-Lagoudakis, and J. G. Sheridan. Exploring bluetooth based mobile phone interaction with the hermes photo display. In MobileHCI '05, pages 47--54, 2005. ACM.

Digital Library

[4]

H. Drewes and A. Schmidt. Interacting with the computer using gaze gestures. In INTERACT '07, pages 475--488. Springer, 2007.

Digital Library

[5]

J.-D. Fekete, N. Elmqvist, and Y. Guiard. Motion-pointing: target selection using elliptical motions. In CHI '09, pages 289--298. ACM, 2009.

Digital Library

[6]

D. Fono and R. Vertegaal. Eyewindows: evaluation of eye-controlled zooming windows for focus selection. In CHI '05, pages 151--160. ACM, 2005.

Digital Library

[7]

K. R. Gegenfurtner, D. Xing, B. H. Scott, and M. J. Hawken. A comparison of pursuit eye movement and perceptual performance in speed discrimination. Journal of Vision, 3:865--876, 2003.

[8]

T. J. Gunn, P. Irani, and J. Anderson. An evaluation of techniques for selecting moving targets. In CHI EA '09, pages 3329--3334, 2009. ACM.

Digital Library

[9]

D. W. Hansen, H. H. T. Skovsgaard, J. P. Hansen, and E. Møllenbach. Noise tolerant selection by gaze-controlled pan and zoom in 3d. In Proc. of the Symposium on Eye Tracking Research and Applications, ETRA '08, pages 205--212. ACM, 2008.

Digital Library

[10]

A. Hyrskykari, H. Istance, and S. Vickers. Gaze gestures or dwell-based interaction? In Proc. of the Symposium on Eye Tracking Research and Applications, ETRA '12, pages 229--232, 2012. ACM.

Digital Library

[11]

M. P. Hyrskykari, A. and K.-J. Räihä. From gaze control to attentive interfaces. In Proc. of HCII. Lawrence Erlbaum Associates, 2005.

[12]

R. J. K. Jacob. What you look at is what you get: eye movement-based interaction techniques. In CHI '90, pages 11--18. ACM, 1990.

Digital Library

[13]

R. Johnson, K. O'Hara, A. Sellen, C. Cousins, and A. Criminisi. Exploring the potential for touchless interaction in image-guided interventional radiology. In CHI'11, pages 3323--3332. ACM.

Digital Library

[14]

R. J. Leigh and D. S. Zee. The neurology of eye movements, chapter 3. Number 55 in Contemporary neurology series. FA Davis, 2 edition, 1991.

[15]

P. Maglio, T. Matlock, C. Campbell, S. Zhai, and B. Smith. Gaze and speech in attentive user interfaces. In T. Tan, Y. Shi, and W. Gao, editors, Advances in Multimodal Interfaces -- ICMI 2000, volume 1948 of Lecture Notes in Computer Science, pages 1--7. Springer Berlin Heidelberg, 2000.

Digital Library

[16]

D. Miniotas, O.vSpakov, and I. S. MacKenzie. Eye gaze interaction with expanding targets. In CHI EA '04, pages 1255--1258, 2004. ACM.

Digital Library

[17]

D. Mould and C. Gutwin. The effects of feedback on targeting with multiple moving targets. In GI '04, pages 25--32, 2004. Canadian Human-Computer Communications Society.

Digital Library

[18]

A. Pavlovych and W. Stuerzlinger. Target following performance in the presence of latency, jitter, and signal dropouts. In GI '11, pages 33--40, 2011. Canadian Human-Computer Communications Society.

Digital Library

[19]

P. Peltonen, E. Kurvinen, A. Salovaara, G. Jacucci, T. Ilmonen, J. Evans, A. Oulasvirta, and P. Saarikko. It's mine, don't touch!: interactions at a large multi-touch display in a city centre. In CHI '08, pages 1285--1294, 2008. ACM.

Digital Library

[20]

K. Rayner. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, pages 372--422, 1998.

[21]

D. Robinson. The mechanics of human smooth pursuit eye movement. The Journal of Physiology, 180(3):569--591, Oct. 1965.

[22]

R. Ruddarraju, A. Haro, K. Nagel, Q. T. Tran, I. A. Essa, G. Abowd, and E. D. Mynatt. Perceptual user interfaces using vision-based eye tracking. In Proc. of the 5th international conference on Multimodal interfaces, ICMI '03, pages 227--233, 2003. ACM.

Digital Library

[23]

J. S. Shell, R. Vertegaal, and A. W. Skaburskis. Eyepliances: attention-seeking devices that respond to visual attention. In CHI EA '03, pages 770--771, 2003. ACM.

Digital Library

[24]

L. E. Sibert and R. J. K. Jacob. Evaluation of eye gaze interaction. In CHI '00, pages 281--288, 2000. ACM.

Digital Library

[25]

S. Stellmach and R. Dachselt. Look & touch: gaze-supported target acquisition. In CHI '12, pages 2981--2990. ACM, 2012.

Digital Library

[26]

O. Tuisku, P. Majaranta, P. Isokoski, and K.-J. R\"aih\"a. Now dasher! dash away!: longitudinal study of fast text entry by eye gaze. In Proc. of the Symposium on Eye tracking Research and Applications, ETRA '08, pages 19--26, 2008. ACM.

Digital Library

[27]

R. Vertegaal. Attentive user interfaces. Commun. ACM, 46(3):30--33, Mar. 2003.

Digital Library

[28]

D. Vogel and R. Balakrishnan. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In UIST '04, pages 137--146, 2004. ACM.

Digital Library

[29]

S. Zhai, C. Morimoto, and S. Ihde. Manual and gaze input cascaded (magic) pointing. In CHI '99, pages 246--253, 1999. ACM.

Digital Library

[30]

Y. Zhang, A. Bulling, and H. Gellersen. Sideways: A gaze interface for spontaneous interaction with situated displays. In CHI'13, 2013. ACM.

Digital Library

Cited By

Emile Tatinyuy VNoumsi Woguia Angono JFONO L(2024)Multi-stage gaze-controlled virtual keyboard using eye trackingPLOS ONE10.1371/journal.pone.030983219:10(e0309832)Online publication date: 28-Oct-2024
https://doi.org/10.1371/journal.pone.0309832
Han MOakley IKostakos VKay JHoang T(2024)EyeWithShut: Exploring Closed Eye Features to Estimate Eye PositionCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677605(157-161)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677605
Hamid AKristensson P(2024)40 Years of Eye Typing: Challenges, Gaps, and Emergent StrategiesProceedings of the ACM on Human-Computer Interaction10.1145/36555968:ETRA(1-19)Online publication date: 28-May-2024
https://dl.acm.org/doi/10.1145/3655596
Show More Cited By

Index Terms

Pursuits: spontaneous interaction with displays based on smooth pursuit eye movement and moving targets
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Pursuits: eye-based interaction with moving targets
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Eye-based interaction has commonly been based on estimation of eye gaze direction, to locate objects for interaction. We introduce Pursuits, a novel and very different eye tracking method that instead is based on following the trajectory of eye movement ...
Smooth-i: smart re-calibration using smooth pursuit eye movements
ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

Eye gaze for interaction is dependent on calibration. However, gaze calibration can deteriorate over time affecting the usability of the system. We propose to use motion matching of smooth pursuit eye movements and known motion on the display to ...
Pursuits: Spontaneous Eye-Based Interaction for Dynamic Interfaces

Although gaze is an attractive modality for pervasive interaction, real-world implementation of eye-based interfaces poses significant challenges. In particular, user calibration is tedious and time consuming. Pursuits is an innovative interaction ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp '13: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing

September 2013

846 pages

ISBN:9781450317702

DOI:10.1145/2493432

General Chairs:
Friedemann Mattern
ETH Zurich, CH
,
Silvia Santini
TU Darmstadt, DE
,
Program Chairs:
John F. Canny
UC Berkeley, US
,
Marc Langheinrich
Università della Svizzera italiana, CH
,
Jun Rekimoto
University of Tokyo, JP

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing
University of Florida: University of Florida
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

In-Cooperation

SIGSPATIAL: ACM Special Interest Group on Spatial Information

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UbiComp '13

Sponsor:

SIGMOBILE
University of Florida
SIGCHI

UbiComp '13: The 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 8 - 12, 2013

Zurich, Switzerland

Acceptance Rates

UbiComp '13 Paper Acceptance Rate 92 of 394 submissions, 23%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

222
Total Citations
View Citations
2,238
Total Downloads

Downloads (Last 12 months)164
Downloads (Last 6 weeks)21

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Emile Tatinyuy VNoumsi Woguia Angono JFONO L(2024)Multi-stage gaze-controlled virtual keyboard using eye trackingPLOS ONE10.1371/journal.pone.030983219:10(e0309832)Online publication date: 28-Oct-2024
https://doi.org/10.1371/journal.pone.0309832
Han MOakley IKostakos VKay JHoang T(2024)EyeWithShut: Exploring Closed Eye Features to Estimate Eye PositionCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677605(157-161)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677605
Hamid AKristensson P(2024)40 Years of Eye Typing: Challenges, Gaps, and Emergent StrategiesProceedings of the ACM on Human-Computer Interaction10.1145/36555968:ETRA(1-19)Online publication date: 28-May-2024
https://dl.acm.org/doi/10.1145/3655596
Manakhov PSidenmark LPfeuffer KGellersen H(2024)Gaze on the Go: Effect of Spatial Reference Frame on Visual Target Acquisition During Physical Locomotion in Extended RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642915(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642915
Lee HWeidner FSidenmark LGellersen H(2024)Snap, Pursuit and Gain: Virtual Reality Viewport Control by GazeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642838(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642838
Reddy GProulx MHirshfield LRies A(2024)Towards an Eye-Brain-Computer Interface: Combining Gaze with the Stimulus-Preceding Negativity for Target Selections in XRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641925(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641925
Orlosky JLiu CSakamoto KSidenmark LMansour A(2024)EyeShadows: Peripheral Virtual Copies for Rapid Gaze Selection and Interaction2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00088(681-689)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00088
Lai YSun MLi Z(2024)GazePuffer: Hands-Free Input Method Leveraging Puff Cheeks for VR2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00055(331-341)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00055
Manakhov PSidenmark LPfeuffer KGellersen H(2024)Filtering on the Go: Effect of Filters on Gaze Pointing Accuracy During Physical Locomotion in Extended RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345615330:11(7234-7244)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456153
Murnani SSetiawan NWibirama S(2024)Robust Object Selection in Spontaneous Gaze-Controlled Application Using Exponential Moving Average and Hidden Markov ModelIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.341378154:5(485-498)Online publication date: Oct-2024
https://doi.org/10.1109/THMS.2024.3413781
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents