Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3332165.3347880acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

Modeling the Uncertainty in 2D Moving Target Selection

Published: 17 October 2019 Publication History

Abstract

Understanding the selection uncertainty of moving targets is a fundamental research problem in HCI. However, the only few works in this domain mainly focus on selecting 1D moving targets with certain input devices, where the model generalizability has not been extensively investigated. In this paper, we propose a 2D Ternary-Gaussian model to describe the selection uncertainty manifested in endpoint distribution for moving target selection. We explore and compare two candidate methods to generalize the problem space from 1D to 2D tasks, and evaluate their performances with three input modalities including mouse, stylus, and finger touch. By applying the proposed model in assisting target selection, we achieved up to 4% improvement in pointing speed and 41% in pointing accuracy compared with two state-of-the-art selection technologies. In addition, when we tested our model to predict pointing errors in a realistic user interface, we observed high fit of 0.94 R2.

Supplementary Material

MP4 File (ufp2542pv.mp4)
Preview video
MP4 File (p1031-huang.mp4)

References

[1]
Brouwer A M, Middelburg T, Smeets J B J, et al. 2003. Hitting moving targets: A dissociation between the use of the target's speed and direction of motion. Experimental Brain Research. 152, 3, 368--375. http://dx.doi.org/10.1007/s00221-003--1556--8
[2]
Brouwer A, Brenner E, Smeets J B, et al. 2002. Hitting moving objects: is target speed used in guiding the hand. Experimental Brain Research, 143, 2, 198--211. http://dx.doi.org/10.1007/s00221-001-0980-x
[3]
Johnny Accot and Shumin Zhai. 1997. Beyond Fitts' law: models for trajectory-based HCI tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '97), 295--302. http://dx.doi.org/10.1145/1120212.1120376
[4]
Johnny Accot and Shumin Zhai. 1999. Performance evaluation of input devices in trajectory-based tasks: an application of the steering law. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '99), 466--472. http://dx.doi.org/10.1145/302979.303133
[5]
Johnny Accot and Shumin Zhai. 2003. Refining Fitts' law models for bivariate pointing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03), 193--200. http://dx.doi.org/10.1145/642611.642646
[6]
Johnny Accot and Shumin Zhai. 2002. More than dotting the i's --foundations for crossing-based interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02), 73--80. http://dx.doi.org/10.1145/503376.503390
[7]
Eli Brenner, Jeroen B J Smeets,. 1996. Hitting moving targets: Co-operative control of when'and 'where', Human Movement Science. 15, 1, 39--53. http://dx.doi.org/10.1016/0167--9457(95)00036--4
[8]
Watson A B, Robson J G. 1981. Discrimination at threshold: labelled detectors in human vision. Vision Res, 21, 1115--1122. http://dx.doi.org/10.1016/0042--6989(81)90014--6
[9]
Watson, A. B., & Ahumada, A. J. 1985. Model of human visual-motion sensing. Journal of The Optical Society of America A-optics Image Science and Vision, 2, 2, 322--342. http://dx.doi.org/10.1364/JOSAA.2.000322
[10]
Xiaojun Bi, Yang Li and Shumin Zhai. 2013. FFitts law: modeling finger touch with fitts' law. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 1363--1372. http://dx.doi.org/10.1145/2470654.2466180
[11]
Xiaojun Bi and Shumin Zhai. 2013. Bayesian touch: a statistical criterion of target selection with finger touch. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13), 51--60. http://dx.doi.org/10.1145/2501988.2502058
[12]
Crossman E, Goodeve P J. 1983. Feedback control of hand-movement and Fitts' law. The Quarterly Journal of Experimental Psychology Section A, 35, 2, 251--278. http://dx.doi.org/10.1080/14640748308402133
[13]
Todorov Emanuel and Jordan I. Michael. 2002. Optimal feedback control as a theory of motor coordination. Nature Neuroscience. 5, 11 (November 2002), 1226--1235. http://dx.doi.org/10.1038/nn963
[14]
Paul M Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of experimental psychology, 47, 6 (Jun 1954), 381--391. http://dx.doi.org/10.1037/h0055392
[15]
Francis G, Kim H. 2001. Perceived motion in orientational afterimages: direction and speed, Vision research. 41, 2, 161--172. http://dx.doi.org/10.1016/S0042--6989(00)00242-X
[16]
Stépán, Gábor. 2009. Delay effects in the human sensory system during balancing. Philosophical transactions. Series A, Mathematical, physical, and engineering sciences. 367, 1195--212. http://dx.doi.org/10.1098/rsta.2008.0278
[17]
Schweigart G, Mergner T, Barnes G. 2003. Object motion perception is shaped by the motor control mechanism of ocular pursuit. Experimental brain research, 148, 3, 350--365. http://dx.doi.org/10.1007/s00221-002--1306--3
[18]
Tovi Grossman and Ravin Balakrishnan. 2004. Pointing at trivariate targets in 3D environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04), 447--454. http://dx.doi.org/10.1145/985692.985749
[19]
Tovi Grossman and Ravin Balakrishnan. 2005. The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05), 281--290. http://dx.doi.org/10.1145/1054972.1055012
[20]
Errol R. Hoffmann. 1991. Capture of moving targets: a modification of Fitts' Law. Ergonomics, 34, 2, 211--220. http://dx.doi.org/10.1080/00140139108967307
[21]
Khalad Hasan, Tovi Grossman and Pourang Irani. 2011. Comet and target ghost: techniques for selecting moving targets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 839--848. http://dx.doi.org/10.1145/1978942.1979065
[22]
Jin Huang, Feng Tian, Xiangmin Fan, Xiaolong (Luke) Zhang, and Shumin Zhai. 2018. Understanding the Uncertainty in 1D Unidirectional Moving Target Selection. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), ACM, to be determined. http://dx.doi.org/10.1145/3173574.3173811
[23]
Jin Huang, Xiaolan Peng, Feng Tian, Hongan Wang, and Guozhong Dai. 2018. Modeling a target-selection motion by leveraging an optimal feedback control mechanism. Science in China Series F: Information Sciences 61, 4 (2018), 044101. http://dx.doi.org/10.1007/s11432-017--9326--8
[24]
Bairstow P J. 1987. Analysis of hand movement to moving targets. Hum Mov Sci, 6, 205--231. http://dx.doi.org/10.1016/0167--9457(87)90013--3
[25]
Bootsma R J, Wieringen PCW van. 1990. Timing an attacking forehand drive in table tennis. J Exp Psychol Hum Percep Perform, 16, 21--29. http://dx.doi.org/10.1037//0096--1523.16.1.21
[26]
Richard J. Jagacinski, Daniel W. Repperger, Sharon L. Ward and Martin S. Moran. 1980. A test of Fitts' law with moving targets. Human Factors: The Journal of the Human Factors and Ergonomics Society, 22, 2 (April 1980), 225--233. http://dx.doi.org/10.1177/001872088002200211
[27]
Nakayama K. 1985. Biological image motion processing: a review. Vision research, 25, 5, 625--660. http://dx.doi.org/10.1016/0042--6989(85)90171--3
[28]
Byungjoo Lee and Antti Oulasvirta. 2016. Modelling Error Rates in Temporal Pointing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 1857--1868. http://dx.doi.org/10.1145/2858036.2858143
[29]
Byungjoo Lee, Sunjun Kim, and Antti Oulasvirta. 2018. Moving Target Selection: A Cue Integration Model. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), to appear. http://dx.doi.org/10.1145/3173574.3173804
[30]
Atsuo Murata and Hirokazu Iwase. 2001. Extending Fitts' law to a three-dimensional pointing task. Human Movement Science, 20, 6 (December 2001), 791--805. http://dx.doi.org/10.1016/S0167--9457(01)00058--6
[31]
I Scott MacKenzie and Poika Isokoski. 2008. Fitts' throughput and the speed-accuracy tradeoff. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08), 1633--1636. http://dx.doi.org/10.1145/1357054.1357308
[32]
Matthews N, Luber B, Qian N, et al. 2001. Transcranial magnetic stimulation differentially affects speed and direction judgments. Experimental Brain Research, 140, 4, 397--406. http://dx.doi.org/10.1007/s002210100837
[33]
Thompson P. 1983. Discrimination of moving gratings at and above detection threshold. Vision Res, 23, 1533--1538. http://dx.doi.org/10.1016/0042--6989(83)90166--9
[34]
Senanayake R, Goonetilleke R S. 2016. Pointing Device Performance in Steering Tasks. Perceptual and Motor Skills, 122, 3, 886--910. http://dx.doi.org/10.1177/0031512516649717
[35]
Paul N. Somerville. 1999. A Fortran 90 Program for Evaluation of Multivariate Normal and Multivariate t Integrals Over Convex Regions. Journal of Statistical Software. 3, 4, 1--10. http://dx.doi.org/10.18637/jss.v003.i04
[36]
Jeroen B J Smeets, Eli Brenner. 1995. Perception and action are based on the same visual information: distinction between position and velocity. Journal of Experimental Psychology: Human Perception and Performance, 21, 1, 19. http://dx.doi.org/10.1037//0096--1523.21.1.19
[37]
Mackenzie I S. 2015. Fitts' Throughput and the Remarkable Case of Touch-Based Target Selection. International conference on human-computer interaction, 238--249. http://dx.doi.org/10.1007/978--3--319--20916--6_23
[38]
MacKenzie, I. S. 1992. Fitts' law as a research and design tool in human-computer interaction. Human-Computer Interaction, 7, 91--139. http://dx.doi.org/10.1207/s15327051hci0701_3
[39]
Jacob O. Wobbrock, Edward Cutrell, Susumu Harada and I. Scott MacKenzie. 2008. An error model for pointing based on Fitts' law. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08), 1613--1622. http://dx.doi.org/10.1145/1357054.1357306
[40]
Jacob O Wobbrock, Alex Jansen, and Kristen Shinohara. 2011. Modeling and predicting pointing errors in two dimensions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 1653--1656. http://dx.doi.org/10.1145/1978942.1979183
[41]
Jacob O. Wobbrock, Edward Cutrell, Susumu Harada and I. Scott MacKenzie. 2008. An error model for pointing based on Fitts' law. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08), 1613--1622. http://dx.doi.org/10.1145/1357054.1357306
[42]
Franklin D W, Wolpert D M. 2011. Computational Mechanisms of Sensorimotor Control. Neuron, 2011, 72, 3, 425--442. http://dx.doi.org/10.1016/j.neuron.2011.10.006
[43]
Zhou X, Cao X, Ren X, et al. 2009. Speed-Accuracy Tradeoff in Trajectory-Based Tasks with Temporal Constraint.In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), 906--919. http://dx.doi.org/10.1007/978--3--642-03655--2_99
[44]
Drezner, Z. 1994. Computation of the Trivariate Normal Integral. Mathematics of Computation, 63, 289--294. http://dx.doi.org/10.2307/2153409
[45]
Shumin Zhai, Jing Kong and Xiangshi Ren. 2004. Speed--accuracy tradeoff in Fitts' law tasks-on the equivalency of actual and nominal pointing precision. International Journal of Human-Computer Studies, 61, 6 (December 2004), 823--856. http://dx.doi.org/10.1016/j.ijhcs.2004.09.007
[46]
Paul N. Somerville. 1999. A Fortran 90 Program for Evaluation of Multivariate Normal and Multivariate t Integrals Over Convex Regions. Journal of Statistical Software. 3, 4, 1--10. http://dx.doi.org/10.18637/jss.v003.i04

Cited By

View all
  • (2024)0.2-mm-Step Verification of the Dual Gaussian Distribution Model with Large Sample Size for Predicting Tap Success RatesProceedings of the ACM on Human-Computer Interaction10.1145/36981538:ISS(674-693)Online publication date: 24-Oct-2024
  • (2024)Mouse Dynamics Behavioral Biometrics: A SurveyACM Computing Surveys10.1145/364031156:6(1-33)Online publication date: 24-Jan-2024
  • (2024)User Performance in Consecutive Temporal Pointing: An Exploratory StudyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642904(1-15)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology
October 2019
1229 pages
ISBN:9781450368162
DOI:10.1145/3332165
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. device factors
  2. endpoint distribution
  3. error rate
  4. moving target selection
  5. pointing accuracy

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China
  • National Key R&D Program of China
  • Key Research Program of Frontier Sciences

Conference

UIST '19

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25
The 38th Annual ACM Symposium on User Interface Software and Technology
September 28 - October 1, 2025
Busan , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)96
  • Downloads (Last 6 weeks)5
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)0.2-mm-Step Verification of the Dual Gaussian Distribution Model with Large Sample Size for Predicting Tap Success RatesProceedings of the ACM on Human-Computer Interaction10.1145/36981538:ISS(674-693)Online publication date: 24-Oct-2024
  • (2024)Mouse Dynamics Behavioral Biometrics: A SurveyACM Computing Surveys10.1145/364031156:6(1-33)Online publication date: 24-Jan-2024
  • (2024)User Performance in Consecutive Temporal Pointing: An Exploratory StudyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642904(1-15)Online publication date: 11-May-2024
  • (2024)Optimising virtual object position for efficient eye-gaze interaction in Hololens2Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization10.1080/21681163.2024.233776512:1Online publication date: 14-Apr-2024
  • (2024)HCI Research and Innovation in China: A 10-Year PerspectiveInternational Journal of Human–Computer Interaction10.1080/10447318.2024.232385840:8(1799-1831)Online publication date: 22-Mar-2024
  • (2024)Evaluating the effects of user motion and viewing mode on target selection in augmented realityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103327191(103327)Online publication date: Nov-2024
  • (2023)Supporting Aim Assistance Algorithms through a Rapidly Trainable, Personalized Model of Players’ Spatial and Temporal Aiming AbilityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581293(1-17)Online publication date: 19-Apr-2023
  • (2023)Shape-Adaptive Ternary-Gaussian Model: Modeling Pointing Uncertainty for Moving Targets of Arbitrary ShapesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581217(1-18)Online publication date: 19-Apr-2023
  • (2023)Predicting Gaze-based Target Selection in Augmented Reality Headsets based on Eye and Head Endpoint DistributionsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581042(1-14)Online publication date: 19-Apr-2023
  • (2023)Modeling Temporal Target Selection: A Perspective from Its Spatial CorrespondenceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581011(1-14)Online publication date: 19-Apr-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media