research-article

Model of visual search and selection time in linear menus

Authors:

Antti Oulasvirta,

Duncan P. Brumby,

Andrew HowesAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 3865 - 3874

https://doi.org/10.1145/2556288.2557093

Published: 26 April 2014 Publication History

Abstract

This paper presents a novel mathematical model for visual search and selection time in linear menus. Assuming two visual search strategies, serial and directed, and a pointing sub-task, it captures the change of performance with five fac- tors: 1) menu length, 2) menu organization, 3) target position, 4) absence/presence of target, and 5) practice. The novel aspect is that the model is expressed as probability density distribution of gaze, which allows for deriving total selection time. We present novel data that replicates and extends the Nielsen menu selection paradigm and uses eye-tracking and mouse tracking to confirm model predictions. The same parametrization yielded a high fit to both menu selection time and gaze distributions. The model has the potential to improve menu designs by helping designers identify more effective solutions without conducting empirical studies.

Supplementary Material

ZIP File (pn0750-file4.zip)

Download
16.49 MB

References

[1]

Ahlstroem, D., Cockburn, A., Gutwin, C., and Irani, P. Why it's quick to be square: modelling new and existing hierarchical menu designs. In CHI'10, ACM (2010), 1371--1380.

Digital Library

[2]

Anderson, J., and C., L. The Atomic Components of Thought. L. Erlbaum Associates Inc., 1998.

[3]

Anderson, J. R., Matessa, M., and Lebiere, C. Act-r: a theory of higher level cognition and its relation to visual attention. Hum.-Comput. Interact. 12, 4 (Dec. 1997), 439--462.

Digital Library

[4]

Bailly, G., Lecolinet, E., and Nigay, L. Flower menus: a new type of marking menu with large menu breadth, within groups and ef'cient expert mode memorization. In AVI '08, ACM (2008), 15--22.

Digital Library

[5]

Bailly, G., Oulasvirta, A., Timo, K., and Hoppe, S. Menuoptimizer: Interactive optimization of menu systems. In UIST'13, ACM. To appear (2013).

Digital Library

[6]

Brumby, D. P., and Howes, A. Good enough but I'll just check: web-page search as attentional refocusing. In Proceedings of the Sixth International Conference on Cognitive Modeling (2004), 46--51.

[7]

Brumby, D. P., and Howes, A. Strategies for guiding interactive search: An empirical investigation into the consequences of label relevance for assessment and selection. HumanComputer Interaction 23, 1 (2008), 1--46.

[8]

Byrne, M. Act-r/pm and menu selection: Applying a cognitive architecture to hci. IJHCS 55 (2001), 41--84.

Digital Library

[9]

Byrne, M. D., Anderson, J. R., Douglass, S., and Matessa, M. Eye tracking the visual search of click-down menus. In CHI'99, ACM (1999), 402--409.

Digital Library

[10]

Card, S. K. User perceptual mechanisms in the search of computer command menus. In CHI'82, ACM (New York, NY, USA, 1982), 190--196.

Digital Library

[11]

Card, S. K., P., T., and Newell, A. The Psychology of Human-Computer Interaction. L. Erlbaum Associates Inc., 1983.

Digital Library

[12]

Cockburn, A., and Gutwin, C. A predictive model of human performance with scrolling and hierarchical lists. HumanComputer Interaction 24, 3 (2009), 273--314.

[13]

Cockburn, A., and Gutwin, C. A model of novice and expert navigation performance in constrained-input interfaces. ACM Trans. Comput.-Hum. Interact. 17, 3 (July 2010), 13:1--13:38.

Digital Library

[14]

Cockburn, A., Gutwin, C., and Greenberg, S. A predictive model of menu performance. In CHI '07, ACM (2007), 627--636.

Digital Library

[15]

Cox, A. L., and Silva, M. M. The role of mouse movements in interactive search. In Annual Meeting of the Cognitive Science Society, Lawrence Erlbaum (2006), 1156--1161.

[16]

Fu, W.-T., and Pirolli, P. Snif-act: a cognitive model of user navigation on the world wide web. Hum.-Comput. Interact. 22, 4 (Nov. 2007), 355--412.

Digital Library

[17]

Halverson, T., and Hornof, A. J. Local density guides visual search: Sparse groups are first and faster. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (2004).

[18]

Halverson, T., and Hornof, A. J. The effects of semantic grouping on visual search. In CHI EA '08, ACM (N, 2008), 3471--3476.

Digital Library

[19]

Halverson, T., and Hornof, A. J. A computational model of active vision for visual search in humancomputer interaction. HumanComputer Interaction 26, 4 (2011), 285--314.

Digital Library

[20]

Hornof, A. J. Cognitive strategies for the visual search of hierarchical computer displays. Hum.-Comput. Interact. 19, 3 (Sept. 2004), 183--223.

Digital Library

[21]

Hornof, A. J., and Kieras, D. E. Cognitive modeling reveals menu search in both random and systematic. In CHI '97, ACM (N, 1997), 107--114.

Digital Library

[22]

Hornof, A. J., and Kieras, D. E. Cognitive modeling demonstrates how people use anticipated location knowledge of menu items. In CHI'99, ACM (1999), 410'417.

Digital Library

[23]

Howes, A., Lewis, R. L., and Vera, A. Rational adaptation under task and processing constraints: implications for testing theories of cognition and action. Psychological Review 116, 4 (2009), 717--751.

[24]

Jacobs, A. M., and Grainger, J. Models of visual word recognition: Sampling the state of the art. Journal of Experimental Psychology: Human perception and performance 20, 6 (1994), 1311.

[25]

John, B. E., Prevas, K., Salvucci, D. D., and Koedinger, K. Predictive human performance modeling made easy. In CHI'04, CHI'04, ACM (N, 2004), 455--462.

Digital Library

[26]

Kaptelinin, V. Item recognition in menu selection: the effect of practice. In INTERACT'93 and CHI'93, CHI'93, ACM (1993), 183--184.

Digital Library

[27]

Kieras, D. E., and Meyer, D. E. An overview of the epic architecture for cognition and performance with application to human-computer interaction. Hum.-Comput. Interact. 12, 4 (Dec. 1997), 391'438.

Digital Library

[28]

Lane, D. M., Napier, H. A., Batsell, R. R., and Naman, J. L. Predicting the skilled use of hierarchical menus with the keystroke-level model. Hum.-Comput. Interact. 8, 2 (June 1993), 185'192.

Digital Library

[29]

Lee, E., and McGregor, J. Minimizing user search time in menu retrieval systems. Human Factors 27, 2 (1985), 157'162.

[30]

MacKenzie, I. S. Fitts' law as a research and design tool in human-computer interaction. Hum.-Comput. Interact. 7, 1 (Mar. 1992), 91'139.

Digital Library

[31]

Malacria, S., Bailly, G., Harrison, J., Cockburn, A., and Gutwin, C. Promoting hotkey use through rehearsal with exposehk. In CHI '13, ACM (2013), 573'582.

Digital Library

[32]

McDonald, J. E., Stone, J. D., and Liebelt, L. S. Searching for items in menus: The effects of organization and type of target. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 27, 834 (Oct. 1983), 834'837.

[33]

Mehlenbacher, B., Duffy, T. M., and Palmer, J. Finding information on a menu: linking menu organization to the user's goals. Hum.-Comput. Interact. 4, 3 (Sept. 1989), 231--251.

Digital Library

[34]

Newell, A., and Rosenbloom, P. S. The soar papers (vol. 1). MIT Press, Cambridge, MA, USA, 1993, ch. Mechanisms of skill acquisition and the law of practice, 81--135.

Digital Library

[35]

Nilsen, E., and Evans, J. Exploring the divide between two uni'ed theories of cognition: modeling visual attention in menu selection. In CHI EA'99, ACM (1999), 288--289.

Digital Library

[36]

Nilsen, E. L. Perceptual-motor control in human-computer interaction. PhD thesis, Ann Arbor, MI, USA, 1991. UMI Order No. GAX91--35659.

Digital Library

[37]

Norman, K. L. The Psychology of Menu Selection: Designing Cognitive Control at the Human/Computer Interface. Greenwood Publishing Group Inc., Westport, CT, USA, 1991.

Digital Library

[38]

Sears, A., and Shneiderman, B. Split menus: effectively using selection frequency to organize menus. ACM Trans. Comput.-Hum. Interact. 1, 1 (Mar. 1994), 27'51.

Digital Library

[39]

Smith, M. R., Lewis, R. L., Howes, A., Chu, A., and Green, C. More than 8,192 Ways to Skin a Cat : Modeling Behavior in Multidimensional Strategy Spaces. In Proceedings of the 30th Annual Conference of the Cognitive Science Society, B. C. Love, K. McRae, and V. M. Sloutsky, Eds., Cognitive Science Society (Austin, Tx, 2008), 1441--1446.

[40]

Somberg, B. L. A comparison of rule-based and positionally constant arrangements of computer menu items. In CHI'87, ACM (1987), 255--260.

Digital Library

Cited By

Meißner SDegbelo A(2024)User Performance Modelling for Spatial Entities Comparison with Geodashboards: Using View Quality and Distractor as ConceptsCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661325(7-14)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661325
Gori JBen Amara MBailly G(2024)Understanding and generating realistic command distributionsProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649799(1-11)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649799
Bai YIkkala AOulasvirta AZhao SWang LYang PXu P(2024)Heads-Up Multitasker: Simulating Attention Switching On Optical Head-Mounted DisplaysProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642540(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642540
Show More Cited By

Index Terms

Model of visual search and selection time in linear menus
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Visual Grouping in Menu Interfaces
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Menu interfaces often arrange options into semantic groups. This semantic structure is then usually conveyed to the user by supplementary visual grouping cues. We investigate whether these visual grouping cues actually help users locate items in menus ...
Eye tracking the visual search of click-down menus
CHI '99: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

Click-down (or pull-down) menus have long been a key component of graphical user interfaces, yet we know surprisingly little about how users actually interact with such menus. Nilsens [8] study on menu selection has led to the development of a number of ...
Is visual content in textual search interfaces beneficial to dyslexic users?

Dyslexia is a learning disability characterised by problems with accurate or fluent word recognition, poor decoding, and poor spelling abilities. Although several studies have addressed dyslexia and Web accessibility, less is known about how dyslexia ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
1,631
Total Downloads

Downloads (Last 12 months)199
Downloads (Last 6 weeks)20

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Meißner SDegbelo A(2024)User Performance Modelling for Spatial Entities Comparison with Geodashboards: Using View Quality and Distractor as ConceptsCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661325(7-14)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661325
Gori JBen Amara MBailly G(2024)Understanding and generating realistic command distributionsProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649799(1-11)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649799
Bai YIkkala AOulasvirta AZhao SWang LYang PXu P(2024)Heads-Up Multitasker: Simulating Attention Switching On Optical Head-Mounted DisplaysProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642540(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642540
Wu CJokinen J(2024)Modeling the impact of mental models on interactive decision-making and behavior2024 16th International Conference on Human System Interaction (HSI)10.1109/HSI61632.2024.10613586(1-7)Online publication date: 8-Jul-2024
https://doi.org/10.1109/HSI61632.2024.10613586
Isomoto TYamanaka SShizuki B(2023)Exploring Dwell-time from Human Cognitive Processes for Dwell SelectionProceedings of the ACM on Human-Computer Interaction10.1145/35911287:ETRA(1-15)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3591128
Moon HOulasvirta ALee B(2023)Amortized Inference with User SimulationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581439(1-20)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581439
Yamanaka SUsuba H(2023)Tuning Endpoint-variability Parameters by Observed Error Rates to Obtain Better Prediction Accuracy of Pointing MissesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580746(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580746
Li ZKo YPutkonen AFeiz SAshok VRamakrishnan IOulasvirta ABi X(2023)Modeling Touch-based Menu Selection Performance of Blind Users via Reinforcement LearningProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580640(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580640
Bailly GKhamassi MGirard B(2023)Computational Model of the Transition from Novice to Expert Interaction TechniquesACM Transactions on Computer-Human Interaction10.1145/350555730:5(1-33)Online publication date: 23-Sep-2023
https://dl.acm.org/doi/10.1145/3505557
Somaskantharajan SDegbelo AKrukar J(2023)An Exploratory Study of Models of Mobile Map User ExperienceEine explorative Studie über Modelle der Nutzererfahrung bei mobilen KartenKN - Journal of Cartography and Geographic Information10.1007/s42489-023-00136-873:2(127-146)Online publication date: 29-Apr-2023
https://doi.org/10.1007/s42489-023-00136-8
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents