This research focuses on the use of hand drawn marks as a human-computer input technique. Drawing a mark is an efficient command input technique in many situations. However, marks are not intrinsically self-explanatory as are other interactive techniques such as buttons and menus. This research develops and evaluates an interaction technique called marking menus which integrates menus and marks such that both self-explanation and efficient interaction can be provided.
A marking menu allows a user to perform a menu selection by either popping up a radial menu and then selecting an item, or by drawing a straight mark in the direction of the desired menu item. Drawing a mark avoids popping up the menu. Marking menus can also be hierarchic. In this case, hierarchic radial menus and "zig-zag" marks are used. Marking menus are based on three design principles: self-revelation, guidance and rehearsal. Self-revelation means a marking menu reveals to a user what functions or items are available. Guidance means a marking menu guides a user in selecting an item. Rehearsal means that the guidance provided by the marking menu is a rehearsal of making the mark needed to select an item. Self-revelation helps a novice determine what functions are available, while guidance and rehearsal train a novice to use the marks like an expert. The intention is to allow a user to make a smooth and efficient transition from novice to expert behavior.
This research evaluates marking menus through empirical experiments, a case study, and a design study. Results shows that (1) 4, 8 and 12 item menus are advantageous when selecting using marks, (2) marks can be used to reliably select from four-item menus that are up to four levels deep or from eight-item menus that are up to two levels deep, (3) marks can be performed more accurately with a pen than a mouse, but the difference is not large, (4) in a practical application, users tended towards using the marks 100% of the time, (5) using a mark, in this application, was 3.5 times faster than selection using the menu, (6) the design principles of marking menus can be generalized to other types of marks.
Cited By
- Bailly G, Khamassi M and Girard B (2023). Computational Model of the Transition from Novice to Expert Interaction Techniques, ACM Transactions on Computer-Human Interaction, 30:5, (1-33), Online publication date: 31-Oct-2023.
- Han T, Li J, Hasan K, Nakamura K, Gomez R, Balakrishnan R and Irani P PageFlip Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, (1-12)
- Bailly G, Lecolinet E and Nigay L (2016). Visual Menu Techniques, ACM Computing Surveys, 49:4, (1-41), Online publication date: 31-Dec-2018.
- Ladwig P, Herder J and Geiger C Towards precise, fast and comfortable immersive polygon mesh modelling Proceedings of the 27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments, (205-212)
- Matulic F, Vogel D and Dachselt R Hand Contact Shape Recognition for Posture-Based Tabletop Widgets and Interaction Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces, (3-11)
- Schramm K, Gutwin C and Cockburn A Supporting Transitions to Expertise in Hidden Toolbars Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, (4687-4698)
- Ismair S, Wagner J, Selker T and Butz A MIME Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services, (199-206)
- Gutwin C, Cockburn A and Lafreniere B Testing the rehearsal hypothesis with two FastTap interfaces Proceedings of the 41st Graphics Interface Conference, (223-231)
- Cockburn A, Gutwin C, Scarr J and Malacria S (2014). Supporting Novice to Expert Transitions in User Interfaces, ACM Computing Surveys, 47:2, (1-36), Online publication date: 8-Jan-2015.
- Pietrzak T, Malacria S and Bailly G CtrlMouse et TouchCtrl Proceedings of the 26th Conference on l'Interaction Homme-Machine, (38-47)
- Chen X, Grossman T and Fitzmaurice G Swipeboard Proceedings of the 27th annual ACM symposium on User interface software and technology, (615-620)
- Gutwin C, Cockburn A, Scarr J, Malacria S and Olson S Faster command selection on tablets with FastTap Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (2617-2626)
- Kulshreshth A and LaViola J Exploring the usefulness of finger-based 3D gesture menu selection Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1093-1102)
- Kamal A, Li Y and Lank E Teaching motion gestures via recognizer feedback Proceedings of the 19th international conference on Intelligent User Interfaces, (73-82)
- Ghomi E, Huot S, Bau O, Beaudouin-Lafon M and Mackay W Arpège Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces, (209-218)
- Fitchett S, Cockburn A and Gutwin C Improving navigation-based file retrieval Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (2329-2338)
- Walter R, Bailly G and Müller J StrikeAPose Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (841-850)
- Malacria S, Bailly G, Harrison J, Cockburn A and Gutwin C Promoting Hotkey use through rehearsal with ExposeHK Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (573-582)
- Bailly G, Pietrzak T, Deber J and Wigdor D Métamorphe Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (563-572)
- Samp K Designing graphical menus for novices and experts Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (3159-3168)
- Leitner J, Perteneder F, Liu C, Rendl C and Haller M Kolibri Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1789-1798)
- Kin K, Hartmann B, DeRose T and Agrawala M Proton++ Proceedings of the 25th annual ACM symposium on User interface software and technology, (477-486)
- Zarek A, Wigdor D and Singh K SNOUT Proceedings of the International Working Conference on Advanced Visual Interfaces, (140-147)
- Guimbretière F and Nguyen C Bimanual marking menu for near surface interactions Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (825-828)
- Samp K and Decker S Visual search in radial menus Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part IV, (248-255)
- Samp K and Decker S Navigation time variability Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part I, (388-395)
- Mathur A, Ramachandran D, Cutrell E and Balakrishnan R An exploratory study on the use of camera phones and pico projectors in rural India Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, (347-356)
- Kin K, Hartmann B and Agrawala M (2011). Two-handed marking menus for multitouch devices, ACM Transactions on Computer-Human Interaction, 18:3, (1-23), Online publication date: 1-Jul-2011.
- Larson E, Cohn G, Gupta S, Ren X, Harrison B, Fox D and Patel S HeatWave Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (2565-2574)
- Bragdon A, Nelson E, Li Y and Hinckley K Experimental analysis of touch-screen gesture designs in mobile environments Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (403-412)
- Shi P, Xu H and Zhang X Informing security indicator design in web browsers Proceedings of the 2011 iConference, (569-575)
- Das K and Borst C VR menus Proceedings of the 6th international conference on Advances in visual computing - Volume Part I, (719-728)
- Ecker R, Broy V, Hertzschuch K and Butz A Visual cues supporting direct touch gesture interaction with in-vehicle information systems Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications, (80-87)
- Capobianco A and Essert C Study of performances of "haptic walls" modalities for a 3D menu Proceedings of the 2010 international conference on Haptics - generating and perceiving tangible sensations: Part II, (152-159)
- Apitz G, Guimbretière F and Zhai S (2008). Foundations for designing and evaluating user interfaces based on the crossing paradigm, ACM Transactions on Computer-Human Interaction, 17:2, (1-42), Online publication date: 1-May-2010.
- Liao C, Liu Q, Liew B and Wilcox L Pacer Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (2441-2450)
- Nancel M, Huot S and Beaudouin-Lafon M Un espace de conception fondé sur une analyse morphologique des techniques de menus Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine, (13-22)
- Moscovich T Contact area interaction with sliding widgets Proceedings of the 22nd annual ACM symposium on User interface software and technology, (13-22)
- Ecker R, Broy V, Butz A and De Luca A pieTouch Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, (1-10)
- Chertoff D, Byers R and LaViola J An exploration of menu techniques using a 3D game input device Proceedings of the 4th International Conference on Foundations of Digital Games, (256-262)
- Sulaiman A and Olivier P Attribute gates Proceedings of the 21st annual ACM symposium on User interface software and technology, (57-66)
- Bau O and Mackay W OctoPocus Proceedings of the 21st annual ACM symposium on User interface software and technology, (37-46)
- Chen N, Guimbretière F and Löckenhoff C (2008). Relative role of merging and two-handed operation on command selection speed, International Journal of Human-Computer Studies, 66:10, (729-740), Online publication date: 1-Oct-2008.
- Chen N, Guimbretiere F, Dixon M, Lewis C and Agrawala M Navigation techniques for dual-display e-book readers Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1779-1788)
- Fitzmaurice G, Matejka J, Khan A, Glueck M and Kurtenbach G PieCursor Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1361-1370)
- Blanch R and Lecolinet É Treemaps zoomables Proceedings of the 19th Conference on l'Interaction Homme-Machine, (131-138)
- Blanch R and Lecolinet E (2007). Browsing Zoomable Treemaps, IEEE Transactions on Visualization and Computer Graphics, 13:6, (1248-1253), Online publication date: 1-Nov-2007.
- Bailly G, Lecolinet E and Nigay L Wave menus Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction, (475-488)
- Grossman T, Dragicevic P and Balakrishnan R Strategies for accelerating on-line learning of hotkeys Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1591-1600)
- Zhao S, Dragicevic P, Chignell M, Balakrishnan R and Baudisch P Earpod Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1395-1404)
- Guimbretiére F, Dixon M and Hinckley K ExperiScope Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1333-1342)
- Liao C, Guimbretière F and Loeckenhoff C Pen-top feedback for paper-based interfaces Proceedings of the 19th annual ACM symposium on User interface software and technology, (201-210)
- Zhao S, Agrawala M and Hinckley K Zone and polygon menus Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (1077-1086)
- Blasko G, Narayanaswami C and Feiner S Prototyping retractable string-based interaction techniques for dual-display mobile devices Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (369-372)
- Liao C, Guimbretière F and Hinckley K PapierCraft Proceedings of the 18th annual ACM symposium on User interface software and technology, (241-244)
- Zhao S and Balakrishnan R Simple vs. compound mark hierarchical marking menus Proceedings of the 17th annual ACM symposium on User interface software and technology, (33-42)
- Apitz G and Guimbretière F CrossY Proceedings of the 17th annual ACM symposium on User interface software and technology, (3-12)
- Blaskó G and Feiner S Single-handed interaction techniques for multiple pressure-sensitive strips CHI '04 Extended Abstracts on Human Factors in Computing Systems, (1461-1464)
- Fitzmaurice G, Khan A, Pieké R, Buxton B and Kurtenbach G Tracking menus Proceedings of the 16th annual ACM symposium on User interface software and technology, (71-79)
- Ratzer A and Hansen K Ideogramic Proceedings of the second Nordic conference on Human-computer interaction, (291-292)
- Hansen K and Ratzer A (2002). Tool support for collaborative teaching and learning of object-oriented modeling, ACM SIGCSE Bulletin, 34:3, (146-150), Online publication date: 1-Sep-2002.
- Hansen K and Ratzer A Tool support for collaborative teaching and learning of object-oriented modeling Proceedings of the 7th annual conference on Innovation and technology in computer science education, (146-150)
- Guimbretiére F and Winograd T FlowMenu Proceedings of the 13th annual ACM symposium on User interface software and technology, (213-216)
- Damm C, Hansen K and Thomsen M Tool support for cooperative object-oriented design Proceedings of the SIGCHI conference on Human Factors in Computing Systems, (518-525)
- Balakrishnan R and Patel P The PadMouse Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (9-16)
- Tapia M and Kurtenbach G Some design refinements and principles on the appearance and behavior of marking menus Proceedings of the 8th annual ACM symposium on User interface and software technology, (189-195)
- Roy Q, Guiard Y, Bailly G, Lecolinet É and Rioul O Glass+Skin: An Empirical Evaluation of the Added Value of Finger Identification to Basic Single-Touch Interaction on Touch Screens Human-Computer Interaction – INTERACT 2015, (55-71)
Index Terms
- The design and evaluation of marking menus
Recommendations
An empirical evaluation of some articulatory and cognitive aspects of marking menus
We describe marking menus, an extension of pie menus, which are well suited for stylus-based interfaces. Pie menus are circular menus subdivided into sectors, each of which might correspond to a different command. One moves the cursor from the center of ...
The design and evaluation of multitouch marking menus
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsDespite the considerable quantity of research directed towards multitouch technologies, a set of standardized UI components have not been developed. Menu systems provide a particular challenge, as traditional GUI menus require a level of pointing ...
The limits of expert performance using hierarchic marking menus
CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing SystemsA marking menu allows a user to perform a menu selection by either popping-up a radial (or pie) menu, or by making a straight mark in the direction of the desired menu item without popping-up the menu. A hierarchic marking menu uses hierarchic radial ...