research-article

Augmenting user-maintained interaction through mode locking and reversing

Authors:

Katherine Fennedy,

Dongliang Zhang,

Chunxiao LiAuthors Info & Claims

HCI '18: Proceedings of the 32nd International BCS Human Computer Interaction Conference

Article No.: 9, Pages 1 - 12

https://doi.org/10.14236/ewic/HCI2018.9

Published: 04 July 2018 Publication History

Abstract

User-maintained mode is often adopted in facilitating a bimanual interaction using multitouch devices, in which a thumb of a non-dominant hand holding the device can press a part of the screen and keep pressed in order to activate and maintain a temporary mode that is required only for a short period of time, until the user releases the thumb. In this paper, we characterise this particular interactivity and propose novel locking mechanism that supports easy swapping between primary and secondary modes enabling further useful bimanual interaction mechanism that we call reversed mode relationship. We design three prototypes that employ this interactivity and conduct a usability testing with 27 participants. Findings suggest that this interaction works better in applications where there are frequent but short and non-intensive sub-tasks that interrupt the main workflow. We use this insight to further explore more advanced ways to support such interaction.

References

[1]

Baudisch, P. and Chu, G. (2009) Back-of-device interaction allows creating very small touch devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA. ACM

Digital Library

[2]

Degani, A. (1999) Modes in Human-Machine Systems: Constructs, Representation, and Classification. The International journal of aviation psychology., 9, 2, 125.

[3]

Foucault, d., Micaux, M., Bonnet, D. and Beaudouin-Lafon, M. (2014) SPad: a bimanual interaction technique for productivity applications on multi-touch tablets. CHI '14 Extended Abstracts on Human Factors in Computing Systems, Toronto, Ontario, Canada. ACM

Digital Library

[4]

Guiard, Y. (1987) Asymmetric Division of Labor in Human Skilled Bimanual Action. Journal of Motor Behavior, 19, 4, 486--517.

[5]

Gutwin, C., Coekburn, A., Searr, J., Malaeria, S. and Olson, S. C. (2014) Faster command selection on tablets with FastTap. Proceedings of the 32nd annual ACM conference on Human factors in computing systems, Toronto, Ontario, Canada. ACM

Digital Library

[6]

Hamilton, W., Kerne, A. and Robbins, T. (2012) High-performance pen + touch modality interactions: a real-time strategy game eSports context. Proceedings of the 25th annual ACM symposium on User interface software and technology, Cambridge, Massachusetts, USA. ACM

Digital Library

[7]

Hinckley, K., Guimbretiere, F., Baudisch, P., Sarin, R., Agrawala, M. and Cutrell, E. (2006) The Springboard: Multiple Modes in One Spring-Loaded Control. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Montreal, Quebec, Canada, 181--190. ACM 1124801.

Digital Library

[8]

Holz, C. and Baudisch, P. (2010) The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, Georgia, USA. ACM

Digital Library

[9]

InstagramPress. (2016) Introducing Instagram Stories. https://instagram-press.com/blog/2016/08/02/introducing-instagram-stories/ (14th March 2018).

[10]

Johnson, J. and Engelbeck, G. (1989) Modes Survey Results. SIGCHI Bull., 20, 4, 38--50.

Digital Library

[11]

Johnson, J. (1990) Modes in non-computer devices. International Journal of Man-Machine Studies, 32, 4, 423--438.

Digital Library

[12]

Kleimola, J., Laine, M., Litvinova, E. and Vuorimaa, P. (2013) TouchModifier: enriched multi-touch gestures for tablet browsers. Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces, St. Andrews, Scotland, United Kingdom. ACM

Digital Library

[13]

Lank, E., Ruiz, J. and Cowan, W. (2006) Concurrent bimanual stylus interaction: a study of non-preferred hand mode manipulation. Proceedings of Graphics Interface 2006, Quebec, Canada. Canadian Information Processing Society

Digital Library

[14]

Le, H. V., Mayer, S., Bader, P., Bastian, F. and Henze, N. (2017) Interaction Methods and Use Cases for a Full-Touch Sensing Smartphone. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Denver, Colorado, USA. ACM

Digital Library

[15]

Li, Y., Hinckley, K., Guan, Z. and Landay, J. A. (2005) Experimental Analysis of Mode Switching Techniques in Pen-Based User Interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Portland, Oregon, USA. ACM

Digital Library

[16]

Matulic, F. and Norrie, M. C. (2012) Supporting active reading on pen and touch-operated tabletops. Proceedings of the International Working Conference on Advanced Visual Interfaces, Capri Island, Italy. ACM

Digital Library

[17]

Matulic, F. and Norrie, M. C. (2013) Pen and Touch Gestural Environment for Document Editing on Interactive Tabletops. Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces, St. Andrews, Scotland, United Kingdom, 41--50. ACM 2512802.

Digital Library

[18]

Odell, D. and Chandrasekaran, V. (2012) Enabling comfortable thumb interaction in tablet computers: a Windows 8 case study. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 56, 1, 1907--1911.

[19]

Oulasvirta, A., Reichel, A., Li, W., Zhang, Y., Bachynskyi, M., Vertanen, K. and Kristensson, P. O. (2013) Improving two-thumb text entry on touchscreen devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France. ACM

Digital Library

[20]

Pfeuffer, K., Hinckley, K., Pahud, M. and Buxton, B. (2017) Thumb + Pen Interaction on Tablets. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, Colorado, USA. ACM

Digital Library

[21]

Poller, M. F. and Garter, S. K. (1983) A Comparative Study of Moded and Modeless Text Editing by Experienced Editor Users. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, Massachusetts, USA, 166--170. ACM 801603.

Digital Library

[22]

Raskin, J. (2000) The Humane Interface: New Directions for Designing Interactive Systems. ACM Press/Addison-Wesley Publishing Co.

Digital Library

[23]

Rod, J., Li, C., Zhang, D. and Lee, H. (2016) Designing a 3D modelling tool for novice users. Proceedings of the 28th Australian Conference on Computer-Human Interaction, Launceston, Tasmania, Australia. ACM

Digital Library

[24]

Saffer, D. (2013) Microinteractions: Designing with Details. O'Reilly Media, Inc.

Digital Library

[25]

Saund, E. and Lank, E. (2003) Stylus Input and Editing Without Prior Selection of Mode. Proceedings of the 16th annual ACM symposium on User interface software and technology, Vancouver, Canada, 213--216. ACM 964720.

Digital Library

[26]

Sellen, A. J., Kurtenbach, G. P. and Buxton, W. A. S. (1992) The Prevention of Mode Errors Through Sensory Feedback. Hum.-Comput. Interact., 7, 2, 141--164.

Digital Library

[27]

Siek, K. A., Rogers, Y. and Connelly, K. H. (2005) Fat finger worries: how older and younger users physically interact with PDAs. Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction, Rome, Italy. Springer-Verlag

Digital Library

[28]

Surale, H. B., Matulic, F. and Vogel, D. (2017) Experimental Analysis of Mode Switching Techniques in Touch-based User Interfaces, 3267--3280.

Digital Library

[29]

Uddin, M. S., Gutwin, C. and Lafreniere, B. (2016) HandMark Menus: Rapid Command Selection and Large Command Sets on Multi-Touch Displays. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, Santa Clara, California, USA. ACM

Digital Library

[30]

Vogel, D. and Baudisch, P. (2007) Shift: a technique for operating pen-based interfaces using touch. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, San Jose, California, USA. ACM

Digital Library

[31]

Vogel, D. and Balakrishnan, R. (2010) Occlusion-aware interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, Georgia, USA. ACM

Digital Library

[32]

WABetalnfo. (2017) WhatsApp to support locked recordings. http://wabetainfo.com/whatsapp-to-support-locked-recordings/ (14th March 2018).

[33]

Wagner, J., St, Huot, p. and Mackay, W. (2012) BiTouch and BiPad: designing bimanual interaction for hand-held tablets. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Austin, Texas, USA. ACM

Digital Library

[34]

Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J. and Shen, C. (2007) Lucid touch: a see-through mobile device. Proceedings of the 20th annual ACM symposium on User interface software and technology, Newport, Rhode Island, USA. ACM

Digital Library

[35]

Woods, D. D., Johannesen, L. J., Cook, R. I. and Sarter, N. B. (1994) Behind human error: Cognitive systems, computers and hindsight. DAYTON UNIV RESEARCH INST (URDI) OH.

[36]

Xia, H., Grossman, T. and Fitzmaurice, G. (2015) NanoStylus: Enhancing Input on Ultra-Small Displays with a Finger-Mounted Stylus. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, Charlotte, NC, USA. ACM

Digital Library

Cited By

Fennedy KLee H(2019)Modus OperandiProceedings of the XX International Conference on Human Computer Interaction10.1145/3335595.3335645(1-4)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3335595.3335645
Fennedy KLee H(2019)ModeRateProceedings of the XX International Conference on Human Computer Interaction10.1145/3335595.3335598(1-2)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3335595.3335598
Lee HKo ITan YZhang DLi C(2019)Usability Impact of Occlusion-free Techniques on Commonly-used Multitouch ActionsProceedings of the 5th International ACM In-Cooperation HCI and UX Conference10.1145/3328243.3328256(96-105)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1145/3328243.3328256
Show More Cited By

Augmenting user-maintained interaction through mode locking and reversing
1. Human-centered computing

Recommendations

Exploring finger specific touch screen interaction for mobile phone user interfaces
OzCHI '14: Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design

Today, mobile phones with touch screens are widespread but as de facto, the interaction space is limited to single finger taps or multitouch gestures. In this paper, we present an investigation of a novel interaction concept for mobile phone touch ...
Spatially aware tangible display interaction in a tabletop environment
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

One limiting factor of digital tabletops is that interaction is usually restricted to a single 2D surface. I propose to extend this interaction space to the 3D space above the table by using spatially aware handheld displays. Utilizing the spatial ...
Tablet interaction techniques for viewport navigation on large displays
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

While a subset view on tablet devices allows users to observe in detail an area of the large display from a distance, interaction techniques are required to support viewport navigation around the display efficiently. We propose two dual-touch techniques ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

HCI '18: Proceedings of the 32nd International BCS Human Computer Interaction Conference

July 2018

1509 pages

Publisher

BCS Learning & Development Ltd.

Swindon, United Kingdom

Publication History

Published: 04 July 2018

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fennedy KLee H(2019)Modus OperandiProceedings of the XX International Conference on Human Computer Interaction10.1145/3335595.3335645(1-4)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3335595.3335645
Fennedy KLee H(2019)ModeRateProceedings of the XX International Conference on Human Computer Interaction10.1145/3335595.3335598(1-2)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3335595.3335598
Lee HKo ITan YZhang DLi C(2019)Usability Impact of Occlusion-free Techniques on Commonly-used Multitouch ActionsProceedings of the 5th International ACM In-Cooperation HCI and UX Conference10.1145/3328243.3328256(96-105)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1145/3328243.3328256
Fennedy KLee H(2019)Multitouch Keyboard RevisitedProceedings of the 5th International ACM In-Cooperation HCI and UX Conference10.1145/3328243.3328249(36-45)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1145/3328243.3328249

View Options

View options

Figures

Tables

Media

View Table of Conten