research-article

Pinch-drag-flick vs. spatial input: rethinking zoom & pan on mobile displays

Authors:

Martin Spindler,

Martin Schuessler,

Marcel Martsch,

Raimund DachseltAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1113 - 1122

https://doi.org/10.1145/2556288.2557028

Published: 26 April 2014 Publication History

Abstract

The multi-touch-based pinch to zoom, drag and flick to pan metaphor has gained wide popularity on mobile displays, where it is the paradigm of choice for navigating 2D documents. But is finger-based navigation really the gold standard' In this paper, we present a comprehensive user study with 40 participants, in which we systematically compared the Pinch-Drag-Flick approach with a technique that relies on spatial manipulation, such as lifting a display up/down to zoom. While we solely considered known techniques, we put considerable effort in implementing both input strategies on popular consumer hardware (iPhone, iPad). Our results show that spatial manipulation can significantly outperform traditional Pinch-Drag-Flick. Given the carefully optimized prototypes, we are confident to have found strong arguments that future generations of mobile devices could rely much more on spatial interaction principles.

Supplementary Material

suppl.mov (pn0425-file3.mp4)

Supplemental video

Download
31.65 MB

References

[1]

Bier, E.A., Stone, M.C., Pier, K., Buxton, B., and DeRose, T.D. Toolglass and Magic Lenses: The SeeThrough Interface. In Proc. SIGGRAPH 1993, ACM (1993), 445--446.

Digital Library

[2]

Boring, S., Ledo, D., Chen, X., Marquardt, N., Tang, A., and Greenberg, S. The fat thumb: using the thumb's contact size for single-handed mobile interaction. In Proc. MobileHCI 2012, ACM (2012), 207--208.

Digital Library

[3]

Burstyn, J., Banerjee, A., and Vertegaal, R. FlexView: An evaluation of depth navigation on deformable mobile devices. In Proc. TEI 2013, ACM (2013), 193--200.

Digital Library

[4]

Chae, M. and Kim, J. Do size and structure matter to mobile users' An empirical study of the effects of screen size, information structure, and task complexity on user activities with standard web phones. Behaviour and Information Technology 23, 3 (2004), 165--181.

[5]

Cutmore, T., Hine, T., Maberly, K., Langford, N., and Hawgood, G. Cognitive and gender factors influencing navigation in a virtual environment. Int. Journal of Human Computer Studies 53, 2 (2000), 223--249.

Digital Library

[6]

Dabbs, J., Chang, E., Strong, R., and Milun, R. Spatial ability, navigation strategy, and geographic knowledge among men and women. Evolution and Human Behavior 19, 2 (1998), 89--98.

[7]

Fitzmaurice, G.W., Zhai, S., and Chignell, M. Virtual reality for palmtop computers. ACM Trans. Inf. Syst. 11, 3 (1993), 197--218.

Digital Library

[8]

Furnas, G.W. and Bederson, B.B. Space-Scale Diagrams: Understanding Multiscale Interfaces, In Proc. CHI 1995, ACM (1995), 234--241.

Digital Library

[9]

Gutwin, C. and Fedak, C. Interacting with big interfaces on small screens: a comparison of fisheye, zoom, and panning techniques. In Proc. Graphics Interface 2004, Canad. H.-C. Comm. Society (2004), 145--152.

Digital Library

[10]

Hansen, T.R., Eriksson, E., and Lykke-Olesen, A. Mixed interaction space - Expanding the interaction space with mobile devices. In Proc. HCI 2006. Springer London (2006), 365--380.

[11]

Jones, B., Sodhi, R., Forsyth, D., Bailey, B., and Maciocci, G. Around device interaction for multiscale navigation. In Proc. MobileHCI 2012. ACM (2012), 83--92.

Digital Library

[12]

Jones, M., Marsden, G., Mohd-Nasir, N., Boone, K., Buchanan, G. Improving web interaction on small displays. Computer Networks 31, 16 (1999), 1129--1137.

Digital Library

[13]

Joshi, N., Kar, A., and Cohen, M. Looking at you: fused gyro and face tracking for viewing large imagery on mobile devices. In Proc. CHI, ACM (2012), 2211--2220.

Digital Library

[14]

Jul, S. and Furnas, G.W. Critical zones in desert fog: aids to multiscale navigation. In Proc. UIST 1998, ACM (1998), 97--106.

Digital Library

[15]

Kaufmann, B. and Ahlström, D. Studying spatial memory and map navigation performance on projector phones with peephole interaction. In Proc. CHI 2013. ACM (2013), 3173--3176.

Digital Library

[16]

Malacria, S., Lecolinet, E., and Guiard, Y. Clutch-free panning and integrated pan-zoom control on touchsensitive surfaces: the cyclostar approach. In Proc. CHI 2010, ACM (2010), 2615--2624.

Digital Library

[17]

Norman, D. The Design of Everyday Things. Basic Books, 2002.

Digital Library

[18]

Oh, J. and Hua, H. User Evaluations on Form Factors of Tangible Magic Lenses. In Proc. ISMAR 2006, ACM (2006), 23--32.

Digital Library

[19]

Pahud. M., Hinckley, K., Iqbal, S., Sellen, A., and Buxton, B. Toward compound navigation tasks on mobiles via spatial manipulation. In Proc. Mobile HCI 2013. ACM (2013), 113--122.

Digital Library

[20]

Rädle, R., Jetter, H.-C., Butscher, S., and Reiterer, H. The effect of egocentric body movements on users' navigation performance and spatial memory in zoomable user interfaces. In Proc. ITS 2013. ACM (2013), 23--32.

Digital Library

[21]

Reeves, B., Lang, A., Kim, E.Y., and Tatar, D. The effects of screen size and message content on attention and arousal. Media Psychology 1, 1 (1999), 49--67.

[22]

Rogers, Y., Sharp, H., and Preece, J. Interaction Design: Beyond Human-Computer Interaction. John Wiley & Sons, 1st edition, 2002.

[23]

Spelmezan, D., Appert, C., Chapuis, O., and Pietriga, E. Side Pressure for Bidirectional Navigation on Small Devices. In Proc. MobileHCI, ACM (2013), 113--122.

Digital Library

[24]

Spindler, M., Martsch, M., Dachselt, R. Going Beyond the Surface: Studying Multi-Layer Interaction Above the Tabletop. In Proc. CHI, ACM (2012), 1277--1286.

Digital Library

[25]

Spindler, M., Stellmach, S., and Dachselt, R. Advanced Magic Lens Interaction above the Tabletop. In Proc. ITS 2009, ACM (2009), 77--84.

Digital Library

[26]

Treisman, A., Gelade, G. A Feature Integration Theory of Attention. Cogn. Psychology 12, 1 (1980), 97--136.

[27]

Tsang, M., Fitzmaurice, G., Kurtenbach, G., Khan, A., and Buxton, B. Boom Chameleon: Simultaneous Capture of 3D Viewpoint, Voice and Gesture Annotations on a Spatially-aware Display. In Proc. UIST 2002, ACM (2002), 111--120.

Digital Library

[28]

Ullmer, B., Ishii, H., and Jacob, R. Token + constraint systems for tangible interaction with digital information. ACM Trans. C. - H. Interaction 12, 1 (2005), 81--118.

Digital Library

[29]

Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. Lucid touch: a see-through mobile device. In Proc. UIST 2007, ACM (2007), 269--278.

Digital Library

[30]

Yee, K. Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. In Proc. CHI 2003, ACM (2003), 1--8.

Digital Library

Cited By

Nath PDelamare WHasan K(2024)PalmSpaceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103219184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103219
Urbas LPelzer FLorenz SHerlitzius T(2024)Förderlicher Entwurf cyber-physischer ProduktionssystemeHandbuch Industrie 4.010.1007/978-3-662-58528-3_132(189-223)Online publication date: 8-Nov-2024
https://doi.org/10.1007/978-3-662-58528-3_132
Tong WZhu-Tian CXia MLo LYuan LBach BQu H(2023)Exploring Interactions with Printed Data Visualizations in Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320938629:1(418-428)Online publication date: 27-Jan-2023
https://doi.org/10.1109/TVCG.2022.3209386
Show More Cited By

Index Terms

Pinch-drag-flick vs. spatial input: rethinking zoom & pan on mobile displays
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Move your phone: spatial input-based document zoom & pan on mobile displays revisited
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

We present a document navigation technique for mobile displays that relies entirely on principles of spatial manipulation, such as lifting the display up/down to zoom. While the underlying concepts are not new, the goal of this interactivity is to ...
Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Touch screen surfaces large enough for ten-finger input have become increasingly popular, yet typing on touch screens pales in comparison to physical keyboards. We examine typing patterns that emerge when expert users of physical keyboards touch-type on ...
Spatially aware tangible display interaction in a tabletop environment
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

One limiting factor of digital tabletops is that interaction is usually restricted to a single 2D surface. I propose to extend this interaction space to the 3D space above the table by using spatially aware handheld displays. Utilizing the spatial ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
811
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)6

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nath PDelamare WHasan K(2024)PalmSpaceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103219184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103219
Urbas LPelzer FLorenz SHerlitzius T(2024)Förderlicher Entwurf cyber-physischer ProduktionssystemeHandbuch Industrie 4.010.1007/978-3-662-58528-3_132(189-223)Online publication date: 8-Nov-2024
https://doi.org/10.1007/978-3-662-58528-3_132
Tong WZhu-Tian CXia MLo LYuan LBach BQu H(2023)Exploring Interactions with Printed Data Visualizations in Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320938629:1(418-428)Online publication date: 27-Jan-2023
https://doi.org/10.1109/TVCG.2022.3209386
Song TEck UNavab N(2023)Leveraging Motion Tracking for Intuitive Interactions in a Tablet-Based 3D Scene Annotation System2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00071(563-572)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00071
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Zhou ZZhou J(2022)Small screen-big information challenge for older adults: a study on visual momentum and gesture navigationBehaviour & Information Technology10.1080/0144929X.2022.204238542:6(744-757)Online publication date: 27-Feb-2022
https://doi.org/10.1080/0144929X.2022.2042385
Urbas LPelzer FLorenz SHerlitzius T(2022)Förderlicher Entwurf cyber-physischer ProduktionssystemeHandbuch Industrie 4.010.1007/978-3-662-45537-1_132-1(1-36)Online publication date: 15-Dec-2022
https://doi.org/10.1007/978-3-662-45537-1_132-1
Langner RSatkowski MBüschel WDachselt RKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data AnalysisProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445593(1-17)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445593
Newbury RSatriadi KBolton JLiu JCordeil MProuzeau AJenny B(2021)Embodied gesture interaction for immersive mapsCartography and Geographic Information Science10.1080/15230406.2021.192949248:5(417-431)Online publication date: 15-Jun-2021
https://doi.org/10.1080/15230406.2021.1929492
Miyazaki MKomuro T(2021)AR Peephole InterfacePervasive and Mobile Computing10.1016/j.pmcj.2021.10148978:COnline publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1016/j.pmcj.2021.101489
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents