research-article

Gesture Action Mapping for Deformation-based One-handed Landscape Mode Interaction with Flexible Smartphone-sized Devices

Authors:

Pranjal Protim Borah,

Keyur SorathiaAuthors Info & Claims

IndiaHCI '21: Proceedings of the 12th Indian Conference on Human-Computer Interaction

Pages 1 - 10

https://doi.org/10.1145/3506469.3506470

Published: 25 February 2022 Publication History

Abstract

This paper presents a user study investigating the effect of directional cues and ease of performing deformation gestures on gesture action mappings. We selected four gestures of one-handed landscape mode interaction and twelve actions associated with different spatial directions for the mapping task. We evaluated thirty participants’ preferences and appropriateness scores for mappings and ease of performing the gestures. We found that the Top-right-corner Bend-upward gesture is the easiest to perform and it constitutes the significantly most appropriate gesture action mappings that are majority preferred. We also found that directional cue, size of deformation, and the required effort in performing the gesture play important roles in user-preferred and appropriate mapping along with ease of performing the gestures. We also noticed that bend gestures at the corners and sides allow users to perceive multiple distinct directional cues, and they are suitable for mapping with multiple actions associated with different spatial directions.

References

[1]

Teemu T Ahmaniemi, Johan Kildal, and Merja Haveri. 2014. What is a device bend gesture really good for?. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3503–3512.

Digital Library

[2]

Pranjal Protim Borah and Keyur Sorathia. 2019. Natural and Intuitive Deformation Gestures for One-handed Landscape Mode Interaction. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 229–236.

Digital Library

[3]

Pranjal Protim Borah, Keyur Sorathia, and Sayan Sarcar. 2021. User-defined Bend Gesture Completion Strategies for Discrete and Continuous Inputs. In IFIP Conference on Human-Computer Interaction. Springer, 192–202.

[4]

Sebastian Boring, David Ledo, Xiang’Anthony’ Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The fat thumb: using the thumb’s contact size for single-handed mobile interaction. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. 39–48.

Digital Library

[5]

Victor Cheung, Alex Keith Eady, and Audrey Girouard. 2017. Exploring eyes-free interaction with wrist-worn deformable materials. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction. 521–528.

Digital Library

[6]

Sung-Jung Cho, Roderick Murray-Smith, and Yeun-Bae Kim. 2007. Multi-context photo browsing on mobile devices based on tilt dynamics. In Proceedings of the 9th international conference on Human computer interaction with mobile devices and services. 190–197.

Digital Library

[7]

Matthew Ernst and Audrey Girouard. 2016. Bending blindly: exploring bend gestures for the blind. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2088–2096.

Digital Library

[8]

Matthew Ernst and Audrey Girouard. 2016. Exploring haptics for learning bend gestures for the blind. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2097–2104.

Digital Library

[9]

Matthew Ernst, Travis Swan, Victor Cheung, and Audrey Girouard. 2017. Typhlex: Exploring deformable input for blind users controlling a mobile screen reader. IEEE Pervasive Computing 16, 4 (2017), 28–35.

[10]

Daniella Briotto Faustino, Sara Nabil, and Audrey Girouard. 2019. Bend or PIN: Studying Bend Password Authentication with People with Vision Impairment. (2019).

[11]

Daniella Briotto Faustino, Sara Nabil, and Audrey Girouard. 2020. Bend or PIN: Studying Bend Password Authentication with People with Vision Impairment. In Graphics Interface. 183–191.

[12]

Audrey Girouard, Jessica Lo, Md Riyadh, Farshad Daliri, Alexander Keith Eady, and Jerome Pasquero. 2015. One-handed bend interactions with deformable smartphones. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, 1509–1518.

Digital Library

[13]

Beverly Harrison, Kenneth P Fishkin, Anuj Gujar, and Carlos Mochon. 1998. Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. In Proceedings of CHI’98. Citeseer.

Digital Library

[14]

Gero Herkenrath, Thorsten Karrer, and Jan Borchers. 2008. Twend: twisting and bending as new interaction gesture in mobile devices. In CHI’08 Extended Abstracts on Human Factors in Computing Systems. ACM, 3819–3824.

[15]

Dennis E Hinkle, William Wiersma, and Stephen G Jurs. 2003. Applied statistics for the behavioral sciences. Vol. 663. Houghton Mifflin College Division.

[16]

David Holman and Roel Vertegaal. 2008. Organic user interfaces: designing computers in any way, shape, or form. Commun. ACM 51, 6 (2008), 48–55.

Digital Library

[17]

David Holman, Roel Vertegaal, Mark Altosaar, Nikolaus Troje, and Derek Johns. 2005. Paper windows: interaction techniques for digital paper. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 591–599.

Digital Library

[18]

Jochen Huber, Jürgen Steimle, and Max Mühlhäuser. 2010. Toward more efficient user interfaces for mobile video browsing: an in-depth exploration of the design space. In Proceedings of the 18th ACM international conference on Multimedia. ACM, 341–350.

Digital Library

[19]

Marco A Hudelist, Klaus Schoeffmann, and Laszlo Boeszoermenyi. 2013. Mobile video browsing with the thumbbrowser. In Proceedings of the 21st ACM international conference on Multimedia. ACM, 405–406.

Digital Library

[20]

Wolfgang Hürst and Philipp Merkle. 2008. One-handed mobile video browsing. In Proceedings of the 1st international conference on Designing interactive user experiences for TV and video. 169–178.

Digital Library

[21]

Robert JK Jacob, Audrey Girouard, Leanne M Hirshfield, Michael S Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-based interaction: a framework for post-WIMP interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems. 201–210.

Digital Library

[22]

Amy K Karlson and Benjamin B Bederson. 2007. ThumbSpace: generalized one-handed input for touchscreen-based mobile devices. In IFIP Conference on Human-Computer Interaction. Springer, 324–338.

[23]

Johan Kildal, Andrés Lucero, and Marion Boberg. 2013. Twisting touch: combining deformation and touch as input within the same interaction cycle on handheld devices. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services. 237–246.

Digital Library

[24]

Sunjun Kim, Jihyun Yu, and Geehyuk Lee. 2012. Interaction techniques for unreachable objects on the touchscreen. In Proceedings of the 24th Australian Computer-Human Interaction Conference. 295–298.

Digital Library

[25]

Yuichiro Kota and Minoru Ikeda. 2006. Mobile phone with camera. US Patent 7,003,318.

[26]

Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1303–1312.

Digital Library

[27]

Sang-Su Lee, Sohyun Kim, Bopil Jin, Eunji Choi, Boa Kim, Xu Jia, Daeeop Kim, and Kun-pyo Lee. 2010. How users manipulate deformable displays as input devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1647–1656.

Digital Library

[28]

Sang-su Lee, Youn-kyung Lim, and Kun-Pyo Lee. 2012. Exploring the effects of size on deformable user interfaces. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion. ACM, 89–94.

Digital Library

[29]

Jessica Lo and Audrey Girouard. 2017. Bendy: Exploring mobile gaming with flexible devices. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction. 163–172.

Digital Library

[30]

Samudrala Nagaraju. 2013. Novel user interaction styles with flexible/rollable screens. In Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI. 1–7.

Digital Library

[31]

Anne Roudaut, Stéphane Huot, and Eric Lecolinet. 2008. TapTap and MagStick: improving one-handed target acquisition on small touch-screens. In Proceedings of the working conference on Advanced visual interfaces. 146–153.

Digital Library

[32]

Carsten Schwesig, Ivan Poupyrev, and Eijiro Mori. 2003. Gummi: user interface for deformable computers. In CHI’03 Extended Abstracts on Human Factors in Computing Systems. ACM, 954–955.

[33]

Carsten Schwesig, Ivan Poupyrev, and Eijiro Mori. 2004. Gummi: a bendable computer. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 263–270.

Digital Library

[34]

Samuel Sanford Shapiro and Martin B Wilk. 1965. An analysis of variance test for normality (complete samples). Biometrika 52, 3/4 (1965), 591–611.

[35]

Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013. Flexpad: highly flexible bending interactions for projected handheld displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 237–246.

Digital Library

[36]

Kristen Warren, Jessica Lo, Vaibhav Vadgama, and Audrey Girouard. 2013. Bending the rules: bend gesture classification for flexible displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 607–610.

Digital Library

[37]

Jun-ichiro Watanabe, Arito Mochizuki, and Youichi Horry. 2008. Bookisheet: bendable device for browsing content using the metaphor of leafing through the pages. In Proceedings of the 10th international conference on Ubiquitous computing. 360–369.

[38]

Doug Wightman, Tim Ginn, and Roel Vertegaal. 2011. Bendflip: examining input techniques for electronic book readers with flexible form factors. In IFIP Conference on Human-Computer Interaction. Springer, 117–133.

[39]

Jacob O Wobbrock, Meredith Ringel Morris, and Andrew D Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1083–1092.

Digital Library

[40]

Yue Wu, Tao Mei, Nenghai Yu, and Shipeng Li. 2012. Accelerometer-based single-handed video browsing on mobile devices: design and user studies. In Proceedings of the 4th International Conference on Internet Multimedia Computing and Service. 157–160.

Digital Library

Cited By

Borah PSorathia K(2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
https://doi.org/10.1080/0144929X.2023.2245062

Recommendations

Natural and Intuitive Deformation Gestures for One-handed Landscape Mode Interaction
TEI '19: Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction

The landscape orientation of smartphone offers a better aspect ratio and extensive view for watching media and photography. However, it presents challenges of occlusion, reachability, and frequent re-gripping in one-handed interactions. To address these ...
One-Handed Bend Interactions with Deformable Smartphones
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Smartphones are becoming larger, mainly because bigger screens offer a better experience for viewing content. One drawback of larger screens is that they make single-hand interactions difficult because of hard to reach touch targets and of the need to ...
One-Handed Interaction Technique for Single-Touch Gesture Input on Large Smartphones
SUI '19: Symposium on Spatial User Interaction

We propose a one-handed interaction technique using cursor based on touch pressure to enable users to perform various single-touch gestures such as a tap, swipe, drag, and double-tap on unreachable targets. In the proposed technique, cursor mode is ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IndiaHCI '21: Proceedings of the 12th Indian Conference on Human-Computer Interaction

November 2021

155 pages

ISBN:9781450396073

DOI:10.1145/3506469

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 February 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

India HCI 2021

India HCI 2021: India HCI 2021

November 19 - 21, 2021

Virtual Event, India

Acceptance Rates

Overall Acceptance Rate 33 of 93 submissions, 35%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
104
Total Downloads

Downloads (Last 12 months)40
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Borah PSorathia K(2023)Investigating user performance and preference for two magnitude levels of size and angle of bend on a smartphone-sized flexible deviceBehaviour & Information Technology10.1080/0144929X.2023.2245062(1-27)Online publication date: 13-Sep-2023
https://doi.org/10.1080/0144929X.2023.2245062

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents