research-article

Exploring Visual Signifier Characteristics to Improve the Perception of Affordances of In-Place Touch Inputs

Authors:

Sylvain MalacriaAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 7, Issue MHCI

Article No.: 210, Pages 1 - 32

https://doi.org/10.1145/3604257

Published: 13 September 2023 Publication History

Abstract

Touch screens supporting different inputs such as 'Tap', 'Dwell', 'Double Tap' and 'Force Press' are omnipresent in modern devices and yet this variety of interaction opportunities is rarely communicated to the user. Without visual signifiers, these potentially useful inputs remain unknown or underutilised. We propose a design space of visual signifier characteristics that may impact the perception of in-place one finger inputs. We generated 36 designs and investigated their perception in an online survey (N=32) and an interactive experiment (N=24). The results suggest that visual signifiers increase the perception of input possibilities beyond 'Tap', and reduce perceived mental effort for participants, who also prefer added visual signifiers over a baseline. Our work informs how future touch-based interfaces could be designed to better communicate in-place single finger input possibilities.

References

[1]

Sherman R Alpert. 1991. Self-describing animated icons for human-computer interaction: a research note. Behaviour & Information Technology 10, 2 (1991), 149--152.

[2]

Axel Antoine, Sylvain Malacria, and Géry Casiez. 2017. ForceEdge: Controlling Autoscroll on Both Desktop and Mobile Computers Using the Force. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 3281--3292. https://doi.org/10.1145/3025453.3025605

Digital Library

[3]

Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2012. Dwell-and-Spring: Undo for Direct Manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 1957--1966. https://doi.org/10.1145/2207676.2208339

Digital Library

[4]

Liv Arleth, Emilie Lind Damkjær, and Hendrik Knoche. 2020. ?But Wait, There's More!" a Deeper Look into Temporally Placing Touch Gesture Signifiers. In Interactivity, Game Creation, Design, Learning, and Innovation: 8th EAI International Conference, ArtsIT 2019, and 4th EAI International Conference, DLI 2019, Aalborg, Denmark, November 6--8, 2019, Proceedings 8. Springer, 290--308. https://doi.org/10.1007/978--3-030--53294--9_20

[5]

Jeff Avery, Sylvain Malacria, Mathieu Nancel, Géry Casiez, and Edward Lank. 2018. Introducing Transient Gestures to Improve Pan and Zoom on Touch Surfaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3173574.3173599

Digital Library

[6]

Alethea L Blackler, Rafael Gomez, Vesna Popovic, and M Helen Thompson. 2016. Life is too short to RTFM: how users relate to documentation and excess features in consumer products. Interacting with Computers 28, 1 (2016), 27--46.

[7]

David Bonnet, Caroline Appert, and Michel Beaudouin-Lafon. 2013. Extending the Vocabulary of Touch Events with ThumbRock. In Proceedings of Graphics Interface 2013 (GI '13). CHCCS, Regina (Saskatchewan), Canada. https://hal.inria.fr/hal-00839414

Digital Library

[8]

Josh Clark. 2015. Designing for touch. A Book Apart New York.

[9]

Emilie Lind Damkjær, Liv Arleth, and Hendrik Knoche. 2019. ?I Didn't Know, You Could Do That"-Affordance Signifiers for Touch Gestures on Mobile Devices. In Interactivity, Game Creation, Design, Learning, and Innovation: 7th EAI International Conference, ArtsIT 2018, and 3rd EAI International Conference, DLI 2018, ICTCC 2018, Braga, Portugal, October 24--26, 2018, Proceedings 7. Springer, 206--212.

[10]

William Delamare, Thomas Janssoone, Céline Coutrix, and Laurence Nigay. 2016. Designing 3D Gesture Guidance: Visual Feedback and Feedforward Design Options. In Proceedings of the International Working Conference on Advanced Visual Interfaces (Bari, Italy) (AVI '16). Association for Computing Machinery, New York, NY, USA, 152--159. https://doi.org/10.1145/2909132.2909260

Digital Library

[11]

Anna Dickinson, Roos Eisma, and Peter Gregor. 2011. The barriers that older novices encounter to computer use. Universal Access in the Information Society 10, 3 (2011), 261--266.

Digital Library

[12]

Katherine Fennedy, Angad Srivastava, Sylvain Malacria, and Simon T. Perrault. 2022. Towards a Unified and Efficient Command Selection Mechanism for Touch-Based Devices Using Soft Keyboard Hotkeys. ACM Trans. Comput.-Hum. Interact. 29, 1, Article 4 (jan 2022), 39 pages. https://doi.org/10.1145/3476510

Digital Library

[13]

James J Gibson. 1979. The ecological approach to visual perception. Houghton Mifflin, Boston.

[14]

Vindu Goel. 2017. Apple Piles On the Features and Users Say, 'Enough!'. Retrieved December 9th, 2021 from https://www.nytimes.com/2017/06/02/technology/apple-iphone-developer-conference.html.

[15]

Alix Goguey, Sylvain Malacria, and Carl Gutwin. 2018. Improving Discoverability and Expert Performance in Force- Sensitive Text Selection for Touch Devices with Mode Gauges. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--12. https://doi.org/10.1145/3173574.3174051

Digital Library

[16]

Frank Halasz and Thomas P. Moran. 1982. Analogy Considered Harmful. In Proceedings of the 1982 Conference on Human Factors in Computing Systems (Gaithersburg, Maryland, USA) (CHI '82). Association for Computing Machinery, New York, NY, USA, 383--386. https://doi.org/10.1145/800049.801816

Digital Library

[17]

Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011. TapSense: Enhancing Finger Interaction on Touch Surfaces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 627--636. https://doi.org/10.1145/2047196.2047279

Digital Library

[18]

Seongkook Heo, Jiseong Gu, and Geehyuk Lee. 2014. Expanding Touch Input Vocabulary by Using Consecutive Distant Taps. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 2597--2606. https://doi.org/10.1145/2556288.2557234

Digital Library

[19]

Seongkook Heo and Geehyuk Lee. 2011. Forcetap: Extending the Input Vocabulary of Mobile Touch Screens by Adding Tap Gestures. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (Stockholm, Sweden) (MobileHCI '11). Association for Computing Machinery, New York, NY, USA, 113--122. https://doi.org/10.1145/2037373.2037393

Digital Library

[20]

Jamie Holst. 2013. Users Continue to Double-Click Online. https://baymard.com/blog/users-double-click-online

[21]

Shih-Wen Hsiao, Chiao-Fei Hsu, and Yin-Ting Lee. 2012. An online affordance evaluation model for product design. Design Studies 33, 2 (2012), 126--159. https://doi.org/10.1016/j.destud.2011.06.003

[22]

Apple Inc. 2023. Buttons. https://developer.apple.com/design/human-interface-guidelines/components/menus-and-actions/buttons/

[23]

Material IO. 2023. Material Design Buttons. https://m2.material.io/components/buttons

[24]

Steve Jobs. 2007. Macworld San Francisco 2007 - Steve Jobs introduced the first iPhone.

[25]

Patrick W Jordan, Stephen W Draper, Kirsteen K MacFarlane, and Shirley-Anne McNulty. 1991. Guessability, learnability, and experienced user performance. In People and Computers VI - Proceedings of the HCI '91 Conference. Cambridge University Press.

[26]

Alita Joyce. 2020. Mobile-App Onboarding: An Analysis of Components and Techniques. Retrieved January 27th, 2023 from https://www.nngroup.com/articles/mobile-app-onboarding/.

[27]

Jacob Kastrenakes. 2018. Apple could remove 3D Touch from future iPhones, analyst says. Retrieved January 21st, 2023 from https://www.theverge.com/circuitbreaker/2018/8/27/17787938/apple-new-iphone-3d-touch-pencil-support-missing.

[28]

Sangyeon Kim and Sangwon Lee. 2020. Smash the dichotomy of Skeuomorphism and flat design: Designing an affordable interface to correspond with the human perceptuomotor process. International Journal of Human-Computer Studies 141 (2020), 102435.

[29]

Sangyeon Kim and Sangwon Lee. 2020. Touch Digitality: Affordance Effects of Visual Properties on Gesture Selection. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3382914

Digital Library

[30]

Jon A Krosnick and Duane F Alwin. 1987. An evaluation of a cognitive theory of response-order effects in survey measurement. Public opinion quarterly 51, 2 (1987), 201--219.

[31]

Vincent Lambert, Adrien Chaffangeon Caillet, Alix Goguey, Sylvain Malacria, and Laurence Nigay. 2023. Studying the Visual Representation of Microgestures. Proc. ACM Hum.-Comput. Interact. 7, MHCI, Article 225 (2023). https://doi.org/10.1145/3604272

Digital Library

[32]

Sven Mayer, Lars Lischke, Adrian Lanksweirt, Huy Viet Le, and Niels Henze. 2018. How to communicate new input techniques. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction - NordiCHI '18. ACM Press, Oslo, Norway, 460--472. https://doi.org/10.1145/3240167.3240176

Digital Library

[33]

Joanna McGrenere and Wayne Ho. 2000. Affordances: Clarifying and evolving a concept. In Graphics interface, Vol. 2000. 179--186.

[34]

Donald A. Norman. 2008. THE WAY I SEE ITSignifiers, Not Affordances. Interactions 15, 6 (nov 2008), 18--19. https://doi.org/10.1145/1409040.1409044

Digital Library

[35]

Donald A. Norman. 2013. The design of everyday things: Revised and expanded edition. Basic books.

[36]

Donald A. Norman. 2018. Affordances and design. https://ns.inria.fr/discovery/refs/norman2018affordances.pdf retrieved January 27th, 2022 from https://jnd.org/affordances_and_design/.

[37]

Martin T Orne. 2009. Demand characteristics and the concept of quasi-controls. Artifacts in behavioral research: Robert Rosenthal and Ralph L. Rosnow's classic books 110 (2009), 110--137.

[38]

David Oswald. 2018. Affordances and metaphors revisited: testing flat vs. skeuomorph design with digital natives and digital immigrants. In Proceedings of the 32nd International BCS Human Computer Interaction Conference 32. BCS Learning & Development Ltd., Swindon, GBR, 1--11. https://doi.org/10.14236/ewic/HCI2018.57

[39]

Nicole Ke Chen Pong. 2020. Interacting with signifier-less designs-the case of swhidgets. Ph.D. Dissertation. Université de Lille.

[40]

Nicole Ke Chen Pong and Sylvain Malacria. 2019. Awareness, Usage and Discovery of Swipe-Revealed Hidden Widgets in IOS. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (Daejeon, Republic of Korea) (ISS '19). Association for Computing Machinery, New York, NY, USA, 193--204. https://doi.org/10.1145/3343055.3359713

Digital Library

[41]

Jef Raskin. 2000. The humane interface: new directions for designing interactive systems. Addison-Wesley Professional.

Digital Library

[42]

Christian Rendl, Patrick Greindl, Kathrin Probst, Martin Behrens, and Michael Haller. 2014. Presstures: Exploring Pressure-Sensitive Multi-Touch Gestures on Trackpads. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). Association for Computing Machinery, New York, NY, USA, 431--434. https://doi.org/10.1145/2556288.2557146

Digital Library

[43]

Anne Roudaut, Eric Lecolinet, and Yves Guiard. 2009. MicroRolls: Expanding Touch-Screen Input Vocabulary by Distinguishing Rolls vs. Slides of the Thumb. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA). Association for Computing Machinery, New York, NY, USA, 927--936. https://doi.org/10.1145/1518701.1518843

Digital Library

[44]

Mindy Seto, Stacey Scott, and Mark Hancock. 2012. Investigating Menu Discoverability on a Digital Tabletop in a Public Setting. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (Cambridge, Massachusetts, USA) (ITS '12). Association for Computing Machinery, New York, NY, USA, 71--80. https://doi.org/10.1145/2396636.2396647

Digital Library

[45]

Konstantinos Spiliotopoulos, Maria Rigou, and Spiros Sirmakessis. 2018. A comparative study of skeuomorphic and flat design from a UX perspective. Multimodal Technologies and Interaction 2, 2 (2018), 31.

[46]

Jacob O. Wobbrock, Htet Htet Aung, Brandon Rothrock, and Brad A. Myers. 2005. Maximizing the Guessability of Symbolic Input. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, USA) (CHI EA '05). Association for Computing Machinery, New York, NY, USA, 1869--1872. https://doi.org/10.1145/1056808.1057043

Digital Library

[47]

Koji Yatani, Kurt Partridge, Marshall Bern, and Mark W. Newman. 2008. Escape: A Target Selection Technique Using Visually-Cued Gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI '08). Association for Computing Machinery, New York, NY, USA, 285--294. https://doi.org/10.1145/1357054.1357104

Digital Library

[48]

J. Zimmerman. 2005. Video sketches: exploring pervasive computing interaction designs. IEEE Pervasive Computing 4, 4 (2005), 91--94. https://doi.org/10.1109/MPRV.2005.91

Digital Library

Cited By

Lambert VGoguey AMalacria SNigay L(2024)Studying the Simultaneous Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36765238:MHCI(1-34)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676523
Khurana AGlueck MChilana P(2024)Do I Just Tap My Headset?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314517:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631451
Coutrix CProst C(2024)Impact of Fingernails Length on Mobile Tactile InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642037(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642037
Show More Cited By

Index Terms

Exploring Visual Signifier Characteristics to Improve the Perception of Affordances of In-Place Touch Inputs
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces
    2. Interaction techniques
  2. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

Affordances for practice

This paper argues that Gibson's concept of affordance inserts a powerful conceptual lens for the study of sociomateriality as enacted in contemporary organizational practices. Our objective in this paper is to develop a comprehensive view of affordances ...
Touch Your Own Device! A COVID-Safe Alternative to Multi-touch Interactions with Public Touchscreens
CHI Greece 2021: CHI Greece 2021: 1st International Conference of the ACM Greek SIGCHI Chapter

Touchscreens are a widely used medium for interacting with digital applications in public and they are found in various contexts including entertainment, culture, travel, marketing, etc. However, in the current times of COVID-19 pandemic there are ...
Touch Affordances
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

The workshop "Touch Affordances" addresses a concept relevant to human computer interactions based on touch. The main topic is the challenge of applying the notion of affordances to domains related to touch interactions (e.g. (multi)touch screens, RFID &...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 7, Issue MHCI

MHCI

September 2023

1017 pages

EISSN:2573-0142

DOI:10.1145/3624512

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2023

Published in PACMHCI Volume 7, Issue MHCI

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

Agence Nationale de la Recherche, MIC
Agence Nationale de la Recherche, Discovery

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
262
Total Downloads

Downloads (Last 12 months)130
Downloads (Last 6 weeks)7

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lambert VGoguey AMalacria SNigay L(2024)Studying the Simultaneous Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36765238:MHCI(1-34)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676523
Khurana AGlueck MChilana P(2024)Do I Just Tap My Headset?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314517:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631451
Coutrix CProst C(2024)Impact of Fingernails Length on Mobile Tactile InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642037(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642037
Mackamul ECasiez GMalacria S(2024)Clarifying and differentiating discoverabilityHuman–Computer Interaction10.1080/07370024.2024.2364606(1-26)Online publication date: 13-Jun-2024
https://doi.org/10.1080/07370024.2024.2364606
Lambert VChaffangeon Caillet AGoguey AMalacria SNigay L(2023)Studying the Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36042727:MHCI(1-36)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604272

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents