research-article

Open access

Push, Tap, Dwell, and Pinch: Evaluation of Four Mid-air Selection Methods Augmented with Ultrasonic Haptic Feedback

Authors:

Tafadzwa Joseph Dube,

Hannah Limerick,

I. Scott MacKenzie,

Ahmed Sabbir ArifAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 6, Issue ISS

Article No.: 565, Pages 207 - 225

https://doi.org/10.1145/3567718

Published: 14 November 2022 Publication History

Abstract

This work compares four mid-air target selection methods (Push, Tap, Dwell, Pinch) with two types of ultrasonic haptic feedback (Select, HoverSelect) in a Fitts’ law experiment. Results revealed that Tap is the fastest, the most accurate, and one of the least physically and cognitively demanding selection methods. Pinch is relatively fast but error prone and physically and cognitively demanding. Dwell is slowest by design, yet the most accurate and the least physically and cognitively demanding. Both haptic feedback methods improve selection performance by increasing users’ spatial awareness. Particularly, Push augmented with Hover & Select feedback is comparable to Tap. Besides, participants perceive the selection methods as faster, more accurate, and more physically and cognitively comfortable with the haptic feedback methods.

Supplementary Material

Teaser (iss22main-id7450-p-teaser.mp4)

This work compares four mid-air target selection methods (Push, Tap, Dwell, Pinch) with two types of ultrasonic haptic feedback (Select, HoverSelect) in a Fitts’ law experiment. Results revealed that Tap is the fastest, the most accurate, and one of the least physically and cognitively demanding selection methods. Pinch is relatively fast but error prone and physically and cognitively demanding. Dwell is slowest by design, yet the most accurate and the least physically and cognitively demanding. Both haptic feedback methods improve selection performance by increasing users’ spatial awareness. Particularly, Push augmented with Hover & Select feedback is comparable to Tap. Besides, participants perceive the selection methods as faster, more accurate, and more physically and cognitively comfortable with the haptic feedback methods.

Download
40.11 MB

References

[1]

Christopher Ackad, Andrew Clayphan, Martin Tomitsch, and Judy Kay. 2015. An in-the-Wild Study of Learning Mid-Air Gestures to Browse Hierarchical Information at a Large Interactive Public Display. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’15). Association for Computing Machinery, New York, NY, USA. 1227–1238. isbn:978-1-4503-3574-4 https://doi.org/10.1145/2750858.2807532

Digital Library

[2]

Ahmed Sabbir Arif, Wolfgang Stuerzlinger, Euclides Jose de Mendonca Filho, and Alec Gordynski. 2014. Error Behaviours in an Unreliable in-Air Gesture Recognizer. In CHI ’14 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’14). Association for Computing Machinery, New York, NY, USA. 1603–1608. isbn:978-1-4503-2474-8 https://doi.org/10.1145/2559206.2581188

Digital Library

[3]

Rahul Arora, Rubaiat Habib Kazi, Danny M. Kaufman, Wilmot Li, and Karan Singh. 2019. MagicalHands: Mid-Air Hand Gestures for Animating in VR. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST ’19). Association for Computing Machinery, New York, NY, USA. 463–477. isbn:978-1-4503-6816-2 https://doi.org/10.1145/3332165.3347942

Digital Library

[4]

Daniel Bachmann, Frank Weichert, and Gerhard Rinkenauer. 2015. Evaluation of the Leap Motion Controller as a New Contact-Free Pointing Device. Sensors, 15, 1 (2015), Jan., 214–233. https://doi.org/10.3390/s150100214

[5]

Norman I. Badler, Kamran H. Manoochehri, and David Baraff. 1987. Multi-Dimensional Input Techniques and Articulated Figure Positioning by Multiple Constraints. In Proceedings of the 1986 workshop on Interactive 3D graphics (I3D ’86). Association for Computing Machinery, New York, NY, USA. 151–169. isbn:978-0-89791-228-0 https://doi.org/10.1145/319120.319132

Digital Library

[6]

Anil Ufuk Batmaz, Aunnoy K Mutasim, Morteza Malekmakan, Elham Sadr, and Wolfgang Stuerzlinger. 2020. Touch the Wall: Comparison of Virtual and Augmented Reality with Conventional 2D Screen Eye-Hand Coordination Training Systems. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Washington, DC, USA. 184–193. https://doi.org/10.1109/VR46266.2020.00037 ISSN: 2642-5254.

[7]

Michelle A. Brown and Wolfgang Stuerzlinger. 2016. Exploring the Throughput Potential of In-Air Pointing. In Human-Computer Interaction. Interaction Platforms and Techniques, Masaaki Kurosu (Ed.) (Lecture Notes in Computer Science). Springer International Publishing, Cham. 13–24. isbn:978-3-319-39516-6 https://doi.org/10.1007/978-3-319-39516-6_2

Digital Library

[8]

Arthur Theil Cabreira and Faustina Hwang. 2015. An Analysis of Mid-Air Gestures Used across Three Platforms. In Proceedings of the 2015 British HCI Conference (British HCI ’15). Association for Computing Machinery, New York, NY, USA. 257–258. isbn:978-1-4503-3643-7 https://doi.org/10.1145/2783446.2783599

Digital Library

[9]

Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: Multi-Point Mid-Air Haptic Feedback for Touch Surfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST ’13). Association for Computing Machinery, New York, NY, USA. 505–514. isbn:978-1-4503-2268-3 https://doi.org/10.1145/2501988.2502018

Digital Library

[10]

Ishan Chatterjee, Robert Xiao, and Chris Harrison. 2015. Gaze+Gesture: Expressive, Precise and Targeted Free-Space Interactions. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction. Association for Computing Machinery, Seattle, Washington, USA. 131–138. isbn:978-1-4503-3912-4 https://doi.org/10.1145/2818346.2820752

Digital Library

[11]

Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences (2 ed.). Routledge, New York, NY, USA. isbn:978-0-203-77158-7 https://doi.org/10.4324/9780203771587

[12]

Patricia Ivette Cornelio Martinez, Silvana De Pirro, Chi Thanh Vi, and Sriram Subramanian. 2017. Agency in Mid-Air Interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA. 2426–2439. isbn:978-1-4503-4655-9

Digital Library

[13]

Kiran Dandekar, Balasundar I. Raju, and Mandayam A. Srinivasan. 2003. 3-D Finite-Element Models of Human and Monkey Fingertips to Investigate the Mechanics of Tactile Sense. Journal of Biomechanical Engineering, 125, 5 (2003), Oct., 682–691. issn:0148-0731 https://doi.org/10.1115/1.1613673

[14]

Katherine Fennedy, Jeremy Hartmann, Quentin Roy, Simon T. Perrault, and Daniel Vogel. 2021. OctoPocus in VR: Using a Dynamic Guide for 3D Mid-Air Gestures in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics, XX, X (2021), 1–1. issn:1941-0506 https://doi.org/10.1109/TVCG.2021.3101854 Conference Name: IEEE Transactions on Visualization and Computer Graphics.

Digital Library

[15]

Stephanie Foehrenbach, Werner A. König, Jens Gerken, and Harald Reiterer. 2009. Tactile Feedback Enhanced Hand Gesture Interaction at Large, High-Resolution Displays. Journal of Visual Languages & Computing, 20, 5 (2009), Oct., 341–351. issn:1045-926X https://doi.org/10.1016/j.jvlc.2009.07.005

Digital Library

[16]

Andris Freivalds. 2011. Biomechanics of the Upper Limbs: Mechanics, Modeling and Musculoskeletal Injuries, Second Edition. CRC Press, Boca Raton, FL, USA. isbn:978-1-4200-9119-9 Google-Books-ID: fmk_F9ZWMoQC.

[17]

Orestis Georgiou, Hannah Limerick, Loïc Corenthy, Mark Perry, Mykola Maksymenko, Sam Frish, Jörg Müller, Myroslav Bachynskyi, and Jin Ryong Kim. 2019. Mid-Air Haptic Interfaces for Interactive Digital Signage and Kiosks. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Glasgow Scotland Uk. 1–9. isbn:978-1-4503-5971-9 https://doi.org/10.1145/3290607.3299030

Digital Library

[18]

Sukeshini A. Grandhi, Gina Joue, and Irene Mittelberg. 2011. Understanding Naturalness and Intuitiveness in Gesture Production: Insights for Touchless Gestural Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA. 821–824. isbn:978-1-4503-0228-9

Digital Library

[19]

Sidhant Gupta, Dan Morris, Shwetak N. Patel, and Desney Tan. 2013. AirWave: Non-Contact Haptic Feedback Using Air Vortex Rings. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’13). Association for Computing Machinery, New York, NY, USA. 419–428. isbn:978-1-4503-1770-2 https://doi.org/10.1145/2493432.2493463

Digital Library

[20]

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology. 52, Elsevier, Amsterdam, The Netherlands. 139–183. isbn:978-0-444-70388-0 https://doi.org/10.1016/S0166-4115(08)62386-9

[21]

Benjamin Hatscher and Christian Hansen. 2018. Hand, Foot or Voice: Alternative Input Modalities for Touchless Interaction in the Medical Domain. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (ICMI ’18). Association for Computing Machinery, New York, NY, USA. 145–153. isbn:978-1-4503-5692-3 https://doi.org/10.1145/3242969.3242971

Digital Library

[22]

Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’14). Association for Computing Machinery, New York, NY, USA. 1063–1072. isbn:978-1-4503-2473-1 https://doi.org/10.1145/2556288.2557130

Digital Library

[23]

Ken Hinckley, Randy Pausch, John C. Goble, and Neal F. Kassell. 1994. A Survey of Design Issues in Spatial Input. In Proceedings of the 7th annual ACM symposium on User interface software and technology (UIST ’94). Association for Computing Machinery, New York, NY, USA. 213–222. isbn:978-0-89791-657-8 https://doi.org/10.1145/192426.192501

Digital Library

[24]

Takayuki Hoshi, Takayuki Iwamoto, and Hiroyuki Shinoda. 2009. Non-Contact Tactile Sensation Synthesized by Ultrasound Transducers. In World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, Washington, D.C., USA. 256–260. https://doi.org/10.1109/WHC.2009.4810900

Digital Library

[25]

Takayuki Hoshi, Masafumi Takahashi, Takayuki Iwamoto, and Hiroyuki Shinoda. 2010. Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound. IEEE Transactions on Haptics, 3, 3 (2010), July, 155–165. issn:2329-4051 https://doi.org/10.1109/TOH.2010.4 Conference Name: IEEE Transactions on Haptics.

Digital Library

[26]

Seki Inoue, Yasutoshi Makino, and Hiroyuki Shinoda. 2015. Active Touch Perception Produced by Airborne Ultrasonic Haptic Hologram. In 2015 IEEE World Haptics Conference (WHC). IEEE, Washington, DC, USA. 362–367. https://doi.org/10.1109/WHC.2015.7177739

[27]

International Organization for Standardization. 2012. ISO/TS 9241-411:2012. https://www.iso.org/cms/render/live/en/sites/isoorg/contents/data/standard/05/41/54106.html

[28]

Muhammad Zahid Iqbal and Abraham Campbell. 2020. The Emerging Need for Touchless Interaction Technologies. Interactions, 27, 4 (2020), July, 51–52. issn:1072-5520 https://doi.org/10.1145/3406100

Digital Library

[29]

Keith S. Jones, Trevor J. McIntyre, and Dennis J. Harris. 2020. Leap Motion- and Mouse-Based Target Selection: Productivity, Perceived Comfort and Fatigue, User Preference, and Perceived Usability. International Journal of Human–Computer Interaction, 36, 7 (2020), April, 621–630. issn:1044-7318 https://doi.org/10.1080/10447318.2019.1666511

[30]

Alvin Jude, G. Michael Poor, and Darren Guinness. 2014. An Evaluation of Touchless Hand Gestural Interaction for Pointing Tasks with Preferred and Non-Preferred Hands. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI ’14). Association for Computing Machinery, New York, NY, USA. 668–676. isbn:978-1-4503-2542-4 https://doi.org/10.1145/2639189.2641207

Digital Library

[31]

Mohamed Khamis, Ludwig Trotter, Ville Mäkelä, Emanuel von Zezschwitz, Jens Le, Andreas Bulling, and Florian Alt. 2018. CueAuth: Comparing Touch, Mid-Air Gestures, and Gaze for Cue-based Authentication on Situated Displays. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2, 4 (2018), Dec., 174:1–174:22. https://doi.org/10.1145/3287052

Digital Library

[32]

Panayiotis Koutsabasis and Panagiotis Vogiatzidakis. 2019. Empirical Research in Mid-Air Interaction: A Systematic Review. International Journal of Human– Computer Interaction, 35, 18 (2019), Nov., 1747–1768. issn:1044-7318 https://doi.org/10.1080/10447318.2019.1572352

[33]

Panayiotis Koutsabasis and Panagiotis Vogiatzidakis. 2019. Empirical Research in Mid-Air Interaction: A Systematic Review. International Journal of Human–Computer Interaction, 35, 18 (2019), Nov., 1747–1768. issn:1044-7318 https://doi.org/10.1080/10447318.2019.1572352 Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/10447318.2019.1572352.

[34]

Laurens R. Krol, Dzmitry Aliakseyeu, and Sriram Subramanian. 2009. Haptic Feedback in Remote Pointing. In CHI ’09 Extended Abstracts on Human Factors in Computing Systems. ACM, Boston MA USA. 3763–3768. isbn:978-1-60558-247-4 https://doi.org/10.1145/1520340.1520568

Digital Library

[35]

Michael Julian Kronester, Andreas Riener, and Teo Babic. 2021. Potential of Wrist-Worn Vibrotactile Feedback to Enhance the Perception of Virtual Objects during Mid-Air Gestures. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Yokohama Japan. 1–7. isbn:978-1-4503-8095-9 https://doi.org/10.1145/3411763.3451655

Digital Library

[36]

David R. Large, Kyle Harrington, Gary Burnett, and Orestis Georgiou. 2019. Feel the Noise: Mid-Air Ultrasound Haptics as a Novel Human-Vehicle Interaction Paradigm. Applied Ergonomics, 81 (2019), Nov., 102909. issn:0003-6870 https://doi.org/10.1016/j.apergo.2019.102909

[37]

Ultraleap Ltd. 2020. Leap Motion Developer. https://developer.leapmotion.com

[38]

I. Scott MacKenzie. 2018. Fitts’ Law. In The Wiley Handbook of Human Computer Interaction. John Wiley & Sons, Ltd, Hoboken, NJ, USA. 347–370. isbn:978-1-118-97600-5 https://doi.org/10.1002/9781118976005.ch17

[39]

William S. Marras. 2006. Basic Biomechanics and Workstation Design. In Handbook of Human Factors and Ergonomics, Gavriel Salvendy (Ed.). Publisher: John Wiley & Sons Publishing Inc., New York, NY, USA. 340–370. isbn:978-1-118-12908-1 Google-Books-ID: WxJVNLzvRVUC.

[40]

Alex Mazursky, Shan-Yuan Teng, Romain Nith, and Pedro Lopes. 2021. Demonstrating Passive yet Interactive Soft Haptic Patches Anywhere Using MagnetIO. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Yokohama Japan. 1–4. isbn:978-1-4503-8095-9 https://doi.org/10.1145/3411763.3451548

Digital Library

[41]

Aunnoy K Mutasim, Anil Ufuk Batmaz, and Wolfgang Stuerzlinger. 2021. Pinch, Click, or Dwell: Comparing Different Selection Techniques for Eye-Gaze-Based Pointing in Virtual Reality. In ACM Symposium on Eye Tracking Research and Applications. Association for Computing Machinery, New York, NY, USA. Article 15, 1–7. isbn:978-1-4503-8345-5 https://doi.org/10.1145/3448018.3457998

Digital Library

[42]

Jörg Müller, Gilles Bailly, Thor Bossuyt, and Niklas Hillgren. 2014. MirrorTouch: Combining Touch and Mid-Air Gestures for Public Displays. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services - MobileHCI ’14. ACM Press, Toronto, ON, Canada. 319–328. isbn:978-1-4503-3004-6 https://doi.org/10.1145/2628363.2628379

Digital Library

[43]

Cisem Ozkul, David Geerts, and Isa Rutten. 2020. Combining Auditory and Mid-Air Haptic Feedback for a Light Switch Button. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI ’20). Association for Computing Machinery, New York, NY, USA. 60–69. isbn:978-1-4503-7581-8 https://doi.org/10.1145/3382507.3418823

Digital Library

[44]

Yesaya Tommy Paulus and Gerard Bastiaan Remijn. 2021. Usability of Various Dwell Times for Eye-Gaze-Based Object Selection with Eye Tracking. Displays, 67 (2021), April, 101997. issn:0141-9382 https://doi.org/10.1016/j.displa.2021.101997

[45]

Giorgia Persichella, Calogero Luca Lomanto, Claudio Mattutino, Fabiana Vernero, and Cristina Gena. 2019. Experimenting Touchless Gestural Interaction for a University Public Web-based Display. In Proceedings of the 13th Biannual Conference of the Italian SIGCHI Chapter: Designing the next interaction (CHItaly ’19). Association for Computing Machinery, New York, NY, USA. 5.

[46]

Ken Pfeuffer, Benedikt Mayer, Diako Mardanbegi, and Hans Gellersen. 2017. Gaze + Pinch Interaction in Virtual Reality. In Proceedings of the 5th Symposium on Spatial User Interaction. ACM, Brighton United Kingdom. 99–108. isbn:978-1-4503-5486-8 https://doi.org/10.1145/3131277.3132180

Digital Library

[47]

Ismo Rakkolainen, Euan Freeman, Antti Sand, Roope Raisamo, and Stephen Brewster. 2021. A Survey of Mid-Air Ultrasound Haptics and Its Applications. IEEE Transactions on Haptics, 14, 1 (2021), Jan., 2–19. issn:2329-4051 https://doi.org/10.1109/TOH.2020.3018754

[48]

Isa Rutten, William Frier, Lawrence Van den Bogaert, and David Geerts. 2019. Invisible Touch: How Identifiable Are Mid-Air Haptic Shapes? In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Glasgow Scotland Uk. 1–6. isbn:978-1-4503-5971-9 https://doi.org/10.1145/3290607.3313004

Digital Library

[49]

Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, New York, NY, USA. 3115–3119. isbn:978-1-4503-4655-9 https://doi.org/10.1145/3025453.3025744

Digital Library

[50]

Manuel César Bessa Seixas, Jorge C S Cardoso, and Maria Teresa Galvão Dias. 2015. One Hand or Two Hands? 2D Selection Tasks With the Leap Motion Device. In Proceedings of the 8th International Conference on Advances in Computer-Human Interactions (ACHI ’15). IARIA, Wilmington, DE, USA. 6. isbn:978-1-61208-382-7

[51]

Roger N. Shepard and Jacqueline Metzler. 1971. Mental Rotation of Three-Dimensional Objects. Science, 171, 3972 (1971), 701–703. issn:0036-8075 https://www.jstor.org/stable/1731476 Publisher: American Association for the Advancement of Science.

[52]

Ali Shtarbanov. 2018. AirTap: A Multimodal Interactive Interface Platform with Free-Space Cutaneous Haptic Feedback Via Toroidal Air-Vortices. Massachusetts Institute of Technology. https://dspace.mit.edu/handle/1721.1/115718

[53]

Rajinder Sodhi, Ivan Poupyrev, Matthew Glisson, and Ali Israr. 2013. AIREAL: Interactive Tactile Experiences in Free Air. ACM Transactions on Graphics, 32, 4 (2013), July, 134:1–134:10. issn:0730-0301 https://doi.org/10.1145/2461912.2462007

Digital Library

[54]

R. William Soukoreff and I. Scott MacKenzie. 2004. Towards a Standard for Pointing Device Evaluation, Perspectives on 27 Years of Fitts’ Law Research in HCI. International Journal of Human-Computer Studies, 61, 6 (2004), Dec., 751–789. issn:1071-5819 https://doi.org/10.1016/j.ijhcs.2004.09.001

Digital Library

[55]

Shan-Yuan Teng, Pengyu Li, Romain Nith, Joshua Fonseca, and Pedro Lopes. 2021. Demonstrating Touch&Fold: A Foldable Haptic Actuator for Rendering Touch in Mixed Reality. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA. Article 203, 1–4. isbn:978-1-4503-8095-9 https://doi.org/10.1145/3411763.3451540

Digital Library

[56]

Ultraleap. 2020. Leap Motion Controller. https://www.ultraleap.com/product/leap-motion-controller/

[57]

Ultraleap. 2020. STRATOS Explore. https://www.ultraleap.com/product/stratos-explore/

[58]

Florian van de Camp, Alexander Schick, and Rainer Stiefelhagen. 2013. How to Click in Mid-Air. In Distributed, Ambient, and Pervasive Interactions, Norbert Streitz and Constantine Stephanidis (Eds.) (Lecture Notes in Computer Science). Springer, Berlin, Heidelberg. 78–86. isbn:978-3-642-39351-8 https://doi.org/10.1007/978-3-642-39351-8_9

Digital Library

[59]

Chi Thanh Vi, Damien Ablart, Elia Gatti, Carlos Velasco, and Marianna Obrist. 2017. Not Just Seeing, but Also Feeling Art: Mid-Air Haptic Experiences Integrated in a Multisensory Art Exhibition. International Journal of Human-Computer Studies, 108 (2017), Dec., 1–14. issn:1071-5819 https://doi.org/10.1016/j.ijhcs.2017.06.004

Digital Library

[60]

Dong-Bach Vo and Stephen A. Brewster. 2015. Touching the Invisible: Localizing Ultrasonic Haptic Cues. In 2015 IEEE World Haptics Conference (WHC). IEEE, Washington, DC, USA. 368–373. https://doi.org/10.1109/WHC.2015.7177740

[61]

Panagiotis Vogiatzidakis and Panayiotis Koutsabasis. 2018. Gesture Elicitation Studies for Mid-Air Interaction: A Review. Multimodal Technologies and Interaction, 2, 4 (2018), Dec., 65. https://doi.org/10.3390/mti2040065 Number: 4 Publisher: Multidisciplinary Digital Publishing Institute.

[62]

Spyros Vosinakis and Panayiotis Koutsabasis. 2018. Evaluation of Visual Feedback Techniques for Virtual Grasping with Bare Hands Using Leap Motion and Oculus Rift. Virtual Reality, 22, 1 (2018), March, 47–62. issn:1434-9957 https://doi.org/10.1007/s10055-017-0313-4

Digital Library

[63]

Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: Revealing Mid-Air Gestures on Public Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA. 841–850. isbn:978-1-4503-1899-0 https://doi.org/10.1145/2470654.2470774

Digital Library

[64]

Robert Walter, Gilles Bailly, Nina Valkanova, and Jörg Müller. 2014. Cuenesics: Using Mid-Air Gestures to Select Items on Interactive Public Displays. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services (MobileHCI ’14). Association for Computing Machinery, New York, NY, USA. 299–308. isbn:978-1-4503-3004-6 https://doi.org/10.1145/2628363.2628368

Digital Library

[65]

Malte Weiss, Chat Wacharamanotham, Simon Voelker, and Jan Borchers. 2011. FingerFlux: Near-Surface Haptic Feedback on Tabletops. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST ’11). Association for Computing Machinery, New York, NY, USA. 615–620. isbn:978-1-4503-0716-1 https://doi.org/10.1145/2047196.2047277

Digital Library

[66]

Daniel Wigdor, Hrvoje Benko, Michael Haller, David Lindlbauer, Ra Ion, Shengdong Zhao, Jeffrey Tzu, Kwan Valino Koh, Ars Electronica Futurelab, and Ars Electronica Gmbh. 2012. Understanding Mid-Air Hand Gestures: A Study of Human Preferences in Usage of Gesture Types for Hci. Microsoft Research, MSR–TR–2012–111.

[67]

Daniel Wigdor and Dennis Wixon. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture (1st ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. isbn:978-0-12-382231-4

Digital Library

[68]

Markus L. Wittorf and Mikkel R. Jakobsen. 2016. Eliciting Mid-Air Gestures for Wall-Display Interaction. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI ’16). Association for Computing Machinery, New York, NY, USA. 1–4. isbn:978-1-4503-4763-1 https://doi.org/10.1145/2971485.2971503

Digital Library

[69]

John S. Zelek, Sam Bromley, Daniel Asmar, and David Thompson. 2003. A Haptic Glove as a Tactile-Vision Sensory Substitution for Wayfinding. Journal of Visual Impairment & Blindness, 97, 10 (2003), Oct., 621–632. issn:0145-482X https://doi.org/10.1177/0145482X0309701007

Cited By

Cordeil MServais ATruong GDwyer TVyas DHurter C(2025)The Presenter in the Browser: Design and Evaluation of Human Interactive Overlays with Web ContentMultimodal Technologies and Interaction10.3390/mti90200109:2(10)Online publication date: 27-Jan-2025
https://doi.org/10.3390/mti9020010
Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Beier RWolling FHornecker EMichahelles F(2024)TipTopTyping: A Thumb-to-Finger Text Input Method and Character Layout Optimized for Mobile Spatial ComputingProceedings of Mensch und Computer 202410.1145/3670653.3670669(196-206)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670669
Show More Cited By

Index Terms

Push, Tap, Dwell, and Pinch: Evaluation of Four Mid-air Selection Methods Augmented with Ultrasonic Haptic Feedback
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction techniques
      1. Gestural input
      2. Pointing

Recommendations

Ultrasonic Keyboard: A Mid-Air Virtual Qwerty with Ultrasonic Feedback for Virtual Reality
TEI '23: Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

Free-hand mid-air Qwerty enables entering text in virtual reality without the use of controllers. However, it is much slower and more error prone than its physical counterpart, primarily due to the absence of haptic feedback and reduced spatial ...
Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction
Human-Computer Interaction – INTERACT 2015
Abstract
Users can interact with large displays in many ways, including touch and mid-air gestures. However, it remains unclear how these ways compare and when users choose one over the other. In a first experiment, we compare touch and mid-air gestures to ...
Evaluating Menu Techniques for Handheld AR with a Smartphone & Mid-Air Pen
MobileHCI '20: 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services

Adding a mid-air pen to Handheld Augmented Reality creates a new kind of bimanual interaction for which many fundamental interaction design questions have not been answered yet. In particular, menus are an essential component in most visual interfaces, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 6, Issue ISS

December 2022

746 pages

EISSN:2573-0142

DOI:10.1145/3554337

Editor:
Jeffrey Nichols
Apple, USA

Issue’s Table of Contents

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution 4.0 International License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2022

Published in PACMHCI Volume 6, Issue ISS

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
772
Total Downloads

Downloads (Last 12 months)336
Downloads (Last 6 weeks)27

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cordeil MServais ATruong GDwyer TVyas DHurter C(2025)The Presenter in the Browser: Design and Evaluation of Human Interactive Overlays with Web ContentMultimodal Technologies and Interaction10.3390/mti90200109:2(10)Online publication date: 27-Jan-2025
https://doi.org/10.3390/mti9020010
Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Beier RWolling FHornecker EMichahelles F(2024)TipTopTyping: A Thumb-to-Finger Text Input Method and Character Layout Optimized for Mobile Spatial ComputingProceedings of Mensch und Computer 202410.1145/3670653.3670669(196-206)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670669
Evangelou GGeorgiou OBrown EHine NMoore J(2024)Mid-Air Haptic Feedback Improves Implicit Agency and Trust in Gesture-Based Automotive Infotainment Systems: a Driving Simulator StudyProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3676882(116-124)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3676882
Thushara BAdithya VSreekanth N(2024)Gesture centric interaction: evaluating hand and head gestures in touchless cursor controlErgonomics10.1080/00140139.2024.2411302(1-21)Online publication date: 23-Oct-2024
https://doi.org/10.1080/00140139.2024.2411302
(2024)BibliographyHuman-Computer Interaction10.1016/B978-0-44-314096-9.00015-4(391-429)Online publication date: 2024
https://doi.org/10.1016/B978-0-44-314096-9.00015-4
MacKenzie I(2024)Scientific foundationsHuman-Computer Interaction10.1016/B978-0-44-314096-9.00010-5(161-201)Online publication date: 2024
https://doi.org/10.1016/B978-0-44-314096-9.00010-5
MacKenzie I(2024)Interaction elementsHuman-Computer Interaction10.1016/B978-0-44-314096-9.00009-9(93-160)Online publication date: 2024
https://doi.org/10.1016/B978-0-44-314096-9.00009-9
Auer SAnthes CReiterer HJetter H(2023)Aircraft Cockpit Interaction in Virtual Reality with Visual, Auditive, and Vibrotactile FeedbackProceedings of the ACM on Human-Computer Interaction10.1145/36264817:ISS(420-443)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626481
Dube TArif A(2023)Ultrasonic Keyboard: A Mid-Air Virtual Qwerty with Ultrasonic Feedback for Virtual RealityProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3573117(1-8)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3573117

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents