research-article

Interactive Public Displays and Wheelchair Users: Between Direct, Personal and Indirect, Assisted Interaction

Authors:

Radu-Daniel Vatavu,

Ovidiu-Ciprian Ungurean,

Laura-Bianca BiliusAuthors Info & Claims

UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology

Article No.: 45, Pages 1 - 17

https://doi.org/10.1145/3526113.3545662

Published: 28 October 2022 Publication History

Abstract

We examine accessible interactions for wheelchair users and public displays with three studies. In a first study, we conduct a Systematic Literature Review, from which we report very few scientific papers on this topic and a preponderant focus on touch input. In a second study, we conduct a Systematic Video Review using YouTube as a data source, and unveil accessibility challenges for public displays and several input modalities alternative to direct touch. In a third study, we conduct semi-structured interviews with eleven wheelchair users to understand their experience interacting with public displays and to collect their preferences for more accessible input modalities. Based on our findings, we propose the “assisted interaction” phase to extend Vogel and Balakrishnan’s four-phase interaction model with public displays, and the “ability” dimension for cross-device interaction design to support, via users’ personal mobile devices, independent use of interactive public displays.

References

[1]

Gavin Andrews, Alice Kemp, Matthew Sunderland, Michael Von Korff, and Tevik Bedirhan Ustun. 2009. Normative Data for the 12 Item WHO Disability Assessment Schedule 2.0. PLoS ONE 4, 12 (2009), e8343. http://doi.org/10.1371/journal.pone.0008343

[2]

Lisa Anthony, YooJin Kim, and Leah Findlater. 2013. Analyzing User-Generated Youtube Videos to Understand Touchscreen Use by People with Motor Impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). ACM, New York, NY, USA, 1223–1232. https://doi.org/10.1145/2470654.2466158

Digital Library

[3]

Carmelo Ardito, Paolo Buono, Maria Francesca Costabile, and Giuseppe Desolda. 2015. Interaction with Large Displays: A Survey. ACM Comput. Surv. 47, 3, Article 46 (feb 2015), 38 pages. https://doi.org/10.1145/2682623

Digital Library

[4]

Yuki Asai, Yuta Ueda, Ryuichi Enomoto, Daisuke Iwai, and Kosuke Sato. 2016. ExtendedHand on Wheelchair. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology(UIST ’16 Adjunct). ACM, New York, NY, USA, 147–148. https://doi.org/10.1145/2984751.2985738

Digital Library

[5]

Teo Babic, Florian Perteneder, Harald Reiterer, and Michael Haller. 2020. Simo: Interactions with Distant Displays by Smartphones with Simultaneous Face and World Tracking. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3334480.3382962

Digital Library

[6]

Matthias Baldauf and Martin Tomitsch. 2020. Pervasive Displays for Public Transport: An Overview of Ubiquitous Interactive Passenger Services. In Proceedings of the 9th ACM International Symposium on Pervasive Displays(PerDis ’20). ACM, New York, NY, USA, 37–45. https://doi.org/10.1145/3393712.3395335

Digital Library

[7]

Marney Beard and Peter Korn. 2001. What I Need is What I Get: Downloadable User Interfaces via Jini and Java. In CHI ’01 Extended Abstracts on Human Factors in Computing Systems(CHI EA ’01). ACM, New York, NY, USA, 15–16. https://doi.org/10.1145/634067.634079

Digital Library

[8]

Laura-Bianca Bilius and Radu-Daniel Vatavu. 2021. Demonstration of GestuRING, a Web Tool for Ring Gesture Input. In The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 124–125. https://doi.org/10.1145/3474349.3480199

Digital Library

[9]

Mark Blythe and Paul Cairns. 2009. Critical Methods and User Generated Content: The IPhone on YouTube. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’09). ACM, New York, NY, USA, 1467–1476. https://doi.org/10.1145/1518701.1518923

Digital Library

[10]

Harry Brignull and Yvonne Rogers. 2003. Enticing People to Interact with Large Public Displays in Public Spaces. In Proceedings of the IFIP TC13 International Conference on Human-Computer Interaction(INTERACT ’03). IOS Press, Amsterdam, the Netherlands, 17–24.

[11]

Frederik Brudy, Christian Holz, Roman Rädle, Chi-Jui Wu, Steven Houben, Clemens Nylandsted Klokmose, and Nicolai Marquardt. 2019. Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). ACM, New York, NY, USA, 1–28. https://doi.org/10.1145/3290605.3300792

Digital Library

[12]

Frederik Brudy, David Ledo, Saul Greenberg, and Andreas Butz. 2014. Is Anyone Looking? Mitigating Shoulder Surfing on Public Displays through Awareness and Protection. In Proc. of the Int. Symposium on Pervasive Displays(PerDis ’14). ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/2611009.2611028

Digital Library

[13]

Scott A. Cambo, Daniel Avrahami, and Matthew L. Lee. 2017. BreakSense: Combining Physiological and Location Sensing to Promote Mobility during Work-Breaks. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, New York, NY, USA, 3595–3607. https://doi.org/10.1145/3025453.3026021

Digital Library

[14]

Richard Cave, Karina Kocemba, Svjetlana Dajic, Holloe Bostock, and Alastair Cook. 2019. PALS: Patching ALS through Crowdsourced Advice, Social Links & Public Awareness. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems(CHI EA ’19). ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3309690

Digital Library

[15]

Andrew D. Christian and Brian L. Avery. 2000. Speak out and Annoy Someone: Experience with Intelligent Kiosks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’00). ACM, New York, NY, USA, 313–320. https://doi.org/10.1145/332040.332449

Digital Library

[16]

Sarah Clinch. 2013. Smartphones and Pervasive Public Displays. IEEE Pervasive Computing 12, 1 (jan 2013), 92–95. https://doi.org/10.1109/MPRV.2013.16

Digital Library

[17]

Raimund Dachselt and Robert Buchholz. 2009. Natural Throw and Tilt Interaction between Mobile Phones and Distant Displays. In Proceedings of Extended Abstracts on Human Factors in Computing Systems(CHI EA ’09). ACM, New York, NY, USA, 3253–3258. https://doi.org/10.1145/1520340.1520467

Digital Library

[18]

Nicholas Sheep Dalton. 2013. TapTiles: LED-Based Floor Interaction. In Proc. of the ACM Int. Conference on Interactive Tabletops and Surfaces(ITS ’13). ACM, New York, NY, USA, 165–174. https://doi.org/10.1145/2512349.2512800

Digital Library

[19]

Terence Dickson, Rina R. Wehbe, Fabrice Matulic, and Daniel Vogel. 2021. HybridPointing for Touch: Switching Between Absolute and Relative Pointing on Large Touch Screens. Proc. ACM Hum.-Comput. Interact. 5, ISS, Article 495 (nov 2021), 22 pages. https://doi.org/10.1145/3488540

Digital Library

[20]

Tilman Dingler, Markus Funk, and Florian Alt. 2015. Interaction Proxemics: Combining Physical Spaces for Seamless Gesture Interaction. In Proceedings of the 4th International Symposium on Pervasive Displays(PerDis ’15). ACM, New York, NY, USA, 107–114. https://doi.org/10.1145/2757710.2757722

Digital Library

[21]

U. Doll, Barbara Maurer-Burkhard, B. Spahn, and Bernd Fromm. 1998. Functional Hand Development in Tetraplegia. Spinal Cord 36(1998), 818–821. https://doi.org/10.1038/sj.sc.3100706

[22]

Malin Eiband, Mohamed Khamis, Emanuel von Zezschwitz, Heinrich Hussmann, and Florian Alt. 2017. Understanding Shoulder Surfing in the Wild: Stories from Users and Observers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, New York, NY, USA, 4254–4265. https://doi.org/10.1145/3025453.3025636

Digital Library

[23]

Niklas Elmqvist. 2011. Distributed User Interfaces: State of the Art. In Distributed User Interfaces: Designing Interfaces for the Distributed Ecosystem, José A. Gallud, Ricardo Tesoriero, and Victor M.R. Penichet (Eds.). HCI Series. Springer, London, 1–12. https://link.springer.com/chapter/10.1007/978-1-4471-2271-5_1

[24]

Leah Findlater, Alex Jansen, Kristen Shinohara, Morgan Dixon, Peter Kamb, Joshua Rakita, and Jacob O. Wobbrock. 2010. Enhanced Area Cursors: Reducing Fine Pointing Demands for People with Motor Impairments. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology(UIST ’10). ACM, New York, NY, USA, 153–162. https://doi.org/10.1145/1866029.1866055

Digital Library

[25]

Edwin A. Fleishman. 1967. Performance Assessment Based on an Empirically Derived Task Taxonomy. Human Factors 9, 4 (1967), 349–366. https://doi.org/10.1177/001872086700900408

[26]

Krzysztof Z. Gajos, Jacob O. Wobbrock, and Daniel S. Weld. 2008. Improving the Performance of Motor-Impaired Users with Automatically-Generated, Ability-Based Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’08). ACM, New York, NY, USA, 1257–1266. https://doi.org/10.1145/1357054.1357250

Digital Library

[27]

Vito Gentile, Salvatore Sorce, Alessio Malizia, Fabrizio Milazzo, and Antonio Gentile. 2017. Investigating How User Avatar in Touchless Interfaces Affects Perceived Cognitive Load and Two-Handed Interactions. In Proceedings of the 6th ACM International Symposium on Pervasive Displays(PerDis ’17). ACM, New York, NY, USA, Article 21, 7 pages. https://doi.org/10.1145/3078810.3078831

Digital Library

[28]

Vito Gentile, Salvatore Sorce, Alessio Malizia, Dario Pirrello, and Antonio Gentile. 2016. Touchless Interfaces For Public Displays: Can We Deliver Interface Designers From Introducing Artificial Push Button Gestures?. In Proceedings of the International Working Conference on Advanced Visual Interfaces(AVI ’16). ACM, New York, NY, USA, 40–43. https://doi.org/10.1145/2909132.2909282

Digital Library

[29]

Dimitris Grammenos, Xenophon Zabulis, Chatziantoniou Antonis, Zinovia Stefanidi, Ilia Adami, and Vassiliki Neroutsou. 2018. COIN-O-RAMA: Designing an Interactive Exhibit for Exploring and Engaging with Coin Exhibitions. In Proc. of the 11th Pervasive Technologies Related to Assistive Environments Conf.(PETRA ’18). ACM, New York, NY, USA, 38–45. https://doi.org/10.1145/3197768.3197770

Digital Library

[30]

Kilem Li Gwet. 2008. Computing inter-rater reliability and its variance in the presence of high agreement. British Journal of Mathematical and Statistical Ppsychology 61 (2008), 29–48. https://doi.org/10.1348/000711006X126600

[31]

Simen Hagen and Frode Eika Sandnes. 2010. Toward Accessible Self-Service Kiosks through Intelligent User Interfaces. Personal Ubiquitous Comput. 14, 8 (dec 2010), 715–721. https://doi.org/10.1007/s00779-010-0286-8

Digital Library

[32]

Dave Harley and Geraldine Fitzpatrick. 2009. YouTube and Intergenerational Communication: The Case of Geriatric1927. Univers. Access Inf. Soc. 8, 1 (mar 2009), 5–20. https://doi.org/10.1007/s10209-008-0127-y

Digital Library

[33]

Xiaozhu Hu, Jiting Wang, Weiwei Gao, Chun Yu, and Yuanchun Shi. 2021. FootUI: Assisting People with Upper Body Motor Impairments to Use Smartphones with Foot Gestures on the Bed. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 436, 7 pages. https://doi.org/10.1145/3411763.3451782

Digital Library

[34]

Mikkel R. Jakobsen and Kasper Hornbæk. 2014. Up Close and Personal: Collaborative Work on a High-Resolution Multitouch Wall Display. ACM Trans. Comput.-Hum. Interact. 21, 2, Article 11 (feb 2014), 34 pages. https://doi.org/10.1145/2576099

Digital Library

[35]

Sun Hee Jang. 2011. YouTube as an Innovative Resource for Social Science Research. In Proceedings of the Australian Association for Research in Education Conference. AARE, Melbourne, Australia, 1–16. http://ecite.utas.edu.au/77045

[36]

Seokhee Jeon, Jane Hwang, Gerard J. Kim, and Mark Billinghurst. 2010. Interaction with Large Ubiquitous Displays Using Camera-Equipped Mobile Phones. Pers. Ubiq. Comput. 14, 2 (2010), 83–94. https://doi.org/10.1007/s00779-009-0249-0

Digital Library

[37]

Ricardo Jota, Pedro Lopes, Daniel Wigdor, and Joaquim Jorge. 2014. Let’s Kick It: How to Stop Wasting the Bottom Third of Your Large Screen Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’14). ACM, New York, NY, USA, 1411–1414. https://doi.org/10.1145/2556288.2557316

Digital Library

[38]

Ricardo Jota, Miguel A. Nacenta, Joaquim A. Jorge, Sheelagh Carpendale, and Saul Greenberg. 2010. A Comparison of Ray Pointing Techniques for Very Large Displays. In Proceedings of Graphics Interface 2010(GI ’10). Canadian Inf. Proc. Soc., CAN, 269–276. https://dl.acm.org/doi/10.5555/1839214.1839261

[39]

Shaun K. Kane, Chandrika Jayant, Jacob O. Wobbrock, and Richard E. Ladner. 2009. Freedom to Roam: A Study of Mobile Device Adoption and Accessibility for People with Visual and Motor Disabilities. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility(Assets ’09). ACM, New York, NY, USA, 115–122. https://doi.org/10.1145/1639642.1639663

Digital Library

[40]

Mohamed Khamis, Florian Alt, and Andreas Bulling. 2016. Challenges and Design Space of Gaze-Enabled Public Displays. In Proc. of the ACM Int. Joint Conference on Pervasive and Ubiquitous Computing: Adjunct(UbiComp ’16). ACM, New York, NY, USA, 1736–1745. https://doi.org/10.1145/2968219.2968342

Digital Library

[41]

Mohamed Khamis, Christian Becker, Andreas Bulling, and Florian Alt. 2018. Which One is Me? Identifying Oneself on Public Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173861

Digital Library

[42]

Christian Kray, Daniel Nesbitt, John Dawson, and Michael Rohs. 2010. User-Defined Gestures for Connecting Mobile Phones, Public Displays, and Tabletops. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services(MobileHCI ’10). ACM, New York, NY, USA, 239–248. https://doi.org/10.1145/1851600.1851640

Digital Library

[43]

Xiaohui Liang, Ronald Peterson, and David Kotz. 2020. Securely Connecting Wearables to Ambient Displays with User Intent. IEEE Transactions on Dependable and Secure Computing 17, 4 (2020), 676–690. https://doi.org/10.1109/TDSC.2018.2840979

Digital Library

[44]

Bohyeon Lim, Yvonne Rogers, and Neil Sebire. 2019. Designing to Distract: Can Interactive Technologies Reduce Visitor Anxiety in a Children’s Hospital Setting?ACM Trans. Comput.-Hum. Interact. 26, 2, Article 9 (apr 2019), 19 pages. https://doi.org/10.1145/3301427

Digital Library

[45]

Kelly Mack, Emma McDonnell, Dhruv Jain, Lucy Lu Wang, Jon E. Froehlich, and Leah Findlater. 2021. What Do We Mean by “Accessibility Research”? A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019. In Proc. of the CHI Conference on Human Factors in Computing Systems(CHI ’21). ACM, New York, NY, USA, Article 371, 18 pages. https://doi.org/10.1145/3411764.3445412

Digital Library

[46]

Richard A. Magill and David I. Anderson. 2014. Motor Learning and Control: Concepts and Applications (10th Ed.). McGraw-Hill, New York, NY, USA.

[47]

Ville Mäkelä, Sumita Sharma, Jaakko Hakulinen, Tomi Heimonen, and Markku Turunen. 2017. Challenges in Public Display Deployments: A Taxonomy of External Factors. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, New York, NY, USA, 3426–3475. https://doi.org/10.1145/3025453.3025798

Digital Library

[48]

Ville Mäkelä, Jonas Winter, Jasmin Schwab, Michael Koch, and Florian Alt. 2022. Pandemic Displays: Considering Hygiene on Public Touchscreens in the Post-Pandemic Era. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). ACM, New York, NY, USA, Article 284, 12 pages. https://doi.org/10.1145/3491102.3501937

Digital Library

[49]

Meethu Malu, Pramod Chundury, and Leah Findlater. 2018. Exploring Accessible Smartwatch Interactions for People with Upper Body Motor Impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174062

Digital Library

[50]

Meethu Malu and Leah Findlater. 2015. Personalized, Wearable Control of a Head-Mounted Display for Users with Upper Body Motor Impairments. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, New York, NY, USA, 221–230. https://doi.org/10.1145/2702123.2702188

Digital Library

[51]

Joe Marshall, Duncan Rowland, Stefan Rennick Egglestone, Steve Benford, Brendan Walker, and Derek McAuley. 2011. Breath Control of Amusement Rides. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’11). ACM, New York, NY, USA, 73–82. https://doi.org/10.1145/1978942.1978955

Digital Library

[52]

Yoshio Matsuda and Takashi Komuro. 2020. Dynamic Layout Optimization for Multi-User Interaction with a Large Display. In Proceedings of the 25th International Conference on Intelligent User Interfaces(IUI ’20). ACM, New York, NY, USA, 401–409. https://doi.org/10.1145/3377325.3377481

Digital Library

[53]

Jérémie Melchior, Jean Vanderdonckt, and Peter Van Roy. 2011. A Model-Based Approach for Distributed User Interfaces. In Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems(EICS ’11). ACM, New York, NY, USA, 11–20. https://doi.org/10.1145/1996461.1996488

Digital Library

[54]

Kyle Montague, Hugo Nicolau, and Vicki L. Hanson. 2014. Motor-Impaired Touchscreen Interactions in the Wild. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility(ASSETS ’14). ACM, New York, NY, USA, 123–130. https://doi.org/10.1145/2661334.2661362

Digital Library

[55]

Martez E. Mott, Jane E., Cynthia L. Bennett, Edward Cutrell, and Meredith Ringel Morris. 2018. Understanding the Accessibility of Smartphone Photography for People with Motor Impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174094

Digital Library

[56]

Martez E. Mott, Radu-Daniel Vatavu, Shaun K. Kane, and Jacob O. Wobbrock. 2016. Smart Touch: Improving Touch Accuracy for People with Motor Impairments with Template Matching. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). ACM, New York, NY, USA, 1934–1946. https://doi.org/10.1145/2858036.2858390

Digital Library

[57]

Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. 2010. Requirements and Design Space for Interactive Public Displays. In Proceedings of the 18th ACM International Conference on Multimedia(MM ’10). ACM, New York, NY, USA, 1285–1294. https://doi.org/10.1145/1873951.1874203

Digital Library

[58]

Jörg Müller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. 2012. Looking Glass: A Field Study on Noticing Interactivity of a Shop Window. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’12). ACM, New York, NY, USA, 297–306. https://doi.org/10.1145/2207676.2207718

Digital Library

[59]

Maia Naftali and Leah Findlater. 2014. Accessibility in Context: Understanding the Truly Mobile Experience of Smartphone Users with Motor Impairments. In Proc. of the 16th Int. ACM SIGACCESS Conference on Computers & Accessibility(ASSETS ’14). ACM, New York, NY, USA, 209–216. https://doi.org/10.1145/2661334.2661372

Digital Library

[60]

Wolfgang Narzt, Otto Weichselbaum, Gustav Pomberger, Markus Hofmarcher, Michael Strauss, Peter Holzkorn, Roland Haring, and Monika Sturm. 2018. Estimating Collective Attention toward a Public Display. ACM Trans. Interact. Intell. Syst. 8, 3, Article 21 (jul 2018), 34 pages. https://doi.org/10.1145/3230715

Digital Library

[61]

Andrea Nutsi. 2015. Usability Guidelines for Co-Located Multi-User Interaction on Wall Displays. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces(ITS ’15). ACM, New York, NY, USA, 433–438. https://doi.org/10.1145/2817721.2820983

Digital Library

[62]

Jeni Paay, Dimitrios Raptis, Jesper Kjeldskov, Bjarke M. Lauridsen, Ivan S. Penchev, Elias Ringhauge, and Eric V. Ruder. 2017. A Comparison of Techniques for Cross-Device Interaction from Mobile Devices to Large Displays. J. Mob. Multimed. 12, 3–4 (apr 2017), 243–264. https://dl.acm.org/doi/10.1145/3007120.3007140

[63]

Mariah Papy, Duncan Calder, Ngu Dang, Aidan McLaughlin, Breanna Desrochers, and John Magee. 2019. Simulation of Motor Impairment With Reverse Angle Mouse in a Head-Controlled Pointer Fitts’ law Task. In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’19). ACM, New York, NY, USA, 545–547. https://doi.org/10.1145/3308561.3354623

Digital Library

[64]

Callum Parker, Joel Fredericks, Martin Tomitsch, and Soojeong Yoo. 2017. Towards Adaptive Height-Aware Public Interactive Displays. In Adj. Publication of the 25th Conf. on User Modeling, Adaptation and Personalization(UMAP ’17). ACM, New York, NY, USA, 257–260. https://doi.org/10.1145/3099023.3099060

Digital Library

[65]

Callum Parker, Judy Kay, and Martin Tomitsch. 2018. Device-Free: An Implicit Personalisation Approach for Public Interactive Displays. In Proceedings of the Australasian Computer Science Week Multiconference(ACSW ’18). ACM, New York, NY, USA, Article 8, 8 pages. https://doi.org/10.1145/3167918.3167959

Digital Library

[66]

Marc Pous, Circe Serra-Vallmitjana, Rafael Giménez, Marc Torrent-Moreno, and David Boix. 2012. Enhancing accessibility: Mobile to ATM case study. In Proc. of the IEEE Consumer Communications and Networking Conf.(CCNC ’12). IEEE, Washington, D.C., USA, 404–408. https://doi.org/10.1109/CCNC.2012.6181024

[67]

Catia Prandi, Valentina Nisi, and Nuno Nunes. 2017. Bus Stops as Interactive Touchpoints: Improving Engagement and Use of Public Transport. In Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter(CHItaly ’17). ACM, New York, NY, USA, Article 20, 6 pages. https://doi.org/10.1145/3125571.3125593

Digital Library

[68]

Isabel Benavente Rodriguez and Nicolai Marquardt. 2017. Gesture Elicitation Study on How to Opt-in & Opt-out from Interactions with Public Displays. In Proc. of the ACM International Conference on Interactive Surfaces and Spaces(ISS ’17). ACM, New York, NY, USA, 32–41. https://doi.org/10.1145/3132272.3134118

Digital Library

[69]

Elisa Rubegni, Vito Gentile, Alessio Malizia, Salvatore Sorce, and Niko Kargas. 2019. Child-Display Interaction: Exploring Avatar-Based Touchless Gestural Interfaces. In Proc. of the 8th ACM Int. Symp. on Pervasive Displays(PerDis ’19). ACM, New York, NY, USA, Article 23, 7 pages. https://doi.org/10.1145/3321335.3324942

Digital Library

[70]

William Saunders and Daniel Vogel. 2015. The Performance of Indirect Foot Pointing Using Discrete Taps and Kicks While Standing. In Proceedings of the 41st Graphics Interface Conference(GI ’15). Canadian Inf. Proc. Soc., CAN, 265–272. https://dl.acm.org/doi/10.5555/2788890.2788937

[71]

Ovidiu-Andrei Schipor, Laura-Bianca Bilius, and Radu-Daniel Vatavu. 2022. WearSkill: Personalized and Interchangeable Input with Wearables for Users with Motor Impairments. In Proceedings of the 19th International Web for All Conference(W4A ’22). ACM, New York, NY, USA, Article 10, 5 pages. https://doi.org/10.1145/3493612.3520455

Digital Library

[72]

Ather Sharif, Victoria Pao, Katharina Reinecke, and Jacob O. Wobbrock. 2020. The Reliability of Fitts’s Law as a Movement Model for People with and without Limited Fine Motor Function. In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’20). ACM, New York, NY, USA, Article 16, 15 pages. https://doi.org/10.1145/3373625.3416999

Digital Library

[73]

Jun Shingu, Patrick Chiu, Sven Kratz, Jim Vaughan, and Don Kimber. 2016. Depth Based Shadow Pointing Interface for Public Displays. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology(UIST ’16 Adjunct). ACM, New York, NY, USA, 79–80. https://doi.org/10.1145/2984751.2985710

Digital Library

[74]

Garth Shoemaker, Anthony Tang, and Kellogg S. Booth. 2007. Shadow Reaching: A New Perspective on Interaction for Large Displays. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology(UIST ’07). ACM, New York, NY, USA, 53–56. https://doi.org/10.1145/1294211.1294221

Digital Library

[75]

Andy P. Siddaway, Alex M. Wood, and Larry V. Hedges. 2019. How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. Annual Review of Psychology 70, 1 (2019), 747–770. https://doi.org/10.1146/annurev-psych-010418-102803

[76]

Alexandru-Ionut Siean, Laura-Bianca Bilius, and Radu-Daniel Vatavu. 2022. Assistive Technology in the Synchrony between Ambient Intelligence and Mixed Reality for People with Motor Disabilities. In Ambient Intelligence - Software and Applications - 12th International Symposium on Ambient Intelligence, Lecture Notes in Networks and Systems 483, P. Novais et al. (Ed.). Springer, Switzerland. https://doi.org/10.1007/978-3-031-06894-2_3

[77]

Alexandru-Ionut Siean and Radu-Daniel Vatavu. 2021. Wearable Interactions for Users with Motor Impairments: Systematic Review, Inventory, and Research Implications. In Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’21). ACM, New York, NY, USA, Article 7, 15 pages. https://doi.org/10.1145/3441852.3471212

Digital Library

[78]

Salvatore Sorce, Vito Gentile, Cristina Enea, Antonio Gentile, Alessio Malizia, and Fabrizio Milazzo. 2017. A Touchless Gestural System for Extended Information Access Within a Campus. In Proceedings of the 2017 ACM SIGUCCS Annual Conference(SIGUCCS ’17). ACM, New York, NY, USA, 37–43. https://doi.org/10.1145/3123458.3123459

Digital Library

[79]

Maurice Ten Koppel, Gilles Bailly, Jörg Müller, and Robert Walter. 2012. Chained Displays: Configurations of Public Displays Can Be Used to Influence Actor-, Audience-, and Passer-by Behavior. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’12). ACM, New York, NY, USA, 317–326. https://doi.org/10.1145/2207676.2207720

Digital Library

[80]

Mihail Terenti and Radu-Daniel Vatavu. 2022. Measuring the User Experience of Vibrotactile Feedback on the Finger, Wrist, and Forearm for Touch Input on Large Displays. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems(CHI EA ’22). ACM, New York, NY, USA, Article 286, 7 pages. https://doi.org/10.1145/3491101.3519704

Digital Library

[81]

Ovidiu-Ciprian Ungurean and Radu-Daniel Vatavu. 2022. ”I Gave up Wearing Rings:” Insights on the Perceptions and Preferences of Wheelchair Users for Interactions with Wearables. IEEE Pervasive Computing(2022), 10 pages. https://doi.org/10.1109/MPRV.2022.3155952

Digital Library

[82]

Ovidiu-Ciprian Ungurean, Radu-Daniel Vatavu, Luis A. Leiva, and Réjean Plamondon. 2018. Gesture Input for Users with Motor Impairments on Touchscreens: Empirical Results Based on the Kinematic Theory. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems(CHI EA ’18). ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188619

Digital Library

[83]

Radu-Daniel Vatavu. 2012. Nomadic Gestures: A Technique for Reusing Gesture Commands for Frequent Ambient Interactions. J. Ambient Intell. Smart Environ. 4, 2 (apr 2012), 79–93. https://doi.org/10.3233/AIS-2012-0137

[84]

Radu-Daniel Vatavu. 2017. Smart-Pockets: Body-Deictic Gestures for Fast Access to Personal Data during Ambient Interactions. International Journal of Human-Computer Studies 103 (2017), 1–21. http://dx.doi.org/10.1016/j.ijhcs.2017.01.005

Digital Library

[85]

Radu-Daniel Vatavu and Ovidiu-Ciprian Ungurean. 2019. Stroke-Gesture Input for People with Motor Impairments: Empirical Results & Research Roadmap. In Proc. of the CHI Conference on Human Factors in Computing Systems(CHI ’19). ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300445

Digital Library

[86]

Radu-Daniel Vatavu and Ovidiu-Ciprian Ungurean. 2022. Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor Impairments. In Proc. of the ACM Conference on Human Factors in Computing Systems(CHI ’22). ACM, New York, NY, USA, 16 pages. https://doi.org/10.1145/3491102.3501964

Digital Library

[87]

Daniel Vogel and Ravin Balakrishnan. 2004. Interactive Public Ambient Displays: Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology(UIST ’04). ACM, New York, NY, USA, 137–146. https://doi.org/10.1145/1029632.1029656

Digital Library

[88]

Ulrich von Zadow, Wolfgang Büschel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touch-Sensitive Display Walls. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces(ITS ’14). ACM, New York, NY, USA, 129–138. https://doi.org/10.1145/2669485.2669507

Digital Library

[89]

Kieran Watson, Robin Bretin, Mohamed Khamis, and Florian Mathis. 2022. The Feet in Human-Centred Security: Investigating Foot-Based User Authentication for Public Displays. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems(CHI EA ’22). ACM, New York, NY, USA, Article 441, 9 pages. https://doi.org/10.1145/3491101.3519838

Digital Library

[90]

Jacob O. Wobbrock, Krzysztof Z. Gajos, Shaun K. Kane, and Gregg C. Vanderheiden. 2018. Ability-Based Design. Commun. ACM 61, 6 (may 2018), 62–71. https://doi.org/10.1145/3148051

Digital Library

[91]

Jacob O. Wobbrock, Shaun K. Kane, Krzysztof Z. Gajos, Susumu Harada, and Jon Froehlich. 2011. Ability-Based Design: Concept, Principles and Examples. ACM Trans. Access. Comput. 3, 3, Article 9 (apr 2011), 27 pages. https://doi.org/10.1145/1952383.1952384

Digital Library

[92]

Jacob O. Wobbrock and Julie A. Kientz. 2016. Research Contributions in Human-Computer Interaction. Interactions 23, 3 (apr 2016), 38–44. https://doi.org/10.1145/2907069

Digital Library

[93]

Jacob O. Wobbrock, Brad A. Myers, Htet Htet Aung, and Edmund F. LoPresti. 2003. Text Entry from Power Wheelchairs: Edgewrite for Joysticks and Touchpads. In Proceedings of the 6th International ACM SIGACCESS Conference on Computers and Accessibility(ASSETS ’04). ACM, New York, NY, USA, 110–117. https://doi.org/10.1145/1028630.1028650

Digital Library

[94]

World Health Organization. 2010. Measuring Health and Disability Manual for WHO Disability Assessment Schedule WHODAS 2.0. https://www.who.int/publications/i/item/measuring-health-and-disability-manual-for-who-disability-assessment-schedule-(-whodas-2.0)

[95]

Yan Zhai, Guoying Zhao, Toni Alatalo, Janne Heikkilä, Timo Ojala, and Xinyuan Huang. 2013. Gesture Interaction for Wall-Sized Touchscreen Display. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication(UbiComp ’13 Adjunct). ACM, New York, NY, USA, 175–178. https://doi.org/10.1145/2494091.2494148

Digital Library

[96]

Yanxia Zhang, Jörg Müller, Ming Ki Chong, Andreas Bulling, and Hans Gellersen. 2014. GazeHorizon: Enabling Passers-by to Interact with Public Displays by Gaze. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing(UbiComp ’14). ACM, New York, NY, USA, 559–563. https://doi.org/10.1145/2632048.2636071

Digital Library

Cited By

Terenti MPamparău CVatavu R(2024)The user experience of distal arm-level vibrotactile feedback for interactions with virtual versus physical displaysVirtual Reality10.1007/s10055-024-00977-228:2Online publication date: 22-Mar-2024
https://dl.acm.org/doi/10.1007/s10055-024-00977-2
Keppel JStrauss MFaltaous SLiebers JHeger RGruenefeld USchneegass S(2023)Don't Forget to Disinfect: Understanding Technology-Supported Hand Disinfection StationsProceedings of the ACM on Human-Computer Interaction10.1145/36042517:MHCI(1-18)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604251
Bilius LUngurean OVatavu R(2023)An Expressivity-Complexity Tradeoff?: User-Defined Gestures from the Wheelchair Space are Mostly DeicticExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585695(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585695
Show More Cited By

Index Terms

Interactive Public Displays and Wheelchair Users: Between Direct, Personal and Indirect, Assisted Interaction
1. Human-centered computing

Recommendations

Understanding Wheelchair Users’ Preferences for On-Body, In-Air, and On-Wheelchair Gestures
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

We present empirical results from a gesture elicitation study conducted with eleven wheelchair users that proposed on-body, in-air, and on-wheelchair gestures to effect twenty-one referents representing common actions, types of digital content, and ...
Enhancing multi-touch table accessibility for wheelchair users
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility

Wheelchair users can find accessing digital content on large multi-touch tables particularly difficult and frustrating due to their limited reach. We present work in progress that is exploring the potential of enhancing touch table accessibility through ...
Cross-device interaction with large displays in public: insights from both users' and observers' perspectives
OzCHI '17: Proceedings of the 29th Australian Conference on Computer-Human Interaction

1Using a mixture of physical gestures and one's smartphone is a convenient way for people to engage and interact with large displays in public. Yet, one of the challenges of cross-device interactions is to design techniques that encourage participation. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology

October 2022

1363 pages

ISBN:9781450393201

DOI:10.1145/3526113

Editors:
Maneesh Agrawala
Stanford University, USA
,
Jacob O. Wobbrock
University of Washington, USA
,
Eytan Adar
University of Michigan, USA
,
Vidya Setlur
Tableau Research, USA

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 October 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Unitatea Executiva pentru Finantarea Invatamantului Superior, a Cercetarii, Dezvoltarii si Inovarii

Conference

UIST '22

Sponsor:

UIST '22: The 35th Annual ACM Symposium on User Interface Software and Technology

October 29 - November 2, 2022

OR, Bend, USA

Acceptance Rates

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
381
Total Downloads

Downloads (Last 12 months)144
Downloads (Last 6 weeks)8

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Terenti MPamparău CVatavu R(2024)The user experience of distal arm-level vibrotactile feedback for interactions with virtual versus physical displaysVirtual Reality10.1007/s10055-024-00977-228:2Online publication date: 22-Mar-2024
https://dl.acm.org/doi/10.1007/s10055-024-00977-2
Keppel JStrauss MFaltaous SLiebers JHeger RGruenefeld USchneegass S(2023)Don't Forget to Disinfect: Understanding Technology-Supported Hand Disinfection StationsProceedings of the ACM on Human-Computer Interaction10.1145/36042517:MHCI(1-18)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604251
Bilius LUngurean OVatavu R(2023)An Expressivity-Complexity Tradeoff?: User-Defined Gestures from the Wheelchair Space are Mostly DeicticExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585695(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585695
Bilius LUngurean OVatavu R(2023)Understanding Wheelchair Users’ Preferences for On-Body, In-Air, and On-Wheelchair GesturesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580929(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580929

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents