Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3447526.3472037acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article

ARO: Exploring the Design of Smart-Ring Interactions for Encumbered Hands

Published: 27 September 2021 Publication History

Abstract

Fingertip computing has seen increased interest through miniaturized smart-rings for augmenting digital peripherals. One key advantages of such always-available input devices is the non-necessity to hold a device for interaction, as it remains affixed to a finger for access when needed. Such a wearable device makes it possible to interaction with content even when the hand is encumbered, by grasping or holding objects. Our investigation aims at understanding the properties of this fundamental smart-ring advantage. We designed a smart-ring prototype, ARO (in-Air, on-Ring, on-Object interaction), which facilitates input while grasping objects. To better identify interaction possibilities, we present the results of an elicitation study through which we grouped various forms of micro-gestures possible with ARO while holding objects under different grasp requirements. We then explored the ability for users to perform different navigation tasks (i.e. zooming and panning) using the smart-ring with encumbered hands. In our studies, users were most efficient when using either In-air or On-ring interactions, in comparisons to gestures detected On-object. Furthermore, In-air was the most preferred by our participants. Based on our findings, we conclude with recommendations for the design of future smart-rings and fingertip devices at large, to allow efficient interaction while hands are encumbered.

References

[1]
Daniel Ashbrook, Patrick Baudisch, and Sean White. 2011. Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2043–2046.
[2]
American Psychological Association (Ed.). 2009. Publication Manual of the American Psychological Association (6 ed.). American Psychological Association.
[3]
Monya Baker. 2016. Statisticians issue warning over misuse of P values. Nature News 531, 7593 (2016), 151.
[4]
Joanna Bergstrom-Lehtovirta and Antti Oulasvirta. 2014. Modeling the functional area of the thumb on mobile touchscreen surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1991–2000.
[5]
Lonni Besançon. 2017. An interaction Continuum for 3D Dataset Visualization. Theses. Université Paris-Saclay. https://tel.archives-ouvertes.fr/tel-01684210
[6]
Roger Boldu, Alexandru Dancu, Denys JC Matthies, Pablo Gallego Cascón, Shanaka Ransir, and Suranga Nanayakkara. 2018. Thumb-In-Motion: Evaluating Thumb-to-Ring Microgestures for Athletic Activity. In Proceedings of the Symposium on Spatial User Interaction. 150–157.
[7]
Edwin Chan, Teddy Seyed, Wolfgang Stuerzlinger, Xing-Dong Yang, and Frank Maurer. 2016. User elicitation on single-hand microgestures. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3403–3414.
[8]
Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: private and subtle interaction using fingertips. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 255–260.
[9]
Ke-Yu Chen, Kent Lyons, Sean White, and Shwetak Patel. 2013. uTrack: 3D input using two magnetic sensors. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 237–244.
[10]
Francesco Chinello, Monica Malvezzi, Claudio Pacchierotti, and Domenico Prattichizzo. 2012. A three DoFs wearable tactile display for exploration and manipulation of virtual objects. In 2012 IEEE Haptics Symposium (HAPTICS). IEEE, 71–76.
[11]
Pierre Dragicevic. 2016. Fair statistical communication in HCI. In Modern statistical methods for HCI. Springer, 291–330.
[12]
Pierre Dragicevic, Fanny Chevalier, and Stephane Huot. 2014. Running an HCI experiment in multiple parallel universes. In CHI’14 Extended Abstracts on Human Factors in Computing Systems. 607–618.
[13]
Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J Thompson. 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 4680–4691.
[14]
Barrett Ens, Ahmad Byagowi, Teng Han, Juan David Hincapié-Ramos, and Pourang Irani. 2016. Combining ring input with hand tracking for precise, natural interaction with spatial analytic interfaces. In Proceedings of the 2016 Symposium on Spatial User Interaction. 99–102.
[15]
Masaaki Fukumoto and Yasuhito Suenaga. 1994. “FingeRing” a full-time wearable interface. In Conference companion on Human factors in computing systems. 81–82.
[16]
Masaaki Fukumoto and Yoshinobu Tonomura. 1997. “Body coupled FingerRing” wireless wearable keyboard. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems. 147–154.
[17]
Pablo Gallego Cascón, Denys JC Matthies, Sachith Muthukumarana, and Suranga Nanayakkara. 2019. ChewIt. An Intraoral Interface for Discreet Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.
[18]
Bogdan-Florin Gheran, Jean Vanderdonckt, and Radu-Daniel Vatavu. 2018. Gestures for smart rings: Empirical results, insights, and design implications. In Proceedings of the 2018 Designing Interactive Systems Conference. 623–635.
[19]
Bogdan-Florin Gheran and Radu-Daniel Vatavu. 2020. From controls on the steering wheel to controls on the finger: using smart rings for in-vehicle interactions. In Companion Publication of the 2020 ACM Designing Interactive Systems Conference. 299–304.
[20]
Aakar Gupta, Cheng Ji, Hui-Shyong Yeo, Aaron Quigley, and Daniel Vogel. 2019. RotoSwype: Word-Gesture Typing Using a Ring. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.
[21]
Chris Harrison and Scott E Hudson. 2009. Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices. In Proceedings of the 22nd annual ACM symposium on User interface software and technology. 121–124.
[22]
Guido Heumer, Heni Ben Amor, and Bernhard Jung. 2008. Grasp recognition for uncalibrated data gloves: A machine learning approach. Presence: Teleoperators and Virtual Environments 17, 2(2008), 121–142.
[23]
Lei Jing, Zixue Cheng, Yinghui Zhou, Junbo Wang, and Tongjun Huang. 2013. Magic ring: A self-contained gesture input device on finger. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia. 1–4.
[24]
Jingun Jung, Sangyoon Lee, Jiwoo Hong, Eunhye Youn, and Geehyuk Lee. 2020. Voice+ Tactile: Augmenting In-vehicle Voice User Interface with Tactile Touchpad Interaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.
[25]
Hsin-Liu Kao, Artem Dementyev, Joseph A Paradiso, and Chris Schmandt. 2015. NailO: fingernails as an input surface. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 3015–3018.
[26]
Wolf Kienzle and Ken Hinckley. 2014. LightRing: always-available 2D input on any surface. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 157–160.
[27]
Junhyeok Kim, William Delamare, and Pourang Irani. 2018. ThumbText: text entry for wearable devices using a miniature ring. In Proceedings of Graphics Interface. 18–25.
[28]
Yoon Sang Kim, Byung Seok Soh, and Sang-Goog Lee. 2005. A new wearable input device: SCURRY. IEEE Transactions on Industrial Electronics 52, 6 (2005), 1490–1499.
[29]
Ig Mo Koo, Kwangmok Jung, Ja Choon Koo, Jae-Do Nam, Young Kwan Lee, and Hyouk Ryeol Choi. 2008. Development of soft-actuator-based wearable tactile display. IEEE Transactions on Robotics 24, 3 (2008), 549–558.
[30]
DoYoung Lee, SooHwan Lee, and Ian Oakley. 2020. Nailz: Sensing Hand Input with Touch Sensitive Nails. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[31]
Jupyung Lee, Seung-Ho Lim, Jong-Woon Yoo, Ki-Woong Park, Hyun-Jin Choi, and Kyu Ho Park. 2007. A ubiquitous fashionable computer with an i-Throw device on a location-based service environment. In 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW’07), Vol. 2. IEEE, 59–65.
[32]
Seongil Lee and Sang Hyuk Hong. 2004. Design of an integrated wearable multimedia interface for in-vehicle telematics. In Pacific-Rim Conference on Multimedia. Springer, 113–120.
[33]
Hyunchul Lim, Jungmin Chung, Changhoon Oh, SoHyun Park, and Bongwon Suh. 2016. OctaRing: examining pressure-sensitive multi-touch input on a finger ring device. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 223–224.
[34]
Sylvain Malacria, Eric Lecolinet, and Yves Guiard. 2010. Clutch-free panning and integrated pan-zoom control on touch-sensitive surfaces: the cyclostar approach. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2615–2624.
[35]
Meredith Ringel Morris, Andreea Danielescu, Steven Drucker, Danyel Fisher, Bongshin Lee, and Jacob O Wobbrock. 2014. Reducing Legacy Bias in Gesture Elicitation Studies. interactions 21, 3: 40–45. Google Scholar Google Scholar Digital Library Digital Library (2014).
[36]
Matei Negulescu, Jaime Ruiz, Yang Li, and Edward Lank. 2012. Tap, swipe, or move: attentional demands for distracted smartphone input. In Proceedings of the International Working Conference on Advanced Visual Interfaces. 173–180.
[37]
Alexander Ng, John Williamson, and Stephen Brewster. 2015. The effects of encumbrance and mobility on touch-based gesture interactions for mobile phones. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. 536–546.
[38]
Shahriar Nirjon, Jeremy Gummeson, Dan Gelb, and Kyu-Han Kim. 2015. Typingring: A wearable ring platform for text input. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. 227–239.
[39]
Masa Ogata, Yuta Sugiura, Hirotaka Osawa, and Michita Imai. 2012. iRing: intelligent ring using infrared reflection. In Proceedings of the 25th annual ACM symposium on User interface software and technology. 131–136.
[40]
Anala Pandit, Dhairya Dand, Sisil Mehta, Shashank Sabesan, and Ankit Daftery. 2009. A simple wearable hand gesture recognition device using iMEMS. In 2009 International Conference of Soft Computing and Pattern Recognition. IEEE, 592–597.
[41]
Jose L Pons, E Rocon, Ramón Ceres, Dominiek Reynaerts, B Saro, S Levin, and W Van Moorleghem. 2004. The MANUS-HAND dextrous robotics upper limb prosthesis: mechanical and manipulation aspects. Autonomous Robots 16, 2 (2004), 143–163.
[42]
Mehran Roshandel, Aarti Munjal, Peyman Moghadam, Shahin Tajik, and Hamed Ketabdar. 2014. Multi-sensor based gestures recognition with a smart finger ring. In International Conference on Human-Computer Interaction. Springer, 316–324.
[43]
Georg Schlesinger. 1919. Der mechanische aufbau der künstlichen glieder. In Ersatzglieder und Arbeitshilfen. Springer, 321–661.
[44]
Robert J Schwarz and CL Taylor. 1955. The anatomy and mechanics of the human hand. Artificial limbs 2, 2 (1955), 22–35.
[45]
Marcos Serrano, Barrett M Ens, and Pourang P Irani. 2014. Exploring the use of hand-to-face input for interacting with head-worn displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3181–3190.
[46]
Adwait Sharma, Joan Sol Roo, and Jürgen Steimle. 2019. Grasping Microgestures: Eliciting Single-hand Microgestures for Handheld Objects. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.
[47]
Roy Shilkrot, Jochen Huber, Jürgen Steimle, Suranga Nanayakkara, and Pattie Maes. 2015. Digital digits: A comprehensive survey of finger augmentation devices. ACM Computing Surveys (CSUR) 48, 2 (2015), 1–29.
[48]
Gaganpreet Singh, William Delamare, and Pourang Irani. 2018. D-SWIME: A Design Space for Smartwatch Interaction Techniques Supporting Mobility and Encumbrance. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.
[49]
Yanke Tan, Sang Ho Yoon, and Karthik Ramani. 2017. BikeGesture: user elicitation and performance of micro hand gesture as input for cycling. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2147–2154.
[50]
Koji Tsukada and Michiaki Yasumura. 2004. Ubi-finger: A simple gesture input device for mobile and ubiquitous environment. Journal of Asian Information, Science and Life (AISL) 2, 2(2004), 111–120.
[51]
Radu-Daniel Vatavu and Jacob O Wobbrock. 2015. Formalizing agreement analysis for elicitation studies: new measures, significance test, and toolkit. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 1325–1334.
[52]
Frederic Vernier and Laurence Nigay. 2000. A framework for the combination and characterization of output modalities. In International Workshop on Design, Specification, and Verification of Interactive Systems. Springer, 35–50.
[53]
Santiago Villarreal-Narvaez, Jean Vanderdonckt, Radu-Daniel Vatavu, and Jacob A Wobbrock. 2020. A Systematic Review of Gesture Elicitation Studies: What Can We Learn from 216 Studies. In Proceedings of ACM Int. Conf. on Designing Interactive Systems (DIS’20).
[54]
Martin Weigel and Jürgen Steimle. 2017. Deformwear: Deformation input on tiny wearable devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (2017), 1–23.
[55]
Greg Welch, Gary Bishop, 1995. An introduction to the Kalman filter. (1995).
[56]
Mathias Wilhelm, Daniel Krakowczyk, Frank Trollmann, and Sahin Albayrak. 2015. eRing: multiple finger gesture recognition with one ring using an electric field. In Proceedings of the 2nd international Workshop on Sensor-based Activity Recognition and Interaction. 1–6.
[57]
Jacob O Wobbrock, Meredith Ringel Morris, and Andrew D Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI conference on human factors in computing systems. 1083–1092.
[58]
Katrin Wolf, Anja Naumann, Michael Rohs, and Jörg Müller. 2011. A taxonomy of microinteractions: Defining microgestures based on ergonomic and scenario-Dependent requirements. In IFIP conference on human-computer interaction. Springer, 559–575.
[59]
Zheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo, Te-Yen Wu, Jun Gong, Sicheng Yin, Jialun Zhai, and Xing-Dong Yang. 2020. BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[60]
Xing-Dong Yang, Tovi Grossman, Daniel Wigdor, and George Fitzmaurice. 2012. Magic finger: always-available input through finger instrumentation. In Proceedings of the 25th annual ACM symposium on User interface software and technology. 147–156.
[61]
Yui-Pan Yau, Lik Hang Lee, Zheng Li, Tristan Braud, Yi-Hsuan Ho, and Pan Hui. 2020. How subtle can it get? a trimodal study of ring-sized interfaces for one-handed drone control. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 2 (2020), 1–29.
[62]
Hui-Shyong Yeo, Juyoung Lee, Hyung-il Kim, Aakar Gupta, Andrea Bianchi, Daniel Vogel, Hideki Koike, Woontack Woo, and Aaron Quigley. 2019. WRIST: Watch-Ring Interaction and Sensing Technique for Wrist Gestures and Macro-Micro Pointing. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–15.
[63]
Sang Ho Yoon, Ke Huo, Vinh P Nguyen, and Karthik Ramani. 2015. TIMMi: Finger-worn textile input device with multimodal sensing in mobile interaction. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. 269–272.
[64]
Sang Ho Yoon, Ke Huo, and Karthik Ramani. 2014. Plex: finger-worn textile sensor for mobile interaction during activities. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication. 191–194.
[65]
Sang Ho Yoon, Ke Huo, and Karthik Ramani. 2016. Wearable textile input device with multimodal sensing for eyes-free mobile interaction during daily activities. Pervasive and Mobile Computing 33 (2016), 17–31.
[66]
Boning Zhang, Yiqiang Chen, Yueliang Qian, and Xiangdong Wang. 2011. A ring-shaped interactive device for large remote display and mobile device control. In Proceedings of the 13th international conference on Ubiquitous computing. 473–474.
[67]
Cheng Zhang, Anandghan Waghmare, Pranav Kundra, Yiming Pu, Scott Gilliland, Thomas Ploetz, Thad E Starner, Omer T Inan, and Gregory D Abowd. 2017. Fingersound: Recognizing unistroke thumb gestures using a ring. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–19.
[68]
Tengxiang Zhang, Xin Zeng, Yinshuai Zhang, Ke Sun, Yuntao Wang, and Yiqiang Chen. 2020. ThermalRing: Gesture and Tag Inputs Enabled by a Thermal Imaging Smart Ring. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.

Cited By

View all
  • (2024)GraspUI: Seamlessly Integrating Object-Centric Gestures within the Seven Phases of GraspingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661551(1275-1289)Online publication date: 1-Jul-2024
  • (2023)SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-grained Finger MicrogesturesACM Transactions on Computer-Human Interaction10.1145/356989430:3(1-40)Online publication date: 10-Jun-2023
  • (2023)EFRingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694786:4(1-31)Online publication date: 11-Jan-2023
  • Show More Cited By
  1. ARO: Exploring the Design of Smart-Ring Interactions for Encumbered Hands

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MobileHCI '21: Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction
    September 2021
    637 pages
    ISBN:9781450383288
    DOI:10.1145/3447526
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 September 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. mid-air gestures
    2. smart-ring
    3. touch interaction
    4. wearable computing

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    MobileHCI '21
    Sponsor:
    MobileHCI '21: 23rd International Conference on Mobile Human-Computer Interaction
    September 27 - October 1, 2021
    Toulouse & Virtual, France

    Acceptance Rates

    Overall Acceptance Rate 202 of 906 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)146
    • Downloads (Last 6 weeks)15
    Reflects downloads up to 27 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)GraspUI: Seamlessly Integrating Object-Centric Gestures within the Seven Phases of GraspingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661551(1275-1289)Online publication date: 1-Jul-2024
    • (2023)SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-grained Finger MicrogesturesACM Transactions on Computer-Human Interaction10.1145/356989430:3(1-40)Online publication date: 10-Jun-2023
    • (2023)EFRingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694786:4(1-31)Online publication date: 11-Jan-2023
    • (2023)New Insights into User-Defined Smart Ring Gestures with Implications for Gesture Elicitation StudiesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585590(1-8)Online publication date: 19-Apr-2023
    • (2023)Gesture-Based InteractionHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_20-1(1-47)Online publication date: 9-Feb-2023
    • (2022)One Ring to Rule Them AllProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503156:3(1-20)Online publication date: 7-Sep-2022
    • (2022)Expanding Touch Interaction Capabilities for Smart-rings: An Exploration of Continual Slide and Microroll GesturesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519714(1-7)Online publication date: 27-Apr-2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media