research-article

WristFlex: low-power gesture input with wrist-worn pressure sensors

Authors:

Artem Dementyev,

Joseph A. ParadisoAuthors Info & Claims

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

Pages 161 - 166

https://doi.org/10.1145/2642918.2647396

Published: 05 October 2014 Publication History

Abstract

In this paper we present WristFlex, an always-available on-body gestural interface. Using an array of force sensitive resistors (FSRs) worn around the wrist, the interface can distinguish subtle finger pinch gestures with high accuracy (>80 %) and speed. The system is trained to classify gestures from subtle tendon movements on the wrist. We demonstrate that WristFlex is a complete system that works wirelessly in real-time. The system is simple and light-weight in terms of power consumption and computational overhead. WristFlex's sensor power consumption is 60.7 uW, allowing the prototype to potentially last more then a week on a small lithium polymer battery. Also, WristFlex is small and non-obtrusive, and can be integrated into a wristwatch or a bracelet. We perform user studies to evaluate the accuracy, speed, and repeatability. We demonstrate that the number of gestures can be extended with orientation data from an accelerometer. We conclude by showing example applications.

Supplementary Material

suppl.mov (uistf3455-file3.mp4)

Supplemental video

Download
19.13 MB

References

[1]

Amento, B., Hill, W., and Terveen, L. The sound of one hand: a wrist-mounted bio-acoustic fingertip gesture interface. In Proc. CHI '02, 724--725.

Digital Library

[2]

Amft, O., Junker, H., Lukowicz, P., Troster, G., and Schuster, C. Sensing muscle activities with body-worn sensors. In BSN '06, 4--pp.

Digital Library

[3]

Bainbridge, R., and Paradiso, J. A. Wireless hand gesture capture through wearable passive tag sensing. In BSN '11, 200--204.

Digital Library

[4]

Deyle, T., Palinko, S., Poole, E. S., and Starner, T. Hambone: A bio-acoustic gesture interface. In ISWC '07, 3--10.

Digital Library

[5]

Fukui, R., Watanabe, M., Gyota, T., Shimosaka, M., and Sato, T. Hand shape classification with a wrist contour sensor: development of a prototype device. In Proc. Ubicomp '11, 311--314.

Digital Library

[6]

Grau, A. M., Hendee, C., Rizzo, J.-R., and Perlin, K. Mechanical force redistribution: enabling seamless, large-format, high-accuracy surface interaction. In CHI '14, 4137--4146.

Digital Library

[7]

Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. H. The weka data mining software: an update. ACM SIGKDD Explorations Newsletter 11, 1 (2009), 10--18.

Digital Library

[8]

Harrison, C., Tan, D., and Morris, D. Skinput: appropriating the body as an input surface. In Proc. CHI '10, ACM (2010), 453--462.

Digital Library

[9]

Kawahara, Y., Hodges, S., Cook, B. S., Zhang, C., and Abowd, G. D. Instant inkjet circuits: lab-based inkjet printing to support rapid prototyping of ubicomp devices. In Proc. Ubicomp '13, 363--372.

Digital Library

[10]

Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., and Olivier, P. Digits: freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proc. UIST '12, 167--176.

Digital Library

[11]

Nuwer, R. Armband adds a twitch to gesture control. New Scientist 217, 2906 (2013), 21.

[12]

Perng, J. K., Pister, K. S., fisher, B., and Hollar, S. Acceleration sensing glove. In ISWC '09, 178--178.

Digital Library

[13]

Rekimoto, J. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In ISWC '01, 21--27.

Digital Library

[14]

Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., and Landay, J. A. Enabling always-available input with muscle-computer interfaces. In Proc. UIST '09, 167--176.

Digital Library

[15]

Schlomer, T., Poppinga, B., Henze, N., and Boll, S. Gesture recognition with a wii controller. In Proc. TEI '08, 11--14.

Digital Library

[16]

Way, D., and Paradiso, J. A usability user study concerning free-hand microgesture and wrist-worn sensors. In Proc. BSN '14,

Digital Library

Cited By

Takahashi RWhitmire EBoldu RNg SKienzle WBenko H(2024)picoRing: battery-free rings for subtle thumb-to-index inputProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676365(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676365
Jyothish KMishra S(2024)A Survey on Robotic Prosthetics: Neuroprosthetics, Soft Actuators, and Control StrategiesACM Computing Surveys10.1145/364835556:8(1-44)Online publication date: 10-Apr-2024
https://dl.acm.org/doi/10.1145/3648355
Hajika RGunasekaran THaigh CPai YHayashi ELien JLottridge DBillinghurst M(2024)RadarHand: A Wrist-Worn Radar for On-Skin Touch-Based Proprioceptive GesturesACM Transactions on Computer-Human Interaction10.1145/361736531:2(1-36)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3617365
Show More Cited By

Index Terms

WristFlex: low-power gesture input with wrist-worn pressure sensors
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools
      1. User interface management systems

Recommendations

BackHand: Sensing Hand Gestures via Back of the Hand
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

In this paper, we explore using the back of hands for sensing hand gestures, which interferes less than glove-based approaches and provides better recognition than sensing at wrists and forearms. Our prototype, BackHand, uses an array of strain gauge ...
Evaluating the placement of arm-worn devices for recognizing variations of dynamic hand gestures

Dynamic hand gestures have become increasingly popular as touch-free input modality for interactive systems. There exists a variety of arm-worn devices for the recognition of hand gestures, which differ not only in their capabilities, but also in their ...
Comparing the Placement of Two Arm-Worn Devices for Recognizing Dynamic Hand Gestures
MoMM '16: Proceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media

Dynamic hand gestures have become increasingly popular as an input modality for interactive systems. There exists a variety of arm-worn devices for the recognition of hand gestures, which differ not only in their capabilities, but also in the arm ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

October 2014

722 pages

ISBN:9781450330695

DOI:10.1145/2642918

General Chair:
Hrvoje Benko
Microsoft Research, USA
,
Program Chairs:
Mira Dontcheva
Adobe, USA
,
Daniel Wigdor
University of Toronto, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

UIST '14

Sponsor:

UIST '14: The 27th Annual ACM Symposium on User Interface Software and Technology

October 5 - 8, 2014

Hawaii, Honolulu, USA

Acceptance Rates

UIST '14 Paper Acceptance Rate 74 of 333 submissions, 22%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

192
Total Citations
View Citations
2,372
Total Downloads

Downloads (Last 12 months)134
Downloads (Last 6 weeks)9

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Takahashi RWhitmire EBoldu RNg SKienzle WBenko H(2024)picoRing: battery-free rings for subtle thumb-to-index inputProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676365(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676365
Jyothish KMishra S(2024)A Survey on Robotic Prosthetics: Neuroprosthetics, Soft Actuators, and Control StrategiesACM Computing Surveys10.1145/364835556:8(1-44)Online publication date: 10-Apr-2024
https://dl.acm.org/doi/10.1145/3648355
Hajika RGunasekaran THaigh CPai YHayashi ELien JLottridge DBillinghurst M(2024)RadarHand: A Wrist-Worn Radar for On-Skin Touch-Based Proprioceptive GesturesACM Transactions on Computer-Human Interaction10.1145/361736531:2(1-36)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3617365
Lee CZhang RAgarwal DYu TGunda VLopez OKim JYin SDong BLi KSakashita MGuimbretiere FZhang C(2024)EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a WristbandProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642910(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642910
Kin KWan CKoh KMarin ACamgöz NZhang YCai YKovalev FBen-Zacharia MHoople SNunes-Ueno MSanchez-Rodriguez MBhargava AWang RSauser EMa S(2024)STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR InputProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642702(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642702
Chibizov PPetrov MKapravchuk VMazeina VBriko A(2024)Multi-channel Control System Using Force Myography2024 IEEE Ural-Siberian Conference on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT)10.1109/USBEREIT61901.2024.10584009(130-134)Online publication date: 13-May-2024
https://doi.org/10.1109/USBEREIT61901.2024.10584009
Xiao ZDu ZYan ZHuang TXu DHuang QHan B(2024)Channel Selection for Gesture Recognition Using Force Myography: A Universal Model for Gesture Measurement PointsIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2024.340394132(2016-2026)Online publication date: 2024
https://doi.org/10.1109/TNSRE.2024.3403941
Lou ZMin XLi GAvery JStewart R(2024)Advancing Sensing Resolution of Impedance Hand Gesture Recognition DevicesIEEE Journal of Biomedical and Health Informatics10.1109/JBHI.2024.341761628:10(5855-5864)Online publication date: Oct-2024
https://doi.org/10.1109/JBHI.2024.3417616
Ju LJia HShi YDing XFeng YZhang W(2024)Continuously Estimate and Control Prosthetic Grip Force by an Optical Waveguide Sensor2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10610613(5317-5322)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10610613
Kang YCheong J(2023)Smart Wrist Band Considering Wrist Skin Curvature Variation for Real-Time Hand Gesture RecognitionJournal of Korea Robotics Society10.7746/jkros.2023.18.1.01818:1(18-28)Online publication date: 1-Mar-2023
https://doi.org/10.7746/jkros.2023.18.1.018
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents