research-article

Skinput: appropriating the body as an input surface

Authors:

Chris Harrison,

Dan MorrisAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 453 - 462

https://doi.org/10.1145/1753326.1753394

Published: 10 April 2010 Publication History

Abstract

We present Skinput, a technology that appropriates the human body for acoustic transmission, allowing the skin to be used as an input surface. In particular, we resolve the location of finger taps on the arm and hand by analyzing mechanical vibrations that propagate through the body. We collect these signals using a novel array of sensors worn as an armband. This approach provides an always available, naturally portable, and on-body finger input system. We assess the capabilities, accuracy and limitations of our technique through a two-part, twenty-participant user study. To further illustrate the utility of our approach, we conclude with several proof-of-concept applications we developed.

Supplementary Material

JPG File (1753394.jpg)

Download
12.90 KB

JPG File (p453.jpg)

Download
9.90 KB

index.html (index.html)

Slides from the presentation

Download
.93 KB

MOV File (p453.mov)

Supplemental video file for "Skinput: appropriating the body as an input surface"

Download
27.90 MB

Audio only (1753394.mp3)

Download
14.32 MB

Video (1753394.mp4)

Download
198.21 MB

References

[1]

Ahmad, F., and Musilek, P. A Keystroke and Pointer Control Input Interface for Wearable Computers. In Proc. IEEE PERCOM '06, 2--11.

Digital Library

[2]

Amento, B., Hill, W., and Terveen, L. The Sound of One Hand: A Wrist-mounted Bio--acoustic Fingertip Gesture Interface. In CHI '02 Ext. Abstracts, 724--725.

Digital Library

[3]

Argyros, A.A., and Lourakis, M.I.A. Vision-based Interpretation of Hand Gestures for Remote Control of a Computer Mouse. In Proc. ECCV 2006 Workshop on Computer Vision in HCI, LNCS 3979, 40--51.

Digital Library

[4]

Burges, C.J. A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 2.2, June 1998, 121--167.

Digital Library

[5]

Clinical Guidelines on the Identification, Evaluation, and Treatment of Overweight and Obesity in Adults. National Heart, Lung and Blood Institute. Jun. 17, 1998.

[6]

Deyle, T., Palinko, S., Poole, E.S., and Starner, T. Hambone: A Bio-Acoustic Gesture Interface. In Proc. ISWC '07. 1--8.

Digital Library

[7]

Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., and Twombly, X. Vision-based hand pose estimation: A review. Computer Vision and Image Understanding. 108, Oct., 2007.

Digital Library

[8]

Fabiani, G.E. McFarland, D.J. Wolpaw, J.R. and Pfurtscheller, G. Conversion of EEG activity into cursor movement by a brain-computer interface (BCI). IEEE Trans. on Neural Systems and Rehabilitation Engineering, 12.3, 331--8. Sept. 2004.

[9]

Grimes, D., Tan, D., Hudson, S.E., Shenoy, P., and Rao, R. Feasibility and pragmatics of classifying working memory load with an electroencephalograph. Proc. CHI '08, 835--844.

Digital Library

[10]

Harrison, C., and Hudson, S.E. Scratch Input: Creating Large, Inexpensive, Unpowered and Mobile finger Input Surfaces. In Proc. UIST '08, 205--208.

Digital Library

[11]

Hirshfield, L.M., Solovey, E.T., Girouard, A., Kebinger, J., Jacob, R.J., Sassaroli, A., and Fantini, S. Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy. In Proc. CHI '09, 2185--2194.

Digital Library

[12]

Ishii, H., Wisneski, C., Orbanes, J., and Chun, B., Paradiso, J. PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play. Proc. CHI '99, 394--401.

Digital Library

[13]

Lakshmipathy, V., Schmandt, C., and Marmasse, N. TalkBack: a conversational answering machine. In Proc. UIST '03, 41--50.

Digital Library

[14]

Lee, J.C., and Tan, D.S. Using a low-cost electroencephalograph for task classification in HCI research. In Proc. CHI '06, 81--90.

Digital Library

[15]

Lyons, K., Skeels, C., Starner, T., Snoeck, C.M., Wong, B.A., and Ashbrook, D. Augmenting conversations using dual-purpose speech. In Proc. UIST '04. 237--246.

Digital Library

[16]

Mandryk, R.L., and Atkins, M.S. A Fuzzy Physiological Approach for Continuously Modeling Emotion During Interaction with Play Environments. Intl Journal of Human-Computer Studies, 6(4), 329--347, 2007.

Digital Library

[17]

Mandryk, R.L., Inkpen, K.M., and Calvert, T.W. Using Psychophysiological Techniques to Measure User Experience with Entertainment Technologies. Behaviour and Information Technology, 25(2), 141--58, March 2006.

[18]

McFarland, D.J., Sarnacki, W.A., and Wolpaw, J.R. Brain-computer interface (BCI) operation: optimizing information transfer rates. Biological Psychology, 63(3), 237--51. Jul 2003.

[19]

Mistry, P., Maes, P., and Chang, L. WUW -- wear Ur world: a wearable gestural interface. In CHI '09 Ext. Abst., 4111--4116.

Digital Library

[20]

Moore, M., and Dua, U. A galvanic skin response interface for people with severe motor disabilities. In Proc. ACM SIGACCESS Accessibility and Comp. '04, 48--54.

Digital Library

[21]

Paradiso, J.A., Leo, C.K., Checka, N., and Hsiao, K. Passive acoustic knock tracking for interactive windows. In CHI '02 Extended Abstracts, 732--733.

Digital Library

[22]

Post, E.R. and Orth, M. Smart Fabric, or "Wearable Clothing." In Proc. ISWC '97, 167.

Digital Library

[23]

Rosenberg, R. The biofeedback Pointer: EMG Control of a Two Dimensional Pointer. In Proc. ISWC '98, 4--7.

Digital Library

[24]

Saponas, T.S., Tan, D.S., Morris, D., and Balakrishnan, R. Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces. In Proc. CHI '09, 515--24.

Digital Library

[25]

Sturman, D.J. and Zeltzer, D. A Survey of Glove-based Input. IEEE Comp Graph and Appl, 14.1, Jan 1994.

Digital Library

[26]

Wilson, A. PlayAnywhere: a compact interactive tabletop projection-vision system. In Proc. UIST '05, 83--92.

Digital Library

[27]

Wilson, A.D. Robust computer vision-based detection of pinching for one and two-handed gesture input. In Proc. UIST '06, 255--258.

Digital Library

[28]

Witten, I.H. and Frank, E. Data Mining: Practical machine learning tools and techniques, 2nd Edition, Morgan Kaufmann, San Francisco, 2005.

Digital Library

Cited By

Kunieda NManabe H(2024)OSIRITap: Whole-Body Interface that Recognizes Tap Input Using Only an HMD and Wrist-Mounted IMUsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3688871(1-2)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3688871
Darbar RHu XYan XWei YLiang HXu WSarcar S(2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682084
Lambert VGoguey AMalacria SNigay L(2024)Studying the Simultaneous Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36765238:MHCI(1-34)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676523
Show More Cited By

Index Terms

Skinput: appropriating the body as an input surface
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Buses and high-speed links
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Belly gestures: body centric gestures on the abdomen
NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

Recent HCI research has shown that the body offers an interactive surface particularly suitable to eyes-free interaction. While researchers have mainly focused on the arms and the hands, we argue that the surface of the belly is especially appropriate. ...
ThumbSlide: An Interaction Technique for Smartwatches using a Thumb Slide Movement
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

We present ThumbSlide, which is an interaction technique for a smartwatch that prevents occlusion caused by the user's finger; the technique realizes continuous manipulation by estimating the moving amount of the thumb. Combining with any determining ...
Bitey: an exploration of tooth click gestures for hands-free user interface control
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services

We present Bitey, a subtle, wearable device for enabling input via tooth clicks. Based on a bone-conduction microphone worn just above the ears, Bitey recognizes the click sounds from up to five different pairs of teeth, allowing fully hands-free ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

484
Total Citations
View Citations
7,700
Total Downloads

Downloads (Last 12 months)378
Downloads (Last 6 weeks)57

Reflects downloads up to 19 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kunieda NManabe H(2024)OSIRITap: Whole-Body Interface that Recognizes Tap Input Using Only an HMD and Wrist-Mounted IMUsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3688871(1-2)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3688871
Darbar RHu XYan XWei YLiang HXu WSarcar S(2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682084
Lambert VGoguey AMalacria SNigay L(2024)Studying the Simultaneous Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36765238:MHCI(1-34)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676523
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Chen WLin SPeng ZParizi FHeo SPatel SMatusik WZhao WStankovic J(2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643547
Cheng WChan L(2024)BodyTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314267:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631426
Hajika RGunasekaran THaigh CPai YHayashi ELien JLottridge DBillinghurst M(2024)RadarHand: A Wrist-Worn Radar for On-Skin Touch-Based Proprioceptive GesturesACM Transactions on Computer-Human Interaction10.1145/361736531:2(1-36)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3617365
Lee CZhang RAgarwal DYu TGunda VLopez OKim JYin SDong BLi KSakashita MGuimbretiere FZhang C(2024)EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a WristbandProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642910(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642910
Zhu FSousa MSidenmark LGrossman T(2024)PhoneInVR: An Evaluation of Spatial Anchoring and Interaction Techniques for Smartphone Usage in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642582(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642582
Yang YChen THuang YGuo XShangguan L(2024)MAF: Exploring Mobile Acoustic Field for Hand-to-Face Gesture InteractionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642437(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642437
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents