research-article

PocketTouch: through-fabric capacitive touch input

Authors:

T. Scott Saponas,

Chris Harrison,

Hrvoje BenkoAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

Pages 303 - 308

https://doi.org/10.1145/2047196.2047235

Published: 16 October 2011 Publication History

Abstract

PocketTouch is a capacitive sensing prototype that enables eyes-free multitouch input on a handheld device without having to remove the device from the pocket of one's pants, shirt, bag, or purse. PocketTouch enables a rich set of gesture interactions, ranging from simple touch strokes to full alphanumeric text entry. Our prototype device consists of a custom multitouch capacitive sensor mounted on the back of a smartphone. Similar capabilities could be enabled on most existing capacitive touchscreens through low-level access to the capacitive sensor. We demonstrate how touch strokes can be used to initialize the device for interaction and how strokes can be processed to enable text recognition of characters written over the same physical area. We also contribute a comparative study that empirically measures how different fabrics attenuate touch inputs, providing insight for future investigations. Our results suggest that PocketTouch will work reliably with a wide variety of fabrics used in today's garments, and is a viable input method for quick eyes-free operation of devices in pockets.

Supplementary Material

JPG File (fp310.jpg)

Download
10.58 KB

WMV File (fp310.wmv)

Download
43.79 MB

References

[1]

Anthony, L. & Wobbrock, J.O. 2010. A lightweight multistroke recognizer for user interface prototypes. In Proc. Graphics Interface 2010 (GI '10). 245--252.

Digital Library

[2]

Ashbrook, D.L., Clawson, J.R., Lyons, K., Starner, T.E., & Patel, N. 2008. Quickdraw: the impact of mobility and on-body placement on device access time. In Proc. CHI '08. 219--222.

Digital Library

[3]

Blattner, M., Sumikawa, D. & Greenberg, R. 1989. Earcons and icons: Their structure and common design principles. Human Comp. Interaction 4, 1 (1989), 11--44.

Digital Library

[4]

Brewster, S. & Brown, L.M. 2004. Tactons: structured tactile messages for non-visual information display. In Proc. AUIC '04. 15--23.

Digital Library

[5]

Grossman, T., Hinckley, K., Baudisch, P., Agrawala, M., Balakrishnan, R. 2006. Hover widgets: using the tracking state to extend the capabilities of pen-operated devices. In Proc. CHI '06. 861--870.

Digital Library

[6]

Harrison, C. & Hudson, S.E. 2008. Lightweight Material Detection for Placement-Aware Mobile Computing. In Proc. UIST '08. 279--282.

Digital Library

[7]

Hudson, S.E., Harrison, C., Harrison, B.L., & LaMarca, A. 2010. Whack gestures: inexact and inattentive interaction with mobile devices. In Proc. TEI '10. 109--112.

Digital Library

[8]

Karrer, T., Wittenhagen, M., Lichtschlag, L., Heller, F., & Borchers, J. 2011. Pinstripe: eyes-free continuous input on interactive clothing. In Proc. CHI '11. 1313--1322.

Digital Library

[9]

Orth, M., Post, R., & Cooper, E. 1998. Fabric computing interfaces. In Proc. CHI '98. 331--332.

Digital Library

[10]

Rekimoto, J. 2002. SmartSkin: An Infrastructure for Free-hand Manipulation on Interactive Surfaces. In Proc. CHI '02. 113--120.

Digital Library

[11]

1Ronkainen, S., Häkkilä, J., Kaleva, S., Colley, A., and Linjama, J. Tap input as an embedded interaction method for mobile devices. In Proc. TEI '07. 263--270.

Digital Library

[12]

Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., and Landay, J. A. Enabling always-available input with muscle-computer interfaces. In Proc. UIST '09. 167--176.

Digital Library

[13]

Song, H., Benko, H., Guimbretiere, F., Izadi, S., Cao, X., and Hinckley, K. Grips and Gestures on a Multi-Touch Pen. In Proc. CHI '11. 1323--1332.

Digital Library

[14]

Villar, N., Izadi, S., Rosenfeld, D., Benko, H., Helmes, J., Westhues, J., Hodges, S., Butler, A., Ofek, E., Cao, X., and Chen, B. 2009. "Mouse 2.0: Multi-touch Meets the Mouse". In Proc. UIST '09. 33--42.

Digital Library

[15]

Wobbrock, J.O., Myers, B.A. and Kembel, J.A. 2003. EdgeWrite: A stylus-based text entry method designed for high accuracy and stability of motion. In Proc. UIST '03. 61--70.

Digital Library

Cited By

Li YZhou YShen CStewart RCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)E-textile Sleeve with Graphene Strain Sensors for Arm Gesture Classification of Mid-Air InteractionsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633374(1-10)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633374
Ehtesham-Ul-Haque MBillah S(2023)Abacus GesturesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108987:3(1-30)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610898
Vatavu R(2023)iFAD Gestures: Understanding Users’ Gesture Input Performance with Index-Finger Augmentation DevicesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580928(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580928
Show More Cited By

Index Terms

PocketTouch: through-fabric capacitive touch input
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

We describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Sensor synaesthesia: touch in motion, and motion in touch
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We explore techniques for hand-held devices that leverage the multimodal combination of touch and motion. Hybrid touch + motion gestures exhibit interaction properties that combine the strengths of multi-touch with those of motion-sensing. This affords ...
EarPut: augmenting behind-the-ear devices for ear-based interaction
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

In this work-in-progress paper, we make a case for leveraging the unique affordances of the human ear for eyes-free, mobile interaction. We present EarPut, a novel interface concept, which instruments the ear as an interactive surface for touch-based ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

78
Total Citations
View Citations
1,387
Total Downloads

Downloads (Last 12 months)34
Downloads (Last 6 weeks)4

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li YZhou YShen CStewart RCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)E-textile Sleeve with Graphene Strain Sensors for Arm Gesture Classification of Mid-Air InteractionsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633374(1-10)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633374
Ehtesham-Ul-Haque MBillah S(2023)Abacus GesturesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108987:3(1-30)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610898
Vatavu R(2023)iFAD Gestures: Understanding Users’ Gesture Input Performance with Index-Finger Augmentation DevicesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580928(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580928
Vatavu R(2023)Gesture-Based InteractionHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_20-1(1-47)Online publication date: 9-Feb-2023
https://doi.org/10.1007/978-3-319-27648-9_20-1
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Sathya ALi JRahman TGao GPeng H(2022)CalicoProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503236:3(1-32)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550323
Genç ÇPuro EHäkkilä J(2022)DecoLeaves: Exploring NFC technology for Energy Harvesting and Concealed Input on Interactive Fashion with Dynamic GraphicsProceedings of the 2022 ACM International Symposium on Wearable Computers10.1145/3544794.3560295(120-122)Online publication date: 11-Sep-2022
https://dl.acm.org/doi/10.1145/3544794.3560295
Rekik YLank EGuettaf AGrisoni L(2021)Multi-channel Tactile Feedback Based on User Finger SpeedProceedings of the ACM on Human-Computer Interaction10.1145/34885495:ISS(1-17)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488549
Irudayaraj AAgarwal RJoshi NGupta AAbari OVogel D(2021)PocketView: Through-Fabric Information DisplaysThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474766(511-523)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474766
Zhao HRöddiger TBeigl M(2021)AirCase: Earable Charging Case with Air Quality Monitoring and Soundscape SonificationAdjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460418.3479329(180-184)Online publication date: 21-Sep-2021
https://dl.acm.org/doi/10.1145/3460418.3479329
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents