Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3379337.3415829acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

Capacitivo: Contact-Based Object Recognition on Interactive Fabrics using Capacitive Sensing

Published: 20 October 2020 Publication History

Abstract

We present Capacitivo, a contact-based object recognition technique developed for interactive fabrics, using capacitive sensing. Unlike prior work that has focused on metallic objects, our technique recognizes non-metallic objects such as food, different types of fruits, liquids, and other types of objects that are often found around a home or in a workplace. To demonstrate our technique, we created a prototype composed of a 12 x 12 grid of electrodes, made from conductive fabric attached to a textile substrate. We designed the size and separation between the electrodes to maximize the sensing area and sensitivity. We then used a 10-person study to evaluate the performance of our sensing technique using 20 different objects, which yielded a 94.5% accuracy rate. We conclude this work by presenting several different application scenarios to demonstrate unique interactions that are enabled by our technique on fabrics.

Supplementary Material

VTT File (3379337.3415829.vtt)
MP4 File (ufp2955pv.mp4)
Preview video
MP4 File (ufp2955vf.mp4)
Video figure
MP4 File (3379337.3415829.mp4)
Presentation Video

References

[1]
Roland Aigner, Andreas Pointner, Thomas Preindl, Patrick Parzer, and Michael Haller, 2020. Embroidered Resistive Pressure Sensors: A Novel Approach for Textile Interfaces. In Proceedings of the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'20), ACM, New York, NY, USA, 1--13.
[2]
Amazon.com. Heatnbond, HeatnBond UltraHold Iron-On Adhesive Value Pack, 17 Inches x 5 Yards. Retrieved March 13, 2020 from https://www.amazon.com/HeatnBond-UltraHold-Iron-Adhesive-Inches/dp/B000XAMYXI?th=1f
[3]
Ashutosh Dhekne, Mahanth Gowda, Yixuan Zhao, Haitham Hassanieh, and Romit Roy Choudhury, 2018. LiquID: A Wireless Liquid IDentifier. In Proceedings of the Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '18), ACM, New York, NY, USA, 442--454.
[4]
Claudius Dichtl, Pit Sippel, and Stephan Krohns, 2017. Dielectric Properties of 3D Printed Polylactic Acid. Advances in Materials Science and Engineering 2017, 1--10.
[5]
Paul Dietz and Darren Leigh, 2001. DiamondTouch: a multi-user touch technology. In Proceedings of the Proceedings of the 14th annual ACM symposium on User interface software and technology (UIST'01). ACM, New York, NY, USA. 219--226.
[6]
Oliver Glauser, Daniele Panozzo, Otmar Hilliges, and Olga Sorkine-Hornung, 2019. Deformation Capture via Soft and Stretchable Sensor Arrays. ACM Trans. Graph. 38, 2, Article 16.
[7]
Jun Gong, Yu Wu, Lei Yan, Teddy Seyed, and Xing-Dong Yang, 2019. Tessutivo: Contextual Interactions on Interactive Fabrics with Inductive Sensing. In Proceedings of the Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST'19). ACM, New York, NY, USA, 29--41.
[8]
Tobias Grosse-Puppendahl, Sebastian Beck, Daniel Wilbers, Steeven Zeiß, Julian Von Wilmsdorff, and Arjan Kuijper, 2014. In Distributed, Ambient, and Pervasive Interactions (DAPI 2014). Springer, Cham, 97--108.
[9]
Tobias Grosse-Puppendahl, Sebastian Herber, Raphael Wimmer, Frank Englert, Sebastian Beck, Julian Von Wilmsdorff, Reiner Wichert, and Arjan Kuijper, 2014. Capacitive near-field communication for ubiquitous interaction and perception. In Proceedings of the Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 231--242.
[10]
Tobias Grosse-Puppendahl, Christian Holz, Gabe Cohn, Raphael Wimmer, Oskar Bechtold, Steve Hodges, Matthew S. Reynolds, and Joshua R. Smith, 2017. Finding Common Ground: A Survey of Capacitive Sensing in Human-Computer Interaction. In Proceedings of the Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, New York, NY, USA. 3293--3315.
[11]
Chris Harrison, Munehiko Sato, and Ivan Poupyrev, 2012. Capacitive fingerprinting: exploring user differentiation by sensing electrical properties of the human body. In Proceedings of the Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST'12). ACM, New York, NY, USA, 537--544. DOI= http://dx.doi.org/10.1145/2380116.2380183.
[12]
Ken Hinckley, Jeff Pierce, Eric Horvitz, and Mike Sinclair, 2005. Foreground and background interaction with sensor-enhanced mobile devices. ACM Trans. Comput.-Hum. Interact. 12, 1, 31--52. DOI= http://dx.doi.org/10.1145/1057237.1057240.
[13]
Kristy Jost, Daniel Stenger, Carlos R. Perez, John K. Mcdonough, Keryn Lian, Yury Gogotsi, and Genevieve Dion, 2013. Knitted and screen printed carbon-fiber supercapacitors for applications in wearable electronics. Energy & Environmental Science 6, 9, 2698--2705.
[14]
Nathan Kirchner, Daniel Hordern, Dikai Liu, and Gamini Dissanayake, 2008. Capacitive sensor for object ranging and material type identification. Sensors and Actuators A: Physical 148, 1, 96--104.
[15]
Gierad Laput, Karan Ahuja, Mayank Goel, and Chris Harrison, 2018. Ubicoustics: Plug-and-Play Acoustic Activity Recognition. In Proceedings of the Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST'18). ACM, New York, NY, USA, 213--224.
[16]
Gierad Laput, Robert Xiao, and Chris Harrison, 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proceedings of the Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16). ACM, New York, NY, USA, 321--333.
[17]
Gierad Laput, Chouchang Yang, Robert Xiao, Alanson Sample, and Chris Harrison, 2015. EM-Sense: Touch Recognition of Uninstrumented, Electrical and Electromechanical Objects. In Proceedings of the Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST'15). ACM, New York, NY, USA, 157--166.
[18]
Sk Lee, William Buxton, and K. C. Smith, 1985. A multi-touch three dimensional touch-sensitive tablet. SIGCHI Bull. ACM, New York, NY, USA, 21--25.
[19]
Darren Leigh, Clifton Forlines, Ricardo Jota, Steven Sanders, and Daniel Wigdor, 2014. High rate, low-latency multi-touch sensing with simultaneous orthogonal multiplexing. In Proceedings of the Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST'14). ACM, New York, NY, USA, 355--364. DOI= http://dx.doi.org/10.1145/2642918.2647353.
[20]
Li Liu, Wanli Ouyang, Xiaogang Wang, Paul Fieguth, Jie Chen, Xinwang Liu, and Matti Pietikäinen, 2020. Deep Learning for Generic Object Detection: A Survey. International Journal of Computer Vision 128, 2, 261--318.
[21]
Microchip Technology, MTCH6303 Capacitive Touch Sensor. Retrieved May 5, 2020 from MTCH6303 Capacitive Touch Sensor
[22]
Adiyan Mujibiya and Jun Rekimoto, 2013. Mirage: exploring interaction modalities using off-body static electric field sensing. In Proceedings of the Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST'13). ACM, New York, NY, USA, 211--220.
[23]
Maggie Orth, J. R. Smith, E. R. Post, J. A. Strickon, and E. B. Cooper, 1998. Musical jacket. In Proceedings of the ACM SIGGRAPH 98 Electronic art and animation catalog. ACM, New York, NY, USA, 38.
[24]
Patrick Parzer, Florian Perteneder, Kathrin Probst, Christian Rendl, Joanne Leong, Sarah Schuetz, Anita Vogl, Reinhard Schwoediauer, Martin Kaltenbrunner, Siegfried Bauer, and Michael Haller, 2018. RESi: A Highly Flexible, Pressure-Sensitive, Imperceptible Textile Interface Based on Resistive Yarns. In Proceedings of the Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST'18). ACM, New York, NY, USA, 745--756.
[25]
Patrick Parzer, Adwait Sharma, Anita Vogl, Jürgen Steimle, Alex Olwal, and Michael Haller, 2017. SmartSleeve: Real-time Sensing of Surface and Deformation Gestures on Flexible, Interactive Textiles, using a Hybrid Gesture Detection Pipeline. In Proceedings of the Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17). ACM, New York, NY, USA, 565--577.
[26]
S. Pitou, F. Wu, A. Shafti, B. Michael, R. Stopforth, and M. Howard, 2018. Embroidered Electrodes for Control of Affordable Myoelectric Prostheses. In 2018 IEEE International Conference on Robotics and Automation (ICRA), 1812--1817.
[27]
T. Pola and J. Vanhala, 2007. Textile Electrodes in ECG Measurement. In 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information, 635--639.
[28]
M. Rofouei, W. Xu, and M. Sarrafzadeh, 2010. Computing with uncertainty in a smart textile surface for object recognition. In 2010 IEEE Conference on Multisensor Fusion and Integration, 174--179.
[29]
Sidharth Sahdev, Clifton Forlines, Ricardo Jota, Bruno De Araujo, Braon Moseley, Jonathan Deber, Steven Sanders, Darren Leigh, and Daniel Wigdor, 2017. GhostID: Enabling Non-Persistent User Differentiation in Frequency-Division Capacitive Multi-Touch Sensors. In Proceedings of the Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, New York, NY, USA, 15--27.
[30]
Stefan Schneegass and Alexandra Voit. 2016. GestureSleeve: using touch sensitive fabrics for gestural input on the forearm for controlling smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16). ACM, New York, NY, USA, 108--115.
[31]
Texas Instruments Incorporated. FDC1004: Basics of Capacitive Sensing and Applications. Retrieved May 5, 2020 from http://www.ti.com/product/FDC1004.
[32]
Texas Instruments Incorporated. Capacitive Proximity Sensing Using FDC2x1y. Retrieved May 5, 2020 from https://www.ti.com/lit/an/snoa940a/snoa940a.pdf
[33]
Texas Instruments Incorporated. Common Inductive and Capacitive Sensing Applications. Retrieved May 5, 2020 from https://www.ti.com/lit/an/slya048a/slya048a.pdf
[34]
Miika Valtonen, Lasse Kaila, Jaakko Mäentausta, and Jukka Vanhala, 2011. Unobtrusive human height and posture recognition with a capacitive sensor. Journal of Ambient Intelligence and Smart Environments 3, 4, 305--332.
[35]
Nicolas Villar, Haiyan Zhang, Daniel Cletheroe, Greg Saul, Christian Holz, Tim Regan, Oscar Salandin, Misha Sra, Hui-Shyong Yeo, and William Field, 2018. Project Zanzibar. In Proceedings of the Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Paper 515, 1--13.
[36]
Anita Vogl, Patrick Parzer, Teo Babic, Joanne Leong, Alex Olwal, and Michael Haller, 2017. StretchEBand: Enabling Fabric-based Interactions through Rapid Fabrication of Textile Stretch Sensors. In Proceedings of the Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, New York, NY, USA, 2617--2627.
[37]
Ju Wang, Jie Xiong, Xiaojiang Chen, Hongbo Jiang, Rajesh Krishna Balan, and Dingyi Fang, 2017. TagScan: Simultaneous Target Imaging and Material Identification with Commodity RFID Devices. In Proceedings of the Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking (MobiCom'17). ACM, New York, NY, USA, 288--300.
[38]
Yuntao Wang, Jianyu Zhou, Hanchuan Li, Tengxiang Zhang, Minxuan Gao, Zhuolin Cheng, Chun Yu, Shwetak Patel, and Yuanchun Shi, 2019. FlexTouch: Enabling Large-Scale Interaction Sensing Beyond Touchscreens Using Flexible and Conductive Materials. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 109.
[39]
Raphael Wimmer, 2011. Capacitive Sensors for Whole Body Interaction. In Whole Body Interaction, D. ENGLAND Ed. Springer London, London, 121--133.
[40]
Te-Yen Wu, Shutong Qi, Junchi Chen, Mujie Shang, Jun Gong, Teddy Seyed, and Xing-Dong Yang, 2020. Fabriccio: Touchless Gestural Input on Interactive Fabrics. In Proceedings of the Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI'20). ACM, New York, NY, USA, 1--14.
[41]
W. Xu, M. Huang, N. Amini, L. He, and M. Sarrafzadeh, 2013. eCushion: A Textile Pressure Sensor Array Design and Calibration for Sitting Posture Analysis. IEEE Sensors Journal 13, 10, 3926--3934.
[42]
W. Q. Yang and Lihui Peng, 2002. Image reconstruction algorithms for electrical capacitance tomography. Measurement Science and Technology 14, 1 (2002/12/11), R1-R13.
[43]
Z. Ye, R. Banasiak, and M. Soleimani, 2013. Planar array 3D electrical capacitance tomography. Insight - Non-Destructive Testing and Condition Monitoring 55, 12, 675--680.
[44]
Z. Ye, H. Y. Wei, and M. Soleimani, 2015. Resolution analysis using fully 3D electrical capacitive tomography. Measurement 61(2015/02/01/), 270--279.
[45]
Hui-Shyong Yeo, Gergely Flamich, Patrick Schrempf, David Harris-Birtill, and Aaron Quigley, 2016. RadarCat. In Proceedings of the Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 833--841.
[46]
Neng-Hao Yu, Li-Wei Chan, Seng Yong Lau, Sung-Sheng Tsai, I-Chun Hsiao, Dian-Je Tsai, Fang-I Hsiao, Lung-Pan Cheng, Mike Chen, Polly Huang ., and Et Al., 2011. TUIC: enabling tangible interaction on capacitive multi-touch displays. In Proceedings of the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). ACM, New York, NY, USA, 2995--3004.
[47]
Yang Zhang, Chouchang Yang, Scott E. Hudson, Chris Harrison, and Alanson Sample, 2018. Wall++. In Proceedings of the Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18).ACM, New York, NY, USA, 1--15.
[48]
Thomas G. Zimmerman, Joshua R. Smith, Joseph A. Paradiso, David Allport, and Neil Gershenfeld, 1995. Applying electric field sensing to human-computer interfaces. In Proceedings of the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'95), ACM Press/Addison-Wesley Publishing Co., 280--287.

Cited By

View all
  • (2024)Embrogami: Shape-Changing Textiles with Machine EmbroideryProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676431(1-15)Online publication date: 13-Oct-2024
  • (2024)SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose TrackingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676341(1-13)Online publication date: 13-Oct-2024
  • (2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
  • Show More Cited By

Index Terms

  1. Capacitivo: Contact-Based Object Recognition on Interactive Fabrics using Capacitive Sensing

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology
    October 2020
    1297 pages
    ISBN:9781450375146
    DOI:10.1145/3379337
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 October 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. capacitive sensing
    2. interactive fabrics
    3. object recognition

    Qualifiers

    • Research-article

    Funding Sources

    • NSF ABR Grant

    Conference

    UIST '20

    Acceptance Rates

    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)152
    • Downloads (Last 6 weeks)23
    Reflects downloads up to 13 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Embrogami: Shape-Changing Textiles with Machine EmbroideryProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676431(1-15)Online publication date: 13-Oct-2024
    • (2024)SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose TrackingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676341(1-13)Online publication date: 13-Oct-2024
    • (2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
    • (2024)CAvatarProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314247:4(1-24)Online publication date: 12-Jan-2024
    • (2024)TextureSightProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314137:4(1-27)Online publication date: 12-Jan-2024
    • (2024)Screenless Interactive Tabletop Gaming with Capacitive Surface SensingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642654(1-10)Online publication date: 11-May-2024
    • (2024)Tagnoo: Enabling Smart Room-Scale Environments with RFID-Augmented PlywoodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642356(1-18)Online publication date: 11-May-2024
    • (2024)LiquidListener: Supporting Ubiquitous Liquid Volume Sensing via Singing SoundsIEEE Access10.1109/ACCESS.2024.337539212(39833-39846)Online publication date: 2024
    • (2024)Clarifying and differentiating discoverabilityHuman–Computer Interaction10.1080/07370024.2024.2364606(1-26)Online publication date: 13-Jun-2024
    • (2023)FibeRobo: Fabricating 4D Fiber Interfaces by Continuous Drawing of Temperature Tunable Liquid Crystal ElastomersProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606732(1-17)Online publication date: 29-Oct-2023
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media