Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3332165.3347897acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article
Public Access

Tessutivo: Contextual Interactions on Interactive Fabrics with Inductive Sensing

Published: 17 October 2019 Publication History

Abstract

We present Tessutivo, a contact-based inductive sensing technique for contextual interactions on interactive fabrics. Our technique recognizes conductive objects (mainly metallic) that are commonly found in households and workplaces, such as keys, coins, and electronic devices. We built a prototype containing six by six spiral-shaped coils made of conductive thread, sewn onto a four-layer fabric structure. We carefully designed the coil shape parameters to maximize the sensitivity based on a new inductance approximation formula. Through a ten-participant study, we evaluated the performance of our proposed sensing technique across 27 common objects. We yielded 93.9% real-time accuracy for object recognition. We conclude by presenting several applications to demonstrate the unique interactions enabled by our technique.

Supplementary Material

MP4 File (ufp4055pv.mp4)
Preview video
MP4 File (ufp4055vf.mp4)
Supplemental video
MP4 File (p29-gong.mp4)

References

[1]
TI LDC Sensor Design Application Report SNOA930. 2015. Retrieved March 15, 2019 from http://www.ti.com/lit/an/snoa930a/snoa930a.pdf
[2]
Eugen Berlin, Jun Liu, Kristof van Laerhoven and Bernt Schiele. 2010. Coming to grips with the objects we grasp: detecting interactions with efficient wrist-worn sensors. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction (TEI'10), 57--64. DOI=http://dx.doi.org/10.1145/1709886.1709898
[3]
Michael Boyle and Saul Greenberg. 2005. The language of privacy: Learning from video media space analysis and design. ACM Trans. Comput.-Hum. Interact., 12 (2). 328--370. DOI= http://dx.doi.org /10.1145/1067860.1067868
[4]
Leah Buechley and Michael Eisenberg. 2009. Fabric PCBs, electronic sequins, and socket buttons: techniques for e-textile craft. Personal Ubiquitous Comput., 13 (2). 133--150. DOI=https://doi.org/10.1007/s00779-007-0181-0
[5]
Michael Buettner, Richa Prasad, Matthai Philipose and David Wetherall. 2009. Recognizing daily activities with RFID-based sensors. In Proceedings of the 11th international conference on Ubiquitous computing (UbiComp'09), 51--60. DOI=http://doi.acm.org/10.1145/1620545.1620553
[6]
Perumal Varun Chadalavada, Goutham Palaniappan, Vimal Kumar Chandran, Khai Truong and Daniel Wigdor. 2018. ID'em: Inductive Sensing for Embedding and Extracting Information in Robust Materials. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2 (3). 1--28. DOI=https://doi.org/10.1145/3264907
[7]
Liwei Chan, Yi-Ling Chen, Chi-Hao Hsieh, Rong-Hao Liang and Bing-Yu Chen. 2015. CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology, 549--556. DOI=https://doi.org/10.1145/2807442.2807450
[8]
Kai-Yin Cheng, Rong-Hao Liang, Bing-Yu Chen, Rung-Huei Laing and Sy-Yen Kuo. 2010. iCon: utilizing everyday objects as additional, auxiliary and instant tabletop controllers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'10), 1155--1164. DOI=https://doi.org/10.1145/1753326.1753499
[9]
Kunigunde Cherenack, Christoph Zysset, Thomas Kinkeldei, Niko Münzenrieder and Gerhard Tröster. 2010. Woven Electronic Fibers with Sensing and Display Functions for Smart Textiles. Advanced Materials, 22 (45). 5178--5182. DOI=https://doi.org/10.1002/adma.201002159
[10]
Lucy E. Dunne, Kaila Bibeau, Lucie Mulligan, Ashton Frith and Cory Simon. 2012. Multi-layer e-textile circuits. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), 649--650. DOI=http://dx.doi.org/10.1145/2370216.2370348
[11]
Jun Gong, Xin Yang, Teddy Seyed, Josh Urban Davis and Xing-Dong Yang. 2018. Indutivo: Contact-Based, Object-Driven Interactions with Inductive Sensing. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST'18), 321--333. DOI=https://doi.org/10.1145/3242587.3242662
[12]
Tobias Grosse-Puppendahl, Sebastian Herber, Raphael Wimmer, Frank Englert, Sebastian Beck, Julian von Wilmsdorff, Reiner Wichert and Arjan Kuijper. 2014. Capacitive near-field communication for ubiquitous interaction and perception. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp'14), 231--242. DOI=https://doi.org/10.1145/2632048.2632053
[13]
Sunao Hashimoto, Ryohei Suzuki, Youichi Kamiyama, Masahiko Inami and Takeo Igarashi. 2013. LightCloth: senseable illuminating optical fiber cloth for creating interactive surfaces. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA'13), 2809--2810. DOI=https://doi.org/10.1145/2468356.2479523
[14]
Gerard J. Hayes, Ying Liu, Jan Genzer, Gianluca Lazzi and Michael D. Dickey. 2014. Self-Folding Origami Microstrip Antennas. IEEE Transactions on Antennas and Propagation, 62 (10). 5416--5419. DOI=https://doi.org/10.1109/TAP.2014.2346188
[15]
Steve Hodges, Alan Thorne, Hugo Mallinson and Christian Floerkemeier. 2007. Assessing and optimizing the range of UHF RFID to enable real-world pervasive computing applications. In International Conference on Pervasive Computing, 280--297. DOI=https://doi.org/10.1007/978--3--540--72037--9_17
[16]
David I Lehn, Craig W Neely, Kevin Schoonover, Thomas L Martin and Mark Jones. 2004. e-TAGs: e-textile attached gadgets. In Proceedings of the Communication Networks and Distributed Systems Modeling and Simulation Conference.
[17]
Hiren Galiyawala Kinjal H. Pandya. 2014. A Survey on QR Codes : in context of Research and Application. International Journal of Emerging Technology and Advanced Engineering. 4 (3). 258--262.
[18]
Gierad Laput, Robert Xiao and Chris Harrison. 2016. Viband: High-fidelity bio-acoustic sensing using commodity smartwatch accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), 321--333. DOI=https://doi.org/10.1145/2984511.2984582
[19]
Gierad Laput, Chouchang Yang, Robert Xiao, Alanson Sample and Chris Harrison. 2015. Em-sense: Touch recognition of uninstrumented, electrical and electromechanical objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST'15), 157--166. DOI=https://doi.org/10.1145/2807442.2807481
[20]
Joanne Leong, Patrick Parzer, Florian Perteneder, Teo Babic, Christian Rendl, Anita Vogl, Hubert Egger, Alex Olwal and Michael Haller. 2016. proCover: Sensory Augmentation of Prosthetic Limbs Using Smart Textile Covers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), 335--346. DOI=https://doi.org/10.1145/2984511.2984572
[21]
Hanchuan Li, Eric Brockmeyer, Elizabeth J. Carter, Josh Fromm, Scott E. Hudson, Shwetak N. Patel and Alanson Sample. 2016. PaperID: A Technique for Drawing Functional Battery-Free Wireless Interfaces on Paper. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 5885--5896. DOI=https://doi.org/10.1145/2858036.2858249
[22]
Hanchuan Li, Can Ye and Alanson P. Sample. 2015. IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI'15), 2555--2564. DOI=https://doi.org/10.1145/2702123.2702178
[23]
Jaime Lien, Nicholas Gillian, M. Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja and Ivan Poupyrev. 2016. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar. In ACM Transactions on Graphics (SIGGRAPH'16). DOI=https://doi.org/10.1145/2897824.2925953
[24]
David G. Lowe. 1999. Object recognition from local scale-invariant features. In Proceedings of the Seventh IEEE International Conference on Computer Vision (ICCV'99), 1150--1157. DOI=https://doi.org/10.1109/ICCV.1999.790410
[25]
Takuya Maekawa, Yasue Kishino, Yutaka Yanagisawa and Yasushi Sakurai. 2012. Recognizing handheld electrical device usage with hand-worn coil of wire. In International Conference on Pervasive Computing (Pervasive'12), 234--252. DOI=https://doi.org/10.1007/978--3--642--31205--2_15
[26]
Jan Meyer, Bert Arnrich, Johannes Schumm and Gerhard Troster. 2010. Design and Modeling of a Textile Pressure Sensor for Sitting Posture Classification. IEEE Sensors Journal, 10 (8). 1391--1398. DOI=https://doi.org/10.1109/JSEN.2009.2037330
[27]
Norhisam Misron, Loo Qian Ying, Raja Nor Firdaus, Norrimah Abdullah, Nashiren Farzilah Mailah and Hiroyuki Wakiwaka. 2011. Effect of inductive coil shape on sensing performance of linear displacement sensor using thin inductive coil and pattern guide. Sensors, 11 (11). 10522--10533. DOI=https://doi.org/10.3390/s111110522
[28]
Sunderarajan S Mohan, Maria del Mar Hershenson, Stephen P Boyd and Thomas H Lee. 1999. Simple accurate expressions for planar spiral inductances. IEEE Journal of solid-state circuits, 34 (10). 1419--1424. DOI=https://doi.org/10.1109/4.792620
[29]
David S. Nyce. Inductive Sensing. In Linear Position Sensors. 78--93. DOI=https://doi.org/10.1002/0471474282
[30]
Patrick Parzer, Florian Perteneder, Kathrin Probst, Christian Rendl, Joanne Leong, Sarah Schuetz, Anita Vogl, Reinhard Schwoediauer, Martin Kaltenbrunner, Siegfried Bauer and Michael Haller. 2018. RESi: A Highly Flexible, Pressure-Sensitive, Imperceptible Textile Interface Based on Resistive Yarns. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST'18), 745--756. DOI=https://doi.org/10.1145/3242587.3242664
[31]
Patrick Parzer, Kathrin Probst, Teo Babic, Christian Rendl, Anita Vogl, Alex Olwal and Michael Haller. 2016. FlexTiles: A Flexible, Stretchable, Formable, Pressure-Sensitive, Tactile Input Sensor. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA'16), 3754--3757. DOI=https://doi.org/10.1145/2851581.2890253
[32]
Patrick Parzer, Adwait Sharma, Anita Vogl, Jurgen Steimle, Alex Olwal and Michael Haller. 2017. SmartSleeve: Real-time Sensing of Surface and Deformation Gestures on Flexible, Interactive Textiles, using a Hybrid Gesture Detection Pipeline. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17), 565--577. DOI=https://doi.org/10.1145/3126594.3126652
[33]
Vesa Peltonen, Juha Tuomi, Anssi Klapuri, Jyri Huopaniemi and Timo Sorsa. 2002. Computational auditory scene recognition. In IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'02), II-1941-II-1944. DOI=https://doi.org/10.1109/ICASSP.2002.5745009
[34]
Alex "Sandy" Pentland. 1998. Wearable Intelligence. Scientific American, 90--95.
[35]
Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig and Karen E. Robinson. 2016. Project Jacquard: Interactive Digital Textiles at Scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 4216--4227. DOI=https://doi.org/10.1145/2858036.2858176
[36]
Juhi Ranjan, Yu Yao, Erin Griffiths and Kamin Whitehouse. 2012. Using mid-range RFID for location based activity recognition. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), 647--648. DOI=http://dx.doi.org/10.1145/2370216.2370347
[37]
Mahsan Rofouei, Wenyao Xu and Majid Sarrafzadeh. 2010. Computing with uncertainty in a smart textile surface for object recognition. In 2010 IEEE Conference on Multisensor Fusion and Integration, 174--179. DOI=http://dx.doi.org/10.1109/MFI.2010.5604473
[38]
Edward B. Rosa. 1906. Calculation of the self-inductances of single-layer coils. Bull. Bureau Standards, 2 (2). 161--187.
[39]
Edward Bennett Rosa. 1908. The self and mutual inductances of linear conductors.
[40]
Stefan Schneegass and Alexandra Voit. 2016. GestureSleeve: using touch sensitive fabrics for gestural input on the forearm for controlling smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16), 108--115. DOI=https://doi.org/10.1145/2971763.2971797
[41]
Jamie Shotton, Andrew Fitzgibbon, Mat Cook, Toby Sharp, Mark Finocchio, Richard Moore, Alex Kipman and Andrew Blake. 2011. Real-time human pose recognition in parts from single depth images. In Conference on Computer Vision and Pattern Recognition (CVPR'11), 1297--1304. DOI=https://doi.org/10.1109/CVPR.2011.5995316
[42]
Joshua R Smith, Kenneth P Fishkin, Bing Jiang, Alexander Mamishev, Matthai Philipose, Adam D Rea, Sumit Roy and Kishore Sundara-Rajan. 2005. RFID-based techniques for human-activity detection. Communications of the ACM, 48 (9). 39--44. DOI=http://dx.doi.org/10.1145/1081992.1082018
[43]
Jie Song, Gábor Sörös, Fabrizio Pece, Sean Ryan Fanello, Shahram Izadi, Cem Keskin, and Otmar Hilliges. 2014. In-air gestures around unmodified mobile devices. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14), 319--329. DOI=https://doi.org/10.1145/2642918.2647373
[44]
Michael E. Van Steenberg, Andrew Washabaugh, and Neil Goldfme. 2001. Inductive and capacitive sensor arrays for in situ composition sensors. In Proceedings of 2001 IEEE Aerospace Conference. DOI=https://doi.org/10.1109/AERO.2001.931721
[45]
Yuta Sugiura, Gota Kakehi, Anusha Withana, Calista Lee, Daisuke Sakamoto, Maki Sugimoto, Masahiko Inami and Takeo Igarashi. 2011. Detecting shape deformation of soft objects using directional photoreflectivity measurement. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST'11), 509--516. DOI=https://doi.org/10.1145/2047196.2047263
[46]
Nalika Ulapane, Linh Nguyen, Jaime Valls Miro, Alen Alempijevic and Gamini Dissanayake. 2017. Designing a pulsed eddy current sensing set-up for cast iron thickness assessment. In 12th IEEE Conference on Industrial Electronics and Applications (ICIEA'17), 901--906. DOI=https://doi.org/10.1109/ICIEA.2017.8282967
[47]
Nicolas Villar, Daniel Cletheroe, Greg Saul, Christian Holz, Tim Regan, Oscar Salandin, Misha Sra, Hui- Shyong Yeo, William Field and Haiyan Zhang. 2018. Project Zanzibar: A Portable and Flexible Tangible Interaction Platform. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. DOI=https://doi.org/10.1145/3173574.3174089
[48]
Anita Vogl, Patrick Parzer, Teo Babic, Joanne Leong, Alex Olwal and Michael Haller. 2017. StretchEBand: Enabling Fabric-based Interactions through Rapid Fabrication of Textile Stretch Sensors. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 2617--2627. DOI=https://doi.org/10.1145/3025453.3025938
[49]
Edward J Wang, Tien-Jui Lee, Alex Mariakakis, Mayank Goel, Sidhant Gupta and Shwetak N Patel. 2015. Magnifisense: Inferring device interaction using wrist-worn passive magneto-inductive sensors. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp'15), 15--26. DOI=https://doi.org/10.1145/2750858.2804271
[50]
Jamie A Ward, Paul Lukowicz, Gerhard Troster and Thad E Starner. 2006. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE transactions on pattern analysis and machine intelligence, 28 (10). 1553--1567. DOI=https://doi.org/10.1109/TPAMI.2006.197
[51]
Robert Xiao, Gierad Laput, Yang Zhang and Chris Harrison. 2017. Deus EM Machina: on-touch contextual functionality for smart IoT appliances. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 4000--4008. DOI=https://doi.org/10.1145/3025453.3025828
[52]
Wenyao Xu, Ming-Chun Huang, Navid Amini, Lei He and Majid Sarrafzadeh. 2013. eCushion: A Textile Pressure Sensor Array Design and Calibration for Sitting Posture Analysis. IEEE Sensors Journal, 13 (10), 3926--3934. DOI=https://doi.org/10.1109/JSEN.2013.2259589
[53]
Hui-Shyong Yeo, Gergely Flamich, Patrick Schrempf, David Harris-Birtill and Aaron Quigley. 2016. Radarcat: Radar categorization for input and interaction. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), 833--841. DOI=https://doi.org/10.1145/2984511.2984515
[54]
Jonsenser Zhao. 2010. A new calculation for designing multilayer planar spiral inductors. EDN (Electrical Design News), 55 (14), 37.

Cited By

View all
  • (2024)Elbow Gesture Recognition with an Array of Inductive Sensors and Machine LearningSensors10.3390/s2413420224:13(4202)Online publication date: 28-Jun-2024
  • (2024)Rhapso: Automatically Embedding Fiber Materials into 3D Prints for Enhanced InteractivityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676468(1-20)Online publication date: 13-Oct-2024
  • (2024)Embrogami: Shape-Changing Textiles with Machine EmbroideryProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676431(1-15)Online publication date: 13-Oct-2024
  • Show More Cited By

Index Terms

  1. Tessutivo: Contextual Interactions on Interactive Fabrics with Inductive Sensing

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology
    October 2019
    1229 pages
    ISBN:9781450368162
    DOI:10.1145/3332165
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 October 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. inductive sensing
    2. interactive fabrics
    3. object recognition

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    UIST '19

    Acceptance Rates

    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)357
    • Downloads (Last 6 weeks)33
    Reflects downloads up to 17 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Elbow Gesture Recognition with an Array of Inductive Sensors and Machine LearningSensors10.3390/s2413420224:13(4202)Online publication date: 28-Jun-2024
    • (2024)Rhapso: Automatically Embedding Fiber Materials into 3D Prints for Enhanced InteractivityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676468(1-20)Online publication date: 13-Oct-2024
    • (2024)Embrogami: Shape-Changing Textiles with Machine EmbroideryProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676431(1-15)Online publication date: 13-Oct-2024
    • (2024)SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose TrackingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676341(1-13)Online publication date: 13-Oct-2024
    • (2024)SeamSleeve: Robust Arm Movement Sensing through Powered StitchingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660726(1134-1147)Online publication date: 1-Jul-2024
    • (2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
    • (2024)Shaping lace: Machine embroidered metamaterialsProceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3639473.3665792(1-12)Online publication date: 7-Jul-2024
    • (2024)TextureSightProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314137:4(1-27)Online publication date: 12-Jan-2024
    • (2024)Tagnoo: Enabling Smart Room-Scale Environments with RFID-Augmented PlywoodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642356(1-18)Online publication date: 11-May-2024
    • (2024)WooDowel: Electrode Isolation for Electromagnetic Shielding in Triboelectric Plywood SensorsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642304(1-17)Online publication date: 11-May-2024
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media