Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Knitted Sensors: Designs and Novel Approaches for Real-Time, Real-World Sensing

Published: 18 December 2020 Publication History

Editorial Notes

The authors have requested minor, non-substantive changes to the VoR and, in accordance with ACM policies, a Corrected VoR was published on February 10, 2021. For reference purposes the VoR may still be accessed via the Supplemental Material section on this page.

Abstract

Recent work has shown the feasibility of producing knitted capacitive touch sensors through digital fabrication with little human intervention in the textile production process. Such sensors can be designed and manufactured at scale and require only two connection points, regardless of the touch sensor form factor and size of the fabric, opening many possibilities for new designs and applications in textile sensors. To bring this technology closer to real-world use, we go beyond previous work on coarse touch discrimination to enable fine, accurate touch localization on a knitted sensor, using a recognition model able to capture the temporal behavior of the sensor. Moreover, signal acquisition and processing are performed in real-time, using swept frequency Bode analysis to quantify distortion from induced capacitance. After training our network model, we conducted a study with new users, and achieved a subject-independent accuracy of 66% in identifying the touch location on the 36-button sensor, while chance accuracy is approximately 3%. Additionally, we conducted a study demonstrating the viability of taking this solution closer to real-world scenarios by testing the sensor's resistance to potential deformation from everyday conditions. We also introduce several other knitted designs and related application prototypes to explore potential uses of the technology.

Supplementary Material

3432201-vor (3432201-vor.pdf)
Version of Record for "Knitted Sensors: Designs and Novel Approaches for Real-Time, Real-World Sensing" by McDonald et al., Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 4, Issue 4 (IMWUT 4:4).

References

[1]
[n.d.]. SHIMA SEIKI USA [Online]. https://shimaseikiusa.com/
[2]
Talha Agcayazi, Michael McKnight, Hannah Kausche, Tushar Ghosh, and Alper Bozkurt. 2016. A finger touch force detection method for textile based capacitive tactile sensor arrays. In 2016 IEEE SENSORS. 1--3. https://doi.org/10.1109/ICSENS.2016.7808528
[3]
Richard Vallett, Denisa Qori McDonald, Genevieve Dion, Youngmoo Kim, and Ali Shokoufandeh. 2020. Toward Accurate Sensing with Knitted Fabric: Applications and Technical Considerations. Proceedings of the ACM on Human-Computer Interaction, 4, EICS (2020).
[4]
H. W. Bode. 1940. Relations between attenuation and phase in feedback amplifier design. The Bell System Technical Journal 19, 3 (July 1940), 421--454. https://doi.org/10.1002/j.1538-7305.1940.tb00839.x
[5]
Amy Chen. 2020. The Design and Creation of Tactile Knitted E-textiles for Interactive Applications. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction. 905--909.
[6]
Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv.1406.1078 (2014).
[7]
D. De Rossi, F. Carpi, F. Lorussi, A. Mazzoldi, E. P. Scilingo, and A. Tognetti. 2002. Electroactive fabrics for distributed, conformable and interactive systems. In SENSORS, 2002 IEEE, Vol. 2.1608-1613. https://doi.org/10.1109/ICSENS.2002.1037364
[8]
Laura Devendorf, Joanne Lo, Noura Howell, Jung Lin Lee, Nan-Wei Gong, M Emre Karagozler, Shiho Fukuhara, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai. 2016. " I don't Want to Wear a Screen" Probing Perceptions of and Possibilities for Dynamic Displays on Clothing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 6028--6039.
[9]
Rachel Freire, Cedric Honnet, and Paul Strohmeier. 2017. Second Skin: An Exploration of eTextile Stretch Circuits on the Body. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction. 653--658.
[10]
Francine Gemperle, Chris Kasabach, John Stivoric, Malcolm Bauer, and Richard Martin. 1998. Design for wearability. In digest of papers. Second international symposium on wearable computers (cat. No. 98EX215). IEEE, 116--122.
[11]
Felix A Gers, Jürgen Schmidhuber, and Fred Cummins. 1999. Learning to forget: Continual prediction with LSTM. (1999).
[12]
Scott Gilliland, Nicholas Komor, Thad Starner, and Clint Zeagler. 2010. The Textile Interface Swatchbook: Creating graphical user interface-like widgets with conductive embroidery. In Proceedings of the 2010 International Symposium on Wearable Computers (ISWC '10'). 1--8. https://doi.org/10.1109/ISWC.2010.5665876
[13]
Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the thirteenth international conference on artificial intelligence and statistics. 249--256.
[14]
Nur Al-huda Hamdan, Jeffrey R. Blum, Florian Heller, Ravi Kanth Kosuru, and Jan Borchers. 2016. Grabbing at an Angle: Menu Selection for Fabric Interfaces. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16). ACM, New York, NY, USA, 1--7. https://doi.org/10.1145/2971763.2971786
[15]
Nur Al-huda Hamdan, Simon Voelker, and Jan Borchers. 2018. Sketch&Stitch: Interactive Embroidery for E-textiles. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 82, 13 pages. https://doi.org/10.1145/3173574.3173656
[16]
Yuji Hasegawa, M. Shikida, D. Ogura, and Kazuo Sato. 2007. Novel type of fabric tactile sensor made from artificial hollow fiber. In 2007 IEEE 20th International Conference on Micro Electro Mechanical Systems (MEMS). 603--606. https://doi.org/10.1109/MEMSYS.2007.4433079
[17]
Cedric Honnet, Hannah Perner-Wilson, Marc Teyssier, Bruno Fruchard, Jürgen Steimle, Ana C Baptista, and Paul Strohmeier. 2020. PolySense: Augmenting Textiles with Electrical Functionality using In-Situ Polymerization. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--13.
[18]
Dana Hughes, Halley Profita, and Nikolaus Correll. 2014. SwitchBack: An On-body RF-based Gesture Input Device. In Proceedings of the 2014 ACM International Symposium on Wearable Computers (ISWC '14). ACM, New York, NY, USA, 63--66. https://doi.org/10.1145/2634317.2634343
[19]
Dana Hughes, Halley Profita, Sarah Radzihovsky, and Nikolaus Correll. 2017. Intelligent RF-Based Gesture Input Devices Implemented Using e-Textiles. (2017). https://doi.org/10.3390/s17020219
[20]
Masayuki Inaba, Yukiko Hoshino, K. Nagasaka, T. Ninomiya, Satoshi Kagami, and H. Inoue. 1996. A full-body tactile sensor suit using electrically conductive fabric and strings. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96, Vol. 2. 450--457. https://doi.org/10.1109/IROS.1996.570816
[21]
Jarden Applied Materials 2014. RESISTAT®TYPE F901, MERGE D044. Jarden Applied Materials. http://www.resistat.com/pdf/f901d044color.pdf
[22]
Thorsten Karrer, Moritz Wittenhagen, Leonhard Lichtschlag, Florian Heller, and Jan Borchers. 2011. Pinstripe: eyes-free continuous input on interactive clothing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1313--1322.
[23]
Keil. [n.d.]. ARM CMSIS-DSP. https://arm-software.github.io/CMSIS_5/DSP/html/modules.html.
[24]
Simon Ozbek, Md Tahmidul Islam Molla, Crystal Compton, and Brad Holschuh. 2018. Novel manufacturing of advanced smart garments: knitting with spatially-varying, multi-material monofilament. In Proceedings of the 2018 ACM International Symposium on Wearable Computers. 120--127.
[25]
Patrick Parzer, Florian Perteneder, Kathrin Probst, Christian Rendl, Joanne Leong, Sarah Schuetz, Anita Vogl, Reinhard Schwoediauer, Martin Kaltenbrunner, Siegfried Bauer, and Michael Haller. 2018. RESi: A Highly Flexible, Pressure-Sensitive, Imperceptible Textile Interface Based on Resistive Yarns. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA, 745--756. https://doi.org/10.1145/3242587.3242664
[26]
Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in pytorch. (2017).
[27]
Andreas Pointner, Thomas Preindl, Sara Mlakar, Roland Aigner, and Michael Haller. 2020. Knitted RESi: A Highly Flexible, Force-Sensitive Knitted Textile Based on Resistive Yarns. In ACM SIGGRAPH 2020 Emerging Technologies. 1--2.
[28]
Andreas Pointner, Thomas Preindl, Sara Mlakar, Roland Aigner, and Michael Haller. 2020. Knitted RESi: A Highly Flexible, Force-Sensitive Knitted Textile Based on Resistive Yarns. In ACM SIGGRAPH 2020 Emerging Technologies (SIGGRAPH '20). Association for Computing Machinery, New York, NY, USA, Article 21, 2 pages. https://doi.org/10.1145/3388534.3407292
[29]
E. R. Post, M. Orth, P. R. Russo, and N. Gershenfeld. 2000. E-broidery: Design and Fabrication of Textile-based Computing. IBM Syst. J. 39, 3-4 (July 2000), 840--860. https://doi.org/10.1147/sj.393.0840
[30]
Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig, and Karen E. Robinson. 2016. Project Jacquard: Interactive Digital Textiles at Scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4216--4227. https://doi.org/10.1145/2858036.2858176
[31]
Casey Reas and Ben Fry 2006. Processing: Programming for the Media Arts. AI Soc. 20, 4 (Aug. 2006), 526--538. https://doi.org/10.1007/s00146-006-0050-9
[32]
David E Rumelhart, Geoffrey E Hinton, Ronald J Williams, et al. 1988. Learning representations by back-propagating errors. Cognitive modeling 5, 3 (1988), 1.
[33]
Stefan Schneegass and Alexandra Voit. 2016. GestureSleeve: Using Touch Sensitive Fabrics for Gestural Input on the Forearm for Controlling Smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16). ACM, New York, NY, USA, 108--115. https://doi.org/10.1145/2971763.2971797
[34]
Ryan Seguine et al. 2007. Capacitive Sensing Techniques and Considerations. Cypress Semiconductor Corporation Mobile Handset DesignLine (2007).
[35]
Mathias Sundholm, Jingyuan Cheng, Bo Zhou, Akash Sethi, and Paul Lukowicz. 2014. Smart-mat: Recognizing and counting gym exercises with low-cost resistive pressure sensing matrix. In Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing. 373--382.
[36]
Seiichi Takamatsu, Takeshi Kobayashi, Nobuhisa Shibayama, Koji Miyake, and Toshihiro Itoh. 2011. Meter-scale surface capacitive type of touch sensors fabricated by weaving conductive-polymer-coated fibers. In 2011 Symposium on Design, Test, Integration Packaging of MEMS/MOEMS (DTIP). 142--147.
[37]
Richard Vallett, Denisa Qori McDonald, Genevieve Dion, Youngmoo Kim, and Ali Shokoufandeh. 2020. Toward Accurate Sensing with Knitted Fabric: Applications and Technical Considerations. 4, EICS (2020). https://doi.org/10.1145/3394981
[38]
Richard Vallett, Ryan Young, Chelsea Knittel, Youngmoo Kim, and Geneviève Dion. 2016. Development of a Carbon Fiber Knitted Capacitive Touch Sensor. MRS Advances 1, 38 (2016), 2641--2651. https://doi.org/10.1557/adv.2016.498
[39]
Irmandy Wicaksono and Joseph Paradiso. 2020. KnittedKeyboard: Digital Knitting of Electronic Textile Musical Controllers.
[40]
Raphael Wimmer and Patrick Baudisch. 2011. Modular and Deformable Touch-sensitive Surfaces Based on Time Domain Reflectometry. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 517--526. https://doi.org/10.1145/2047196.2047264

Cited By

View all
  • (2025)Simulation based optimization of textile integrated circuits and conductorsResults in Engineering10.1016/j.rineng.2024.10385725(103857)Online publication date: Mar-2025
  • (2024)airTac: A Contactless Digital Tactile Receptor for Detecting Material and Roughness via Terahertz SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785868:3(1-37)Online publication date: 9-Sep-2024
  • (2024)Exploring a Software Tool for Biofibers DesignAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686317(1-3)Online publication date: 13-Oct-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 4, Issue 4
December 2020
1356 pages
EISSN:2474-9567
DOI:10.1145/3444864
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 December 2020
Published in IMWUT Volume 4, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. evaluation study
  2. knitted sensors
  3. neural networks
  4. real-time sensing
  5. real-world sensing
  6. robustness study
  7. touch detection

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)99
  • Downloads (Last 6 weeks)11
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Simulation based optimization of textile integrated circuits and conductorsResults in Engineering10.1016/j.rineng.2024.10385725(103857)Online publication date: Mar-2025
  • (2024)airTac: A Contactless Digital Tactile Receptor for Detecting Material and Roughness via Terahertz SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785868:3(1-37)Online publication date: 9-Sep-2024
  • (2024)Exploring a Software Tool for Biofibers DesignAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686317(1-3)Online publication date: 13-Oct-2024
  • (2024)What's in a cable? Abstracting Knitting Design Elements with Blended Raster/Vector PrimitivesProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676351(1-20)Online publication date: 13-Oct-2024
  • (2024)SeamSleeve: Robust Arm Movement Sensing through Powered StitchingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660726(1134-1147)Online publication date: 1-Jul-2024
  • (2024)KnitScape: Computational Design and Yarn-Level Simulation of Slip and Tuck Colorwork Knitting PatternsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642799(1-20)Online publication date: 11-May-2024
  • (2024)Loopsense: low-scale, unobtrusive, and minimally invasive knitted force sensors for multi-modal input, enabled by selective loop-meshingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642528(1-17)Online publication date: 11-May-2024
  • (2024)Programming mechanics in knitted materials, stitch by stitchNature Communications10.1038/s41467-024-46498-z15:1Online publication date: 23-Mar-2024
  • (2024)A Knitted and MXenzyme-Integrated Dressing for Geriatrics Diagnosis and Ulcer HealingACS Nano10.1021/acsnano.4c0677418:34(23412-23427)Online publication date: 15-Aug-2024
  • (2023)EmTex: Prototyping Textile-Based Interfaces through An Embroidered Construction KitProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606815(1-17)Online publication date: 29-Oct-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media