research-article

Smart Arse: Posture Classification with Textile Sensors in Trousers

Authors:

Rebecca Stewart,

Patrick G. T. HealeyAuthors Info & Claims

ICMI '18: Proceedings of the 20th ACM International Conference on Multimodal Interaction

Pages 116 - 124

https://doi.org/10.1145/3242969.3242977

Published: 02 October 2018 Publication History

Abstract

Body posture is a good indicator of, amongst other things, people's state of arousal, focus of attention and level of interest in a conversation. Posture is conventionally measured by observation and hand coding of videos or, more recently, through automated computer vision and motion capture techniques. Here we introduce a novel alternative approach exploiting a new modality: posture classification using bespoke 'smart' trousers with integrated textile pressure sensors. Changes in posture translate to changes in pressure patterns across the surface of our clothing. We describe the construction of the textile pressure sensor and, using simple machine learning techniques on data gathered from 10 participants, demonstrate its ability to discriminate between 19 different basic posture types with high accuracy. This technology has the potential to support anonymous, unintrusive sensing of interest, attention and engagement in a wide variety of settings.

Supplementary Material

suppl.mov (icmi1027.mov)

Supplemental video

Download
19.56 MB

References

[1]

Bert Arnrich, Cornelia Setz, Roberto La Marca, Gerhard Tröster, and Ulrike Ehlert. 2010. What does your chair know about your stress level? IEEE Transactions on Information Technology in Biomedicine (2010).

Digital Library

[2]

Abdelwahab Bourai, Tadas Baltruš and Louis-Philippe Morency. 2017. Auto- matically Predicting Human Knowledgeability through Non-verbal Cues. 810 (2017).

[3]

Hennie Brugman and Albert Russel. 2004. Annotating Multi-media / Multi- modal resources with ELAN. In Proceedings of the 4th International Conference 7 https://zozo.com/ on Language Resources and Language Evaluation. European Language Resources Association, Paris, 2065--2068.

[4]

Peter E Bull. 2016. Posture & gesture. Vol. 16. Elsevier.

[5]

Joe D. Chalkley, Thomas T. Ranji, Carina E. I. Westling, Nachiappan Chock- alingam, and Harry J. Witchel. 2017. Wearable sensor metric for fidgeting. In Proceedings of the European Conference on Cognitive Ergonomics 2017 - ECCE 2017.

Digital Library

[6]

Jingyuan Cheng, Bo Zhou, Mathias Sundholm, and Paul Lukowicz. 2013. Smart Chair: What Can Simple Pressure Sensors under the Chairs' Legs Tell Us about User Activity?. In UBICOMM13: The Seventh International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies. 81--84. http://www. wearcomlab.de/publications/CZS2013.pdf

[7]

Sidney S D'Mello, Patrick Chipman, and Art Graesser. 2007. Posture as a predictor of learner's affective engagement. In Proceedings of the Annual Meeting of the Cognitive Science Society, Vol. 29.

[8]

Maurin Donneaud and Paul Strohmeier. 2017. Designing a Multi-Touch eTextile for Music Performances. In Proceedings of the 17th International Conference on New Interfaces for Musical Expression (NIME&17). Aalborg, Denmark, 15--19.

[9]

Maurin Donneaud and Paul Strohmeier. 2017. Musical Skin: Fabric Interface for Expressive Music Control. In Proceedings of International Conference on Movement and Computing. ACM, London.

[10]

Lucy E. Dunne, Guido Gioberto, Varun Ramesh, and Helen Koo. 2011. Measuring movement of denim trousers for garment-integrated sensing applications. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS.

[11]

Sidney K D Mello and Arthur Graesser. 2010. Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features. User Modeling and User-Adapted Interaction 20, 2 (2010), 147--187.

Digital Library

[12]

William Gaver, John Bowers, Andy Boucher, Andy Law, Sarah Pennington, and Nicholas Villar. 2006. The History Tablecloth: Illuminating Domestic Activity. In DIS '06 Proceedings of the 6th conference on Designing Interactive systems. ACM, New York, New York, USA, 199--208.

Digital Library

[13]

Guido Gioberto, James Coughlin, Kaila Bibeau, and Lucy E Dunne. 2013. Detecting bends and fabric folds using stitched sensors. In Proceedings of the 2013 International Symposium on Wearable Computers. 53--56.

Digital Library

[14]

Mark Hall Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer Peter Reutemann, and Ian H Witten. 2009. The WEKA Data Mining Software: An Update. ACM SIGKDD Explorations Newsletter 11, 1 (2009), 10--18.

Digital Library

[15]

Patrick George Healey, Nicola Plant, Christine Howes, and Mary Lavelle. 2015. When words fail: collaborative gestures during clarification dialogues. In Turn- Taking and Coordination in Human-Machine Interaction, 2015 AAAI Spring Sym- posium Series. AAAI, Chicago.

[16]

Patrick G T Healey and Stuart A Battersby. 2009. The interactional geometry of a three-way conversation. In Proceedings of the 31st Annual Conference of the Cognitive Science Society. 785--790.

[17]

Florian Heller, Stefan Ivanov, Chat Wacharamanotham, and Jan Borchers. 2014. FabriTouch: Exploring Flexible Touch Input on Textiles. In Proceedings of the 2014 ACM International Symposium on Wearable Computers. ACM, Seattle, Washington, 59--62.

Digital Library

[18]

G. Holmes, A. Donkin, and I.H. Witten. 1994. WEKA: a machine learning work- bench. In Proceedings of ANZIIS '94 - Australian New Zealnd Intelligent Information Systems Conference. IEEE, 357--361.

[19]

Holger Junker, Oliver Amft, Paul Lukowicz, and Gerhard Tröster. 2008. Ges- ture spotting with body-worn inertial sensors to detect user activities. Pattern Recognition (2008).

Digital Library

[20]

Adam Kendon. 1990. Conducting interaction: Patterns of behavior in focused encounters. Vol. 7. CUP Archive.

[21]

Mark L Knapp, Judith A Hall, and Terrence G Horgan. 2013. Nonverbal communication in human interaction. Cengage Learning.

[22]

Tianxing Li, Chuankai An, Zhao Tian, Andrew T Campbell, and Xia Zhou. 2015. Human Sensing Using Visible Light Communication. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 331--344.

Digital Library

[23]

Albert Mehrabian and Albert. 1968. Relationship of attitude to seated posture, orientation, and distance. Journal of Personality and Social Psychology 10, 1 (1968), 26--30.

[24]

Jan Meyer, Bert Arnrich, Johannes Schumm, and Gerhard Troster. 2010. Design and modeling of a textile pressure sensor for sitting posture classification. IEEE Sensors Journal (2010).

[25]

Dan Nathan-Roberts, Bingyune Chen, Gretchen Gscheidle, and David Rempel. 2008. Comparisons of Seated Postures between Office Tasks. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 52, 9 (2008), 692--696.

[26]

Fumio Nihei, Yukiko I. Nakano, and Yutaka Takase. 2016. Meeting extracts for discussion summarization based on multimodal nonverbal information. In Proceedings of the 18th ACM International Conference on Multimodal Interaction - ICMI 2016.

Digital Library

[27]

Hannah Perner-Wilson, Leah Buechley, and Mika Satomi. 2011. Handcrafting textile interfaces from a kit-of-no-parts. In Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction - TEI '11.

Digital Library

[28]

Hannah Perner-Wilson and Mika Satomi. 2009. DIY Wearable Technology ISEA 2009 Wearable Materialities Panel. In ISEA 15th International Symposium on Electronic Art.

[29]

Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig, and Karen E. Robinson. 2016. Project Jacquard. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16.

[30]

R B Ribas Manero, A Shafti, B Michael, J Grewal, J Ll Ribas Fernández, K Althoefer, and M J Howard. 2016. Wearable Embroidered Muscle Activity Sensing Device for the Human Upper Leg. (2016).

[31]

Andreas Riener and Alois Ferscha. 2008. Supporting Implicit Human-to-Vehicle Interaction: Driver Identification from Sitting Postures. In Proceedings of the First Annual International Symposium on Vehicular Computing Systems.

[32]

Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proceed- ings of the SIGCHI Conference on Human Factors in Computing Systems. 483--492.

Digital Library

[33]

Emanuel A Schegloff. 1998. Body Torque. Social Research 65, 3 (1998).

[34]

Sophie Skach, Patrick G T Healey, and Rebecca Stewart. 2017. Talking Through Your Arse: Sensing Conversation with Seat Covers. In Proceedings of the 39th Annual Meeting of the Cognitive Science Society. London.

[35]

Paul Strohmeier, Jarrod Knibbe, Sebastian Boring, and Kasper Hornbaek. 2018. zPatch: Hybrid Resistive/Capacitive eTextile Input. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, Stockholm, Sweden.

Digital Library

[36]

Hong Z. Tan, Lynne A. Slivovsky, and Alex Pentland. 2001. A sensing chair using pressure distribution sensors. IEEE/ASME Transactions on Mechatronics (2001).

[37]

Leena Ukkonen, Lauri Sydänheimo, and Yahya Rahmat-Samii. 2012. Sewed textile RFID tag and sensor antennas for on-body use. In Proceedings of 6th European Conference on Antennas and Propagation, EuCAP 2012.

[38]

K. Van Laerhoven and O. Cakmakci. {n. d.}. What shall we teach our pants?. In Digest of Papers. Fourth International Symposium on Wearable Computers.

Digital Library

[39]

Alessandro Vinciarelli, Maja Pantic, and HervÃ? Bourlard. 2009. Social signal processing: Survey of an emerging domain. Image and Vision Computing (2009).

Digital Library

[40]

Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and JÃijrgen Steimle. 2015. iSkin. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15.

Digital Library

[41]

Wei Weng, Peining Chen, Sisi He, Xuemei Sun, and Huisheng Peng. 2016. Smart electronic textiles. Angewandte Chemie International Edition 55, 21 (2016), 6140--6169.

[42]

Harry J. Witchel, Carlos P. Santos, James K. Ackah, Carina E. I. Westling, and Nachiappan Chockalingam. 2016. Non-Instrumental Movement Inhibition (NIMI) Differentially Suppresses Head and Thigh Movements during Screenic Engagement: Dependence on Interaction. Frontiers in Psychology (2016).

Cited By

Krauter CAngerbauer KSousa Calepso AAchberger AMayer SSedlmair M(2024)Sitting Posture Recognition and Feedback: A Literature ReviewProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642657(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642657
Shen TDi Giulio IHoward M(2023)A Probabilistic Model of Human Activity Recognition with Loose ClothingSensors10.3390/s2310466923:10(4669)Online publication date: 11-May-2023
https://doi.org/10.3390/s23104669
Qi JLi DHe JWang Y(2023)Optically Non-Contact Cross-Country Skiing Action Recognition Based on Key-Point Collaborative Estimation and Motion Feature ExtractionSensors10.3390/s2307363923:7(3639)Online publication date: 31-Mar-2023
https://doi.org/10.3390/s23073639
Show More Cited By

Index Terms

Smart Arse: Posture Classification with Textile Sensors in Trousers
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing design and evaluation methods

Recommendations

Lower-limb goniometry using stitched sensors: effects of manufacturing and wear variables
ISWC '14: Proceedings of the 2014 ACM International Symposium on Wearable Computers

Smart fabrics allow for convenient wearable sensing solutions to monitor body movements during our daily life. However, garment-integrated sensing presents challenges for accurate sensing, due many variables including those presented by variability in ...
Strike A Pose: Capturing Non-Verbal Behaviour with Textile Sensors
ICMI '18: Proceedings of the 20th ACM International Conference on Multimodal Interaction

This work searches to explore the potential of textile sensing systems as a new modality of capturing social behaviour. Hereby, the focus lies on evaluating the performance of embedded pressure sensors as reliable detectors for social cues, such as ...
Improving posture classification accuracy for depth sensor-based human activity monitoring in smart environments

A new posture classification framework for Kinect is proposed.Accuracy in classifying noisy postures is improved by considering the reliability of each joint.Reliability of a joint can be evaluated by the consistency in different aspects over ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICMI '18: Proceedings of the 20th ACM International Conference on Multimodal Interaction

October 2018

687 pages

ISBN:9781450356923

DOI:10.1145/3242969

General Chairs:
Sidney K. D'Mello
University of Illinois, USA
,
Panayiotis (Panos) Georgiou
University of Southern California, USA
,
Stefan Scherer
University of Southern California, USA
,
Program Chairs:
Emily Mower Provost
University of Michigan, USA
,
Mohammad Soleymani
University of Southern California, USA
,
Marcelo Worsley
Northwestern University, USA

Copyright © 2018 Owner/Author.

This work is licensed under a Creative Commons Attribution-NoDerivs International 4.0 License.

Sponsors

SIGCHI: Specialist Interest Group in Computer-Human Interaction of the ACM

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

EPSRC and AHRC Centre for Doctoral Training in Media and Arts Technology

Conference

ICMI '18

Sponsor:

SIGCHI

ICMI '18: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 16 - 20, 2018

CO, Boulder, USA

Acceptance Rates

ICMI '18 Paper Acceptance Rate 63 of 149 submissions, 42%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
457
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)11

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Krauter CAngerbauer KSousa Calepso AAchberger AMayer SSedlmair M(2024)Sitting Posture Recognition and Feedback: A Literature ReviewProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642657(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642657
Shen TDi Giulio IHoward M(2023)A Probabilistic Model of Human Activity Recognition with Loose ClothingSensors10.3390/s2310466923:10(4669)Online publication date: 11-May-2023
https://doi.org/10.3390/s23104669
Qi JLi DHe JWang Y(2023)Optically Non-Contact Cross-Country Skiing Action Recognition Based on Key-Point Collaborative Estimation and Motion Feature ExtractionSensors10.3390/s2307363923:7(3639)Online publication date: 31-Mar-2023
https://doi.org/10.3390/s23073639
Wu YVillalobos LYang ZCroisdale GKarataş ÇLiu J(2023)SmarCyPadProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109277:3(1-26)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610927
Fang FZhang HZhan LGuo SZhang MLin JQin YFu H(2023)Handwriting VelcroProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694616:4(1-31)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569461
Pica ABănescu I(2023)Survey of Electrical Ambient Intelligence (AmI) Devices Built for Environmental Monitoring2023 15th International Conference on Electronics, Computers and Artificial Intelligence (ECAI)10.1109/ECAI58194.2023.10194124(01-07)Online publication date: 29-Jun-2023
https://doi.org/10.1109/ECAI58194.2023.10194124
Zhang XFan JPeng TZheng PZhang XTang R(2023)Multimodal data-based deep learning model for sitting posture recognition toward office workers’ health promotionSensors and Actuators A: Physical10.1016/j.sna.2022.114150(114150)Online publication date: Jan-2023
https://doi.org/10.1016/j.sna.2022.114150
Bryan-Kinns NReed C(2023)A Guide to Evaluating the Experience of Media and Arts TechnologyCreating Digitally10.1007/978-3-031-31360-8_10(267-300)Online publication date: 3-Dec-2023
https://doi.org/10.1007/978-3-031-31360-8_10
Bello HZhou BSuh SSanchez Marin LLukowicz P(2022)Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as AntennasFrontiers in Computer Science10.3389/fcomp.2022.9152804Online publication date: 22-Jun-2022
https://doi.org/10.3389/fcomp.2022.915280
Muehlbradt AWhiting GKane SDevendorf L(2022)Knitting Access: Exploring Stateful Textiles with People with DisabilitiesProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533551(1058-1070)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533551
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents