Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3623509.3633372acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article
Open access

breatHaptics: Enabling Granular Rendering of Breath Signals via Haptics using Shape-Changing Soft Interfaces

Published: 11 February 2024 Publication History

Abstract

Feeling breath signals from the digital world has many values in remote settings. These signals have been visually or audibly represented in previous research, but recent advances in wearable technology now enable us to simulate breath signals via haptics, as an intimate and intuitive form of non-verbal interaction. Prior works relied on low-resolution methods of breath signal rendering and thus a limited understanding of associated haptic perceptions. Addressing this gap, our research introduces breatHaptics, a wearable that offers a high-resolution, haptic representation of breath signals. By utilizing extracted breath data, a mapping algorithm model and finely-tuned soft actuated materials, we deliver a granular simulation of human breath. Through a perception study involving force discrimination testing and haptic experience evaluation, we demonstrate breatHaptics’ ability to create a rich, nuanced tactile sensation of feeling breath haptically. Our work illustrates the promising role of breatHaptics as part of wearable technologies in offering well-being support.

Supplemental Material

MP4 File
Presentation Video
ZIP File
Presentation Video

References

[1]
Ilhan Aslan, Hadrian Burkhardt, Julian Kraus, and Elisabeth André. 2016. Hold my heart and breathe with me: Tangible somaesthetic designs. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction. 1–6.
[2]
Hedan Bai, Shuo Li, and Robert F Shepherd. 2021. Elastomeric haptic devices for virtual and augmented reality. Advanced Functional Materials 31, 39 (2021), 2009364.
[3]
Frank Biocca, Chad Harms, and Judee K Burgoon. 2003. Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence: Teleoperators & virtual environments 12, 5 (2003), 456–480.
[4]
Laurens Boer and Harvey Bewley. 2018. Reconfiguring the appearance and expression of social robots by acknowledging their otherness. In Proceedings of the 2018 Designing Interactive Systems Conference: DIS’18. Association for Computing Machinery, 667–677.
[5]
Frans A Boiten, Nico H Frijda, and Cornelis JE Wientjes. 1994. Emotions and respiratory patterns: review and critical analysis. International journal of psychophysiology 17, 2 (1994), 103–128.
[6]
Ion Boldea. 2004. Linear electromagnetic actuators and their control: A review. EPE Journal 14, 1 (2004), 43–50.
[7]
Paul Brochu and Qibing Pei. 2012. Dielectric elastomers for actuators and artificial muscles. In Electroactivity in polymeric materials. Springer, 1–56.
[8]
Paul Bucci, Xi Laura Cang, Anasazi Valair, David Marino, Lucia Tseng, Merel Jung, Jussi Rantala, Oliver S Schneider, and Karon E MacLean. 2017. Sketching cuddlebits: coupled prototyping of body and behaviour for an affective robot pet. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3681–3692.
[9]
Guillaume Chanel and Christian Mühl. 2015. Connecting brains and bodies: applying physiological computing to support social interaction. Interacting with Computers 27, 5 (2015), 534–550.
[10]
Kyung Yun Choi, Neska ElHaouij, Jinmo Lee, Rosalind W. Picard, and Hiroshi Ishii. 2022. Design and Evaluation of a Clippable and Personalizable Pneumatic-Haptic Feedback Device for Breathing Guidance. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 1, Article 6 (mar 2022), 36 pages. https://doi.org/10.1145/3517234
[11]
Crystal Compton, Heidi Woelfle, Bolanle O. Dahunsi, Robert Pettys-Baker, Niharikha Subash, Miles Priebe, and Brad Holschuh. 2021. Dynamic, Discreet, Robotic Compression Garment for Real-Time Stress Assessment and Intervention. In 2021 International Symposium on Wearable Computers (Virtual, USA) (ISWC ’21). Association for Computing Machinery, New York, NY, USA, 170–174. https://doi.org/10.1145/3460421.3478837
[12]
John Desnoyers-Stewart, Ekaterina R Stepanova, Philippe Pasquier, and Bernhard E Riecke. 2019. JeL: Connecting through breath in virtual reality. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1–6.
[13]
Esko O Dijk and Alina Weffers. 2011. Breathe with the ocean: a system for relaxation using audio, haptic and visual stimuli. In Special symposium at eurohaptics 2010: Haptic and audio-visual stimuli: Enhancing experiences and interaction, Amsterdam, The Netherlands. Univ. Twente.
[14]
Toan Dinh, Thanh Nguyen, Hoang-Phuong Phan, Nam-Trung Nguyen, Dzung Viet Dao, and John Bell. 2020. Stretchable respiration sensors: Advanced designs and multifunctional platforms for wearable physiological monitoring. Biosensors and Bioelectronics 166 (2020), 112460.
[15]
George H Van Doorn, Vladimir Dubaj, Dianne B Wuillemin, Barry L Richardson, and Mark A Symmons. 2012. Cognitive load can explain differences in active and passive touch. In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 91–102.
[16]
Mihai Duduta, Ehsan Hajiesmaili, Huichan Zhao, Robert J Wood, and David R Clarke. 2019. Realizing the potential of dielectric elastomer artificial muscles. Proceedings of the National Academy of Sciences 116, 7 (2019), 2476–2481.
[17]
Nathan Dunkelberger, Joshua Bradley, Jennifer L Sullivan, Ali Israr, Frances Lau, Keith Klumb, Freddy Abnousi, and Marcia K O’Malley. 2018. Improving perception accuracy with multi-sensory haptic cue delivery. In Haptics: Science, Technology, and Applications: 11th International Conference, EuroHaptics 2018, Pisa, Italy, June 13-16, 2018, Proceedings, Part II 11. Springer, 289–301.
[18]
Shreyosi Endow, Hedieh Moradi, Anvay Srivastava, Esau G Noya, and Cesar Torres. 2021. Compressables: A haptic prototyping toolkit for wearable compression-based interfaces. In Designing Interactive Systems Conference 2021. 1101–1114.
[19]
Norman Farb, Jennifer Daubenmier, Cynthia J Price, Tim Gard, Catherine Kerr, Barnaby D Dunn, Anne Carolyn Klein, Martin P Paulus, and Wolf E Mehling. 2015. Interoception, contemplative practice, and health. Frontiers in psychology 6 (2015), 763.
[20]
Alexz Farrall, Jordan Taylor, Ben Ainsworth, and Jason Alexander. 2023. Manifesting Breath: Empirical Evidence for the Integration of Shape-changing Biofeedback-based Artefacts within Digital Mental Health Interventions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–14.
[21]
Rachel R Feinberg, Udaya Lakshmi, Matthew J Golino, and Rosa I Arriaga. 2022. ZenVR: Design Evaluation of a Virtual Reality Learning System for Meditation. In CHI Conference on Human Factors in Computing Systems. 1–15.
[22]
Jérémy Frey, May Grabli, Ronit Slyper, and Jessica R Cauchard. 2018. Breeze: Sharing biofeedback through wearable technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.
[23]
James Gay, Moritz Umfahrer, Arthur Theil, Lea Buchweitz, Eva Lindell, Li Guo, Nils-Krister Persson, and Oliver Korn. 2020. Keep your distance: a playful haptic navigation wearable for individuals with deafblindness. In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility. 1–4.
[24]
Teng Han, Shubhi Bansal, Xiaochen Shi, Yanjun Chen, Baogang Quan, Feng Tian, Hongan Wang, and Sriram Subramanian. 2020. HapBead: on-skin microfluidic haptic Interface using tunable bead. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–10.
[25]
Alice C Haynes, Annie Lywood, Emily M Crowe, Jessica L Fielding, Jonathan M Rossiter, and Christopher Kent. 2022. A calming hug: Design and validation of a tactile aid to ease anxiety. Plos one 17, 3 (2022), e0259838.
[26]
Juan Julian Huaroto, Etsel Suarez, Hermano Igo Krebs, Paul D Marasco, and Emir A Vela. 2018. A soft pneumatic actuator as a haptic wearable device for upper limb amputees: Toward a soft robotic liner. IEEE Robotics and Automation Letters 4, 1 (2018), 17–24.
[27]
Rob J Hyndman. 2014. Measuring forecast accuracy. Business forecasting: Practical problems and solutions (2014), 177–183.
[28]
Rob J Hyndman and Anne B Koehler. 2006. Another look at measures of forecast accuracy. International journal of forecasting 22, 4 (2006), 679–688.
[29]
Ravinder Jerath and Connor Beveridge. 2020. Respiratory rhythm, autonomic modulation, and the spectrum of emotions: The future of emotion recognition and modulation. Frontiers in Psychology 11 (2020), 1980.
[30]
Niclas Kaiser and Emily Butler. 2021. Introducing social breathing: a model of engaging in relational systems. Frontiers in Psychology 12 (2021), 571298.
[31]
Hsin-Liu Kao, Miren Bamforth, David Kim, and Chris Schmandt. 2018. Skinmorph: texture-tunable on-skin interface through thin, programmable gel. In Proceedings of the 2018 ACM International Symposium on Wearable Computers. 196–203.
[32]
Pavel Karpashevich, Pedro Sanches, Rachael Garrett, Yoav Luft, Kelsey Cotton, Vasiliki Tsaknaki, and Kristina Höök. 2022. Touching our breathing through shape-change: Monster, organic other, or twisted mirror. ACM Transactions on Computer-Human Interaction (TOCHI) 29, 3 (2022), 1–40.
[33]
Peter E Keller, Giacomo Novembre, and Michael J Hove. 2014. Rhythm in joint action: psychological and neurophysiological mechanisms for real-time interpersonal coordination. Philosophical Transactions of the Royal Society B: Biological Sciences 369, 1658 (2014), 20130394.
[34]
Jina Kim, Young-Woo Park, and Tek-Jin Nam. 2015. BreathingFrame: An Inflatable Frame for Remote Breath Signal Sharing. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (Stanford, California, USA) (TEI ’15). Association for Computing Machinery, New York, NY, USA, 109–112. https://doi.org/10.1145/2677199.2680606
[35]
Jin Hee Kim, Kunpeng Huang, Simone White, Melissa Conroy, and Cindy Hsin-Liu Kao. 2021. KnitDermis: Fabricating tactile on-body interfaces through machine knitting. In Designing Interactive Systems Conference 2021. 1183–1200.
[36]
Susan J Lederman and Roberta L Klatzky. 2009. Haptic perception: A tutorial. Attention, Perception, & Psychophysics 71, 7 (2009), 1439–1459.
[37]
Dae-Young Lee, Seung Hee Jeong, Andy J. Cohen, Daniel M. Vogt, Matthias Kollosche, Geoffrey Lansberry, Yiğit Mengüç, Ali Israr, David R. Clarke, and Robert J. Wood. 0. A Wearable Textile-Embedded Dielectric Elastomer Actuator Haptic Display. Soft Robotics 0, 0 (0), null. https://doi.org/10.1089/soro.2021.0098 arXiv:https://doi.org/10.1089/soro.2021.0098PMID: 35856695.
[38]
Rock Leung, Karon MacLean, Martin Bue Bertelsen, and Mayukh Saubhasik. 2007. Evaluation of Haptically Augmented Touchscreen Gui Elements under Cognitive Load. In Proceedings of the 9th International Conference on Multimodal Interfaces (Nagoya, Aichi, Japan) (ICMI ’07). Association for Computing Machinery, New York, NY, USA, 374–381. https://doi.org/10.1145/1322192.1322258
[39]
Shuo Li, Hedan Bai, Robert F Shepherd, and Huichan Zhao. 2019. Bio-inspired Design and Additive Manufacturing of Soft Materials, Machines, Robots, and Haptic Interfaces. Angewandte Chemie International Edition 58, 33 (2019), 11182–11204.
[40]
Carmel Majidi. 2014. Soft robotics: a perspective—current trends and prospects for the future. Soft robotics 1, 1 (2014), 5–11.
[41]
Charles A Manion, Dinesh K Patel, M Fuge, and S Bergbrieter. 2018. Modeling and evaluation of additive manufactured HASEL actuators. In International Conference on Intelligent Robots and Systems (IEEE/RSJ).
[42]
Eric Markvicka, Guanyun Wang, Yi-Chin Lee, Gierad Laput, Carmel Majidi, and Lining Yao. 2019. Electrodermis: Fully untethered, stretchable, and highly-customizable electronic bandages. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–10.
[43]
Pardis Miri, Emily Jusuf, Andero Uusberg, Horia Margarit, Robert Flory, Katherine Isbister, Keith Marzullo, and James J Gross. 2020. Evaluating a personalizable, inconspicuous vibrotactile (piv) breathing pacer for in-the-moment affect regulation. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.
[44]
Hedieh Moradi and César Torres. 2020. Siloseam: A Morphogenetic Workflow for the Design and Fabrication of Inflatable Silicone Bladders. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. 1995–2006.
[45]
Stuart Moran, Nils Jäger, Holger Schnädelbach, and Kevin Glover. 2016. ExoPranayama: a biofeedback-driven actuated environment for supporting yoga breathing practices. Personal and Ubiquitous Computing 20, 2 (2016), 261–275.
[46]
Caitlin Morris, Pinyao Liu, Bernhard E Riecke, and Pattie Maes. 2023. InExChange: Fostering Genuine Social Connection through Embodied Breath Sharing in Mixed Reality. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–5.
[47]
Anne M Murray, Roberta L Klatzky, and Pradeep K Khosla. 2003. Psychophysical characterization and testbed validation of a wearable vibrotactile glove for telemanipulation. Presence: Teleoperators & Virtual Environments 12, 2 (2003), 156–182.
[48]
Sara Nabil, Lee Jones, and Audrey Girouard. 2021. Soft Speakers: Digital Embroidering of DIY Customizable Fabric Actuators. In Proceedings of the fifteenth international conference on tangible, embedded, and embodied interaction. 1–12.
[49]
Catherine S Oh, Jeremy N Bailenson, and Gregory F Welch. 2018. A systematic review of social presence: Definition, antecedents, and implications. Frontiers in Robotics and AI (2018), 114.
[50]
Julian Panetta, Florin Isvoranu, Tian Chen, Emmanuel Siéfert, Benoît Roman, and Mark Pauly. 2021. Computational inverse design of surface-based inflatables. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1–14.
[51]
Athina Papadopoulou, Jaclyn Berry, Terry Knight, and Rosalind Picard. 2019. Affective sleeve: Wearable materials with haptic action for promoting calmness. In International Conference on Human-Computer Interaction. Springer, 304–319.
[52]
Pablo Paredes and Matthew Chan. 2011. CalmMeNow: exploratory research and design of stress mitigating mobile interventions. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. 1699–1704.
[53]
Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in PyTorch. (2017).
[54]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019).
[55]
Jérôme Perret and Emmanuel Vander Poorten. 2018. Touching virtual reality: a review of haptic gloves. In ACTUATOR 2018; 16th International Conference on New Actuators. VDE, 1–5.
[56]
Pierre Philippot, Gaëtane Chapelle, and Sylvie Blairy. 2002. Respiratory feedback in the generation of emotion. Cognition & Emotion 16, 5 (2002), 605–627.
[57]
Mirjana Prpa, Ekaterina R. Stepanova, Thecla Schiphorst, Bernhard E. Riecke, and Philippe Pasquier. 2020. Inhaling and Exhaling: How Technologies Can Perceptually Extend Our Breath Awareness. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376183
[58]
Suji Sathiyamurthy, Melody Lui, Erin Kim, and Oliver Schneider. 2021. Measuring Haptic Experience: Elaborating the HX model with scale development. In 2021 IEEE World Haptics Conference (WHC). IEEE, 979–984.
[59]
Takashi G Sato, Mieko Ohsuga, Hidenori Boutani, and Takehiro Moriya. 2015. Tactile phantom sensation for coaching respiration timing. IEEE transactions on haptics 8, 1 (2015), 119–125.
[60]
Yasaman S Sefidgar, Karon E MacLean, Steve Yohanan, HF Machiel Van der Loos, Elizabeth A Croft, and E Jane Garland. 2015. Design and evaluation of a touch-centered calming interaction with a social robot. IEEE Transactions on Affective Computing 7, 2 (2015), 108–121.
[61]
Pallav Sengupta. 2012. Health impacts of yoga and pranayama: A state-of-the-art review. International journal of preventive medicine 3, 7 (2012), 444.
[62]
Vivian Shen, Craig Shultz, and Chris Harrison. 2022. Mouth Haptics in VR using a headset ultrasound phased array. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–14.
[63]
Emmanuel Siéfert, Etienne Reyssat, José Bico, and Benoît Roman. 2019. Bio-inspired pneumatic shape-morphing elastomers. Nature materials 18, 1 (2019), 24–28.
[64]
Alexander Skulmowski, Simon Pradel, Tom Kühnert, Guido Brunnett, and Günter Daniel Rey. 2016. Embodied learning using a tangible user interface: The effects of haptic perception and selective pointing on a spatial learning task. Computers & Education 92 (2016), 64–75.
[65]
Xiaotian Sun and Kiyoshi Tomimatsu. 2017. Breath is to be perceived-breathing signal sharing involved in remote emotional communication. In International Conference on Distributed, Ambient, and Pervasive Interactions. Springer, 472–481.
[66]
Hsin-Ruey Tsai, Yuan-Chia Chang, Tzu-Yun Wei, Chih-An Tsao, Xander Chin-yuan Koo, Hao-Chuan Wang, and Bing-Yu Chen. 2021. Guideband: Intuitive 3d multilevel force guidance on a wristband in virtual reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–13.
[67]
Vasiliki Tsaknaki. 2021. The Breathing Wings: An Autobiographical Soma Design Exploration of Touch Qualities through Shape-Change Materials. In Designing Interactive Systems Conference 2021. 1266–1279.
[68]
Vasiliki Tsaknaki, Kelsey Cotton, Pavel Karpashevich, and Pedro Sanches. 2021. “Feeling the Sensor Feeling you”: A Soma Design Exploration on Sensing Non-habitual Breathing. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–16.
[69]
Luca Turchet, David Baker, and Tony Stockman. 2021. Musical haptic wearables for synchronisation of visually-impaired performers: a co-design approach. In ACM International Conference on Interactive Media Experiences. 20–27.
[70]
Laia Turmo Vidal, Elena Márquez Segura, Christopher Boyer, and Annika Waern. 2019. Enlightened Yoga: Designing an Augmented Class with Wearable Lights to Support Instruction. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 1017–1031. https://doi.org/10.1145/3322276.3322338
[71]
Velko Vechev, Juan Zarate, David Lindlbauer, Ronan Hinchet, Herbert Shea, and Otmar Hilliges. 2019. Tactiles: Dual-mode low-power electromagnetic actuators for rendering continuous contact and spatial haptic patterns in VR. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 312–320.
[72]
Phillip Won, Seongmin Jeong, Carmel Majidi, and Seung Hwan Ko. 2021. Recent advances in liquid-metal-based wearable electronics and materials. Iscience 24, 7 (2021), 102698.
[73]
Shunsuke Yanaka, Motofumi Hattori, and Takayuki Kosaka. 2018. Reducing Fear or Anxiety by Simulating Breathing Movements as Physical Contact with an Unrelated Person. In Virtual, Augmented and Mixed Reality: Applications in Health, Cultural Heritage, and Industry: 10th International Conference, VAMR 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, July 15-20, 2018, Proceedings, Part II 10. Springer, 134–149.
[74]
Jessica Yin, Ronan Hinchet, Herbert Shea, and Carmel Majidi. 2021. Wearable Soft Technologies for Haptic Sensing and Feedback. Advanced Functional Materials 31, 39 (2021), 2007428. https://doi.org/10.1002/adfm.202007428 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/adfm.202007428
[75]
Jozef J Zwislocki and DA Goodman. 1980. Absolute scaling of sensory magnitudes: A validation. Perception & psychophysics 28, 1 (1980), 28–38.

Cited By

View all
  • (2024)Augmented Breathing via Thermal Feedback in the NoseProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676438(1-11)Online publication date: 13-Oct-2024

Index Terms

  1. breatHaptics: Enabling Granular Rendering of Breath Signals via Haptics using Shape-Changing Soft Interfaces

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    TEI '24: Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction
    February 2024
    1058 pages
    ISBN:9798400704024
    DOI:10.1145/3623509
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 February 2024

    Check for updates

    Author Tags

    1. Human breath
    2. haptic wearable
    3. remote communication
    4. shape-changing interface

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Data Availability

    Conference

    TEI '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 393 of 1,367 submissions, 29%

    Upcoming Conference

    TEI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)571
    • Downloads (Last 6 weeks)75
    Reflects downloads up to 22 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Augmented Breathing via Thermal Feedback in the NoseProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676438(1-11)Online publication date: 13-Oct-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media