Work in Progress

Closing the Loop: The Effects of Biofeedback Awareness on Physiological Stress Response Using Electrodermal Activity in Virtual Reality

Authors:

Valentin SchwindAuthors Info & Claims

CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

Article No.: 76, Pages 1 - 7

https://doi.org/10.1145/3613905.3650830

Published: 11 May 2024 Publication History

Abstract

This paper presents the results of a user study examining the impact of biofeedback awareness on the effectiveness of stress management, utilizing Electrodermal Activity (EDA) as the primary metric within an immersive Virtual Reality (VR). Employing a between-subjects design (N=30), we probed whether informing individuals of their capacity to manipulate the VR environment’s weather impacts their physiological stress responses. Our results indicate lower EDA levels of participants who were informed of their biofeedback control than those participants who were not informed about their biofeedback control. Interestingly, the participants who were informed about the control over the environment also manifested variations in their EDA responses. Participants who were not informed of their ability to control the weather showed decreased EDA measures until the end of the biofeedback phase. This study enhances our comprehension of the significance of awareness in biofeedback in immersive settings and its potential to augment stress management techniques.

Supplemental Material

MP4 File - Video Preview

Video Preview

Download
55.31 MB

MP4 File

Talk Video

Transcript for: Talk Video

References

[1]

Hussein Al Osman, Haiwei Dong, and Abdulmotaleb El Saddik. 2016. Ubiquitous Biofeedback Serious Game for Stress Management. IEEE Access 4 (March 2016), 1274–1286. https://doi.org/10.1109/ACCESS.2016.2548980

[2]

Carol Austad and Michael Gendron. 2018. Biofeedback: Using the Power of the Mind–Body Connection, Technology, and Business in Psychotherapies of the Future. Professional Psychology: Research and Practice 49 (Aug. 2018), 264–273. https://doi.org/10.1037/pro0000197

[3]

Jason J Braithwaite, Derrick G Watson, Robert Jones, and Mickey Rowe. 2013. A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49, 1 (2013), 1017–1034.

[4]

N. J. Carriero. 1975. The effects of paced tapping on heart rate, skin conductance, and muscle potential. Psychophysiology 12, 2 (March 1975), 130–135. https://doi.org/10.1111/j.1469-8986.1975.tb01262.x arXiv:1135344

[5]

Francesco Chiossi, Thomas Kosch, Luca Menghini, Steeven Villa, and Sven Mayer. 2023. SensCon: Embedding Physiological Sensing into Virtual Reality Controllers. Proc. ACM Hum.-Comput. Interact. 7, MHCI (Sept. 2023), 1–32. https://doi.org/10.1145/3604270

Digital Library

[6]

Nele A. J. De Witte, Inez Buyck, and Tom Van Daele. 2019. Combining Biofeedback with Stress Management Interventions: A Systematic Review of Physiological and Psychological Effects. Appl. Psychophysiol. Biofeedback 44, 2 (June 2019), 71–82. https://doi.org/10.1007/s10484-018-09427-7

[7]

Darragh Egan, Sean Brennan, John Barrett, Yuansong Qiao, Christian Timmerer, and Niall Murray. 2016. An evaluation of Heart Rate and ElectroDermal Activity as an objective QoE evaluation method for immersive virtual reality environments. In 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX). 1–6. https://doi.org/10.1109/QoMEX.2016.7498964

[8]

Pedro Ferreira, Pedro Sanches, Kristina Höök, and Tove Jaensson. 2008. License to chill! how to empower users to cope with stress. In NordiCHI ’08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges. Association for Computing Machinery, New York, NY, USA, 123–132. https://doi.org/10.1145/1463160.1463174

Digital Library

[9]

Stefan Gradl, Markus Wirth, Nico Mächtlinger, Romina Poguntke, Andrea Wonner, Nicolas Rohleder, and Bjoern M. Eskofier. 2019. The Stroop Room: A Virtual Reality-Enhanced Stroop Test. In VRST ’19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3359996.3364247

Digital Library

[10]

Kunal Gupta, Yuewei Zhang, Yun Suen Pai, and Mark Billinghurst. 2021. WizardOfVR: An Emotion-Adaptive Virtual Wizard Experience. In SIGGRAPH Asia 2021 XR (Tokyo, Japan) (SA ’21 XR). Association for Computing Machinery, New York, NY, USA, Article 18, 2 pages. https://doi.org/10.1145/3478514.3487628

Digital Library

[11]

Rudy Jeanne, Timothy Piton, Séphora Minjoz, Nicolas Bassan, Morgan Le Chenechal, Antoine Semblat, Pascal Hot, Astrid Kibleur, and Sonia Pellissier. 2023. Gut-Brain Coupling and Multilevel Physiological Response to Biofeedback Relaxation After a Stressful Task Under Virtual Reality Immersion: A Pilot Study. Appl. Psychophysiol. Biofeedback 48, 1 (March 2023), 109–125. https://doi.org/10.1007/s10484-022-09566-y

[12]

Lauren Kennedy and Sarah Henrickson Parker. 2019. Biofeedback as a stress management tool: a systematic review. Cogn. Tech. Work 21, 2 (May 2019), 161–190. https://doi.org/10.1007/s10111-018-0487-x

Digital Library

[13]

I. Khazan. 2009. Psychophysiological stress assessment using biofeedback.Journal of visualized experiments : JoVE 29 (2009). https://doi.org/10.3791/1443

[14]

Clemens Kirschbaum, Karl-Martin Pirke, and Dirk H. Hellhammer. 1993. The ‘Trier Social Stress Test’ – A Tool for Investigating Psychobiological Stress Responses in a Laboratory Setting. Neuropsychobiology 28, 1-2 (Dec. 1993), 76–81. https://doi.org/10.1159/000119004

[15]

Agnes M. Kloft, Robin Welsch, Thomas Kosch, and Steeven Villa. 2023. "AI enhances our performance, I have no doubt this one will do the same": The Placebo effect is robust to negative descriptions of AI. arxiv:2309.16606 [cs.HC]

[16]

Martin Kocur, Philipp Schaubhuber, Valentin Schwind, Christian Wolff, and Niels Henze. 2020. The Effects of Self- and External Perception of Avatars on Cognitive Task Performance in Virtual Reality. In 26th ACM Symposium on Virtual Reality Software and Technology (2020-11-01) (VRST ’20). Association for Computing Machinery, Virtual Event, Canada, 11. https://doi.org/10.1145/3385956.3418969

Digital Library

[17]

Thomas Kosch, Jakob Karolus, Havy Ha, and Albrecht Schmidt. 2019. Your skin resists: exploring electrodermal activity as workload indicator during manual assembly. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (Valencia, Spain) (EICS ’19). Association for Computing Machinery, New York, NY, USA, Article 8, 5 pages. https://doi.org/10.1145/3319499.3328230

Digital Library

[18]

Yuka Kotozaki, Hikaru Takeuchi, Atsushi Sekiguchi, Yuki Yamamoto, Takamitsu Shinada, Tsuyoshi Araki, Kei Takahashi, Yasuyuki Taki, Takeshi Ogino, Masashi Kiguchi, and Ryuta Kawashima. 2014. Biofeedback-based training for stress management in daily hassles: an intervention study. Brain Behav. 4, 4 (July 2014), 566–579. https://doi.org/10.1002/brb3.241

[19]

Jane B. Lemaire, Jean E. Wallace, Adriane M. Lewin, Jill de Grood, and Jeffrey P. Schaefer. 2011. The effect of a biofeedback-based stress management tool on physician stress: a randomized controlled clinical trial. Open Medicine 5, 4 (2011), e154. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3345375

[20]

Michael Meehan, Brent Insko, Mary Whitton, and Frederick P. Brooks. 2002. Physiological measures of presence in stressful virtual environments. ACM Trans. Graphics 21, 3 (July 2002), 645–652. https://doi.org/10.1145/566654.566630

Digital Library

[21]

Alin Moldoveanu, Oana Mitruț, Nicolae Jinga, Cătălin Petrescu, Florica Moldoveanu, Victor Asavei, Ana Magdalena Anghel, and Livia Petrescu. 2023. Immersive Phobia Therapy through Adaptive Virtual Reality and Biofeedback. Applied Sciences 13, 18 (2023). https://doi.org/10.3390/app131810365

[22]

Lennart Erik Nacke, Michael Kalyn, Calvin Lough, and Regan Lee Mandryk. 2011. Biofeedback game design: using direct and indirect physiological control to enhance game interaction. In CHI ’11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 103–112. https://doi.org/10.1145/1978942.1978958

Digital Library

[23]

Aileen C. Naef, Marie-Madlen Jeitziner, Samuel E. J. Knobel, Matthias Thomas Exl, René M. Müri, Stephan M. Jakob, Tobias Nef, and Stephan M. Gerber. 2022. Investigating the role of auditory and visual sensory inputs for inducing relaxation during virtual reality stimulation. Sci. Rep. 12, 17073 (Oct. 2022), 1–11. https://doi.org/10.1038/s41598-022-21575-9

[24]

Mark Nazemi, Maryam Mobini, Diane Gromala, Hin Hin Ko, and Julie Carlson. 2017. Sonic therapy for anxiety management in clinical settings. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare (Barcelona, Spain) (PervasiveHealth ’17). Association for Computing Machinery, New York, NY, USA, 455–459. https://doi.org/10.1145/3154862.3154892

Digital Library

[25]

Mark A. Neerincx, Victor L. Kallen, Anne-Marie Brouwer, Leslie van der Leer, and Michiel ten Brinke. 2010. Virtual reality exposure and neuro-bio feedback to help coping with traumatic events. In Proceedings of the 28th Annual European Conference on Cognitive Ergonomics (Delft, Netherlands) (ECCE ’10). Association for Computing Machinery, New York, NY, USA, 367–369. https://doi.org/10.1145/1962300.1962388

Digital Library

[26]

Wanyu Pei, Xiangmin Guo, and Tiantian Lo. 2021. Biofeedback in the Dynamic VR Environments: A Method to Evaluate the Influence of Architectural Elements on Human Spatial Perception. In 2021 Workshop on Algorithm and Big Data (Fuzhou, China) (WABD 2021). Association for Computing Machinery, New York, NY, USA, 27–33. https://doi.org/10.1145/3456389.3456400

Digital Library

[27]

Xiaolan Peng, Xurong Xie, Jin Huang, Chutian Jiang, Haonian Wang, Alena Denisova, Hui Chen, Feng Tian, and Hongan Wang. 2023. ChallengeDetect: Investigating the Potential of Detecting In-Game Challenge Experience from Physiological Measures. In CHI ’23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–29. https://doi.org/10.1145/3544548.3581232

Digital Library

[28]

Erik Peper, Pamela Martinez Aranda, and Donald Moss. 2015. Vulvodynia Treated Successfully with Breathing Biofeedback and Integrated Stress Reduction: A Case Report. Biofeedback 43, 2 (June 2015), 94–100. https://doi.org/10.5298/1081-5937-43.2.04

[29]

Unnikrishnan Radhakrishnan, Francesco Chinello, and Konstantinos Koumaditis. 2023. Investigating the effectiveness of immersive VR skill training and its link to physiological arousal. Virtual Reality 27, 2 (June 2023), 1091–1115. https://doi.org/10.1007/s10055-022-00699-3

Digital Library

[30]

Raquel Robinson, Katelyn Wiley, Amir Rezaeivahdati, Madison Klarkowski, and Regan L. Mandryk. 2020. \. In CHI PLAY ’20: Proceedings of the Annual Symposium on Computer-Human Interaction in Play. Association for Computing Machinery, New York, NY, USA, 132–147. https://doi.org/10.1145/3410404.3414227

Digital Library

[31]

Deba Pratim Saha, R. Benjamin Knapp, and Thomas L. Martin. 2017. Affective feedback in a virtual reality based intelligent supermarket. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers (Maui, Hawaii) (UbiComp ’17). Association for Computing Machinery, New York, NY, USA, 646–653. https://doi.org/10.1145/3123024.3124426

Digital Library

[32]

Débora Pereira Salgado, Felipe Roque Martins, Thiago Braga Rodrigues, Conor Keighrey, Ronan Flynn, Eduardo Lázaro Martins Naves, and Niall Murray. 2018. A QoE assessment method based on EDA, heart rate and EEG of a virtual reality assistive technology system. In Proceedings of the 9th ACM Multimedia Systems Conference (Amsterdam, Netherlands) (MMSys ’18). Association for Computing Machinery, New York, NY, USA, 517–520. https://doi.org/10.1145/3204949.3208118

Digital Library

[33]

Pedro Sanches, Kristina Höök, Elsa Vaara, Claus Weymann, Markus Bylund, Pedro Ferreira, Nathalie Peira, and Marie Sjölinder. 2010. Mind the body! designing a mobile stress management application encouraging personal reflection. In DIS ’10: Proceedings of the 8th ACM Conference on Designing Interactive Systems. Association for Computing Machinery, New York, NY, USA, 47–56. https://doi.org/10.1145/1858171.1858182

Digital Library

[34]

Tanja Schneeberger, Naomi Sauerwein, Manuel S. Anglet, and Patrick Gebhard. 2020. Developing a Social Biofeedback Training System for Stress Management Training. In ICMI ’20 Companion: Companion Publication of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery, New York, NY, USA, 472–476. https://doi.org/10.1145/3395035.3425222

Digital Library

[35]

Valentin Schwind, Stefan Resch, and Jessica Sehrt. 2023. The HCI User Studies Toolkit: Supporting Study Designing and Planning for Undergraduates and Novice Researchers in Human-Computer Interaction. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23) (2023-04-23). ACM. https://doi.org/10.1145/3544549.3585890

Digital Library

[36]

Joyce Segreto. 1995. The role of EMG awareness in EMG biofeedback learning. Biofeedback and Self-Regulation 20, 2 (June 1995), 155–167. https://doi.org/10.1007/BF01720971

[37]

Jessica Sehrt, Leonardo Ferreira, Karsten Weyers, Amir Mahmood, Thomas Kosch, and Valentin Schwind. 2024. Improving Electromyographic Muscle Response Times through Visual and Tactile Prior Stimulation in Virtual Reality. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (2024-01-01) (CHI 4). ACM, Honolulu, HI, USA. https://doi.org/10.1145/3613904.36420

Digital Library

[38]

Jessica Sehrt, Tim Wißmann, Jan Breitenbach, and Valentin Schwind. 2023. The Effects of Body Location and Biosignal Feedback Modality on Performance and Workload Using Electromyography in Virtual Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 84, 16 pages. https://doi.org/10.1145/3544548.3580738

Digital Library

[39]

Kinga Skiers, Yun Suen Pai, and Kouta Minamizawa. 2022. Transcendental Avatar: Experiencing Bioresponsive Avatar of the Self for Improved Cognition. In SIGGRAPH Asia 2022 Posters (Daegu, Republic of Korea) (SA ’22). Association for Computing Machinery, New York, NY, USA, Article 39, 2 pages. https://doi.org/10.1145/3550082.3564210

Digital Library

[40]

Lukasz Tyszczuk Smith, Liat Levita, Francesco Amico, Jennifer Fagan, John H. Yek, Justin Brophy, Haihong Zhang, and Mahnaz Arvaneh. [n. d.]. Using Resting State Heart Rate Variability and Skin Conductance Response to Detect Depression in Adults. In 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE, 20–24. https://doi.org/10.1109/EMBC44109.2020.9176304

[41]

Herman Staudenmayer and Robert A. Kinsman. 1976. Awareness during electromyographic biofeedback: Of signal or process?Biofeedback and Self-Regulation 1, 2 (June 1976), 191–199. https://doi.org/10.1007/BF00998586

[42]

R. Vetrugno, R. Liguori, P. Cortelli, and P. Montagna. 2003. Sympathetic skin response. Clin. Auton. Res. 13, 4 (Aug. 2003), 256–270. https://doi.org/10.1007/s10286-003-0107-5

[43]

Sebastian Weiß, Nelly Klassen, and Wilko Heuten. 2021. Effects of Image Realism on the Stress Response in Virtual Reality. In VRST ’21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3489849.3489885

Digital Library

[44]

Kody Wood, Alvaro Joffre Uribe Quevedo, Lina Penuela, Sharman Perera, and Bill Kapralos. 2022. Virtual Reality Assessment and Customization Using Physiological Measures: A Literature Analysis. In Proceedings of the 23rd Symposium on Virtual and Augmented Reality (, Virtual Event, Brazil, ) (SVR ’21). Association for Computing Machinery, New York, NY, USA, 64–73. https://doi.org/10.1145/3488162.3488228

Digital Library

[45]

Bin Yu, Mathias Funk, Jun Hu, and Loe Feijs. 2017. StressTree: A Metaphorical Visualization for Biofeedback-assisted Stress Management. In DIS ’17: Proceedings of the 2017 Conference on Designing Interactive Systems. Association for Computing Machinery, New York, NY, USA, 333–337. https://doi.org/10.1145/3064663.3064729

Digital Library

[46]

Bin Yu, Mathias Funk, Jun Hu, Qi Wang, and Loe Feijs. 2018. Biofeedback for Everyday Stress Management: A Systematic Review. Front. ICT 5 (Sept. 2018), 297761. https://doi.org/10.3389/fict.2018.00023

Cited By

Schmitz MSchön DKlagemann HKosch T(2024)3DA: Assessing 3D-Printed Electrodes for Measuring Electrodermal ActivityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650938(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650938

Index Terms

Closing the Loop: The Effects of Biofeedback Awareness on Physiological Stress Response Using Electrodermal Activity in Virtual Reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Laboratory experiments
    2. Interaction paradigms
      1. Virtual reality
  2. Visualization
    1. Empirical studies in visualization

Recommendations

Is virtual reality emotionally arousing? Investigating five emotion inducing virtual park scenarios

Following the idea of using virtual environments (VEs) as mood induction procedures (MIPs), this study set out to examine whether five different virtual park scenarios would each elicit a specific affective state (i.e., joy, sadness, boredom, anger and ...
Psychological and physiological responses to stressful situations in immersive virtual reality

Several studies in the literature have shown positive psychophysical effects during or immediately after mindfulness meditation. However, the extent to which such positive effects are maintained in real-life, stressful contexts, remains unclear. This ...
Voluntary facial activations regulate physiological arousal and subjective experiences during virtual social stimulation

Exposure to distressing computer-generated stimuli and feedback of physiological changes during exposure have been effective in the treatment of anxiety disorders (e.g., social phobia). Here we studied voluntary facial activations as a method for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

May 2024

4761 pages

ISBN:9798400703317

DOI:10.1145/3613905

Editors:
Florian Floyd Mueller
Monash University
,
Penny Kyburz
The Australian National University
,
Julie R. Williamson
University of Glasgow
,
Corina Sas
Lancaster University

Copyright © 2024 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 May 2024

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Funding Sources

Hessian Ministry for Science and Art

Conference

CHI '24

Sponsor:

CHI '24: CHI Conference on Human Factors in Computing Systems

May 11 - 16, 2024

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
298
Total Downloads

Downloads (Last 12 months)298
Downloads (Last 6 weeks)53

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schmitz MSchön DKlagemann HKosch T(2024)3DA: Assessing 3D-Printed Electrodes for Measuring Electrodermal ActivityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650938(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650938

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents