research-article

Measuring Photoplethysmogram-Based Stress-Induced Vascular Response Index to Assess Cognitive Load and Stress

Authors:

Ken-ichi KameyamaAuthors Info & Claims

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Pages 857 - 866

https://doi.org/10.1145/2702123.2702399

Published: 18 April 2015 Publication History

Abstract

Quantitative assessment for cognitive load and mental stress is very important in optimizing human-computer system designs to improve performance and efficiency. Traditional physiological measures, such as heart rate variation (HRV), blood pressure and electrodermal activity (EDA), are widely used but still have limitations in sensitivity, reliability and usability. In this study, we propose a novel photoplethysmogram-based stress induced vascular index (sVRI) to measure cognitive load and stress. We also provide the basic methodology and detailed algorithm framework. We employed a classic experiment with three levels of task difficulty and three stages of testing period to verify the new measure. Compared with the blood pressure, heart rate and HRV components recorded simultaneously, the sVRI reached the same level of significance on the effect of task difficulty/period as the most significant other measure. Our findings showed sVRI's potential as a sensitive, reliable and usable parameter.

References

[1]

Paas, F., Tuovinen, J.E., Tabbers, H., et al. Cognitive Load Measurement as a Means to Advance Cognitive Load Theory. Educ. Psychol. 38, 1 (2003), 63--71.

[2]

Oviatt, S. Human-centered design meets cognitive load theory: designing interfaces that help people think. In Proc. 14th ACM Multimedia, ACM (2006), 871--880.

Digital Library

[3]

Brouwer, A.-M., Hogervorst, M.A., Holewijn, M., et al. Evidence for effects of task difficulty but not learning on neurophysiological variables associated with effort. Int. J. Psychophysiol. 93, 2 (2014), 242--252.

[4]

Brunken, R., Plass, J.L., and Leutner, D. Direct Measurement of Cognitive Load in Multimedia Learning. Educ. Psychol. 38, 1 (2003), 53--61.

[5]

Hernandez, J., Paredes, P., Roseway, A., et al. Under pressure: sensing stress of computer users. In Proc. CHI 2014, ACM (2014), 51--60.

Digital Library

[6]

Sun, D., Paredes, P., and Canny, J. MouStress: detecting stress from mouse motion. In Proc. CHI 2014, ACM (2014), 61--70.

Digital Library

[7]

Tan, C.S.S., Schning, J., Luyten, K., et al. Investigating the effects of using biofeedback as visual stress indicator during video-mediated collaboration. In Proc. CHI 2014, ACM (2014), 71--80.

Digital Library

[8]

Lazarus, R.S. Psychological stress and the coping process. McGraw-Hill (1966), New York.

[9]

Hart, S.G. and Staveland, L.E. Development of NASATLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology, North-Holland (1988), 139--183.

[10]

Verwey, W.B. and Veltman, H.A. Detecting short periods of elevated workload: A comparison of nine workload assessment techniques. J. Exp. Psychol. Appl. 2, 3 (1996), 270--285.

[11]

Matthews, G., Campbell, S.E., Falconer, S., et al. Fundamental dimensions of subjective state in performance settings: Task engagement, distress, and worry. Emotion 2, 4 (2002), 315--340.

[12]

Gao, Y., Bianchi-Berthouze, N., and Meng, H. What Does Touch Tell Us about Emotions in TouchscreenBased Gameplay? ACM Trans. Comput.-Hum. Interact. 19, 4 (2012), 1--30.

Digital Library

[13]

Dennerlein, J., Becker, T., Johnson, P., et al. Frustrating computer users increases exposure to physical factors. In Proceedings of the International Ergonomics Association, Seoul, Korea(2003).

[14]

Kreibig, S.D. Autonomic nervous system activity in emotion: A review. Biol. Psychol. 84, 3 (2010), 394--421.

[15]

Berntson, G.G., Cacioppo, J.T., and Quigley, K.S. Autonomic determinism: The modes of autonomic control, the doctrine of autonomic space, and the laws of autonomic constraint. Psychological. Review 98, 4 (1991), 459--487.

[16]

Iani, C., Gopher, D., and Lavie, P. Effects of task difficulty and invested mental effort on peripheral vasoconstriction. Psychophysiology 41, 5 (2004), 789798.

[17]

Mulder, G. The concept and measurement of mental effort. In Energetics and human information processing, Springer (1986), 175--198.

[18]

Brouwer, A.-M., Hogervorst, M.A., Van Erp, J.B., et al. Estimating workload using EEG spectral power and ERPs in the n-back task. Journal of neural engineering 9, 4 (2012), 045008.

[19]

Luo, L., Xiao, L., Miao, D., et al. The Relationship between Mental Stress Induced Changes in Cortisol Levels and Vascular Responses Quantified by Waveform Analysis: Investigating Stress-Dependent Indices of Vascular Changes. In ICBEB 2012, IEEE (2012), 929--933.

Digital Library

[20]

Hjortskov, N., Rissén, D., Blangsted, A.K., et al. The effect of mental stress on heart rate variability and blood pressure during computer work. Eur. J. Appl. Physiol. 92, 1--2 (2004), 84--89.

[21]

Bousefsaf, F., Maaoui, C., and Pruski, A. Remote detection of mental workload changes using cardiac parameters assessed with a low-cost webcam. Comput. Biol. Med. 53(2014), 154--163.

Digital Library

[22]

Yoo, K.-S. and Lee, W.-H. Mental stress assessment based on pulse photoplethysmography. In Proc. ISCE 2011, IEEE (2011), 323--326.

[23]

Chigira, H., Maeda, A., and Kobayashi, M. Area-based photo-plethysmographic sensing method for the surfaces of handheld devices. In Proc. UIST 2011, ACM (2011), 499--508.

Digital Library

[24]

Schäfer, A. and Vagedes, J. How accurate is pulse rate variability as an estimate of heart rate variability?: A review on studies comparing photoplethysmographic technology with an electrocardiogram. Int. J. Cardiol. 166, 1 (2013), 15--29.

[25]

Wijshoff, R.W.C.G.R., Veen, J., Van Der Lee, A.M., et al. PPG motion artifact handling using a self-mixing interferometric sensor. In SPIE2011, SPIE(2011), 78940F-78940F-78913.

[26]

Wijshoff, R.W.C.G.R., Mischi, M., Veen, J., et al. Reducing motion artifacts in photoplethysmograms by using relative sensor motion: phantom study. Journal of Biomedical Optics 17, 11 (2012), 117007--117007.

[27]

Chen, C.-C., Lin, S.-C., Young, M.-S., et al. Accumulated Mental Stress Study Using the Meridians of Traditional Chinese Medicine with Photoplethysmography. The Journal of Alternative and Complementary Medicine 20, 11 (2014), 860--867.

[28]

Ritter, F.E., Reifers, A.L., Klein, L.C., et al. Lessons from defining theories of stress for cognitive architectures. Integrated models of cognitive systems(2007), 254--262.

Cited By

Rony RAhmed MSarcar SAhmed N(2024)Understanding Driving Stress in Urban Bangladesh: An Exploratory Study, Wearable Development and ExperimentACM Journal on Computing and Sustainable Societies10.1145/36484342:2(1-28)Online publication date: 14-Feb-2024
https://dl.acm.org/doi/10.1145/3648434
Khan YMauriello MNowruzi PMotani AHon GVitale NLi JKim JFoudeh ADuvio DShols EChesnut MLanday JLiphardt JWilliams LSudheimer KMurmann BBao ZParedes P(2024)On Stress: Combining Human Factors and Biosignals to Inform the Placement and Design of a Skin-like Stress SensorProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3643473(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3643473
Zhao YHe HGao WXu KRen J(2024)DM-IACNN: A Dual-Multiscale Interactive Attention-Based Convolution Neural Network for Automated Detection of Sleep ApneaIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.342035573(1-10)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3420355
Show More Cited By

Index Terms

Measuring Photoplethysmogram-Based Stress-Induced Vascular Response Index to Assess Cognitive Load and Stress
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Non-Invasive Measurement of Cognitive Load and Stress Based on the Reflected Stress-Induced Vascular Response Index

Measuring cognitive load and stress is crucial for ubiquitous human--computer interaction applications to dynamically understand and respond to the mental status of users, such as in smart healthcare, smart driving, and robotics. Various quantitative ...
Morphometric study of stress-induced changes in aortic wall microstructure
BIEN '07: Proceedings of the fifth IASTED International Conference: biomedical engineering

This study investigated quantitatively microstructural changes of the aortic wall, when subjected to different pre-selected stress levels. Measured parameters included content, orientation, and waviness of elastic lamellae and collagen fibers. Light ...
New ways of non-invasive measuring of blood circulation parameters

The purpose of the article is to describe possible ways of non-invasive measuring and analysis of blood circulation parameters. These parameters are very important indicators of various cardiovascular diseases in clinical practice. For this purpose, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

4290 pages

ISBN:9781450331456

DOI:10.1145/2702123

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
1,304
Total Downloads

Downloads (Last 12 months)109
Downloads (Last 6 weeks)18

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rony RAhmed MSarcar SAhmed N(2024)Understanding Driving Stress in Urban Bangladesh: An Exploratory Study, Wearable Development and ExperimentACM Journal on Computing and Sustainable Societies10.1145/36484342:2(1-28)Online publication date: 14-Feb-2024
https://dl.acm.org/doi/10.1145/3648434
Khan YMauriello MNowruzi PMotani AHon GVitale NLi JKim JFoudeh ADuvio DShols EChesnut MLanday JLiphardt JWilliams LSudheimer KMurmann BBao ZParedes P(2024)On Stress: Combining Human Factors and Biosignals to Inform the Placement and Design of a Skin-like Stress SensorProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3643473(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3643473
Zhao YHe HGao WXu KRen J(2024)DM-IACNN: A Dual-Multiscale Interactive Attention-Based Convolution Neural Network for Automated Detection of Sleep ApneaIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.342035573(1-10)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3420355
Zhang XGuo FDu JJin X(2023)Photoplethysmogram Based Cognitive Load Recognition Using LstmProceedings of the 2023 15th International Conference on Bioinformatics and Biomedical Technology10.1145/3608164.3608188(167-172)Online publication date: 26-May-2023
https://dl.acm.org/doi/10.1145/3608164.3608188
Kosch TKarolus JZagermann JReiterer HSchmidt AWoźniak P(2023)A Survey on Measuring Cognitive Workload in Human-Computer InteractionACM Computing Surveys10.1145/358227255:13s(1-39)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3582272
Cordoș CMihăilă LFaragó PHintea S(2023)A Matlab Implementation of a Biometric Identification System Based on Photopletysmograms2023 46th International Conference on Telecommunications and Signal Processing (TSP)10.1109/TSP59544.2023.10197750(208-211)Online publication date: 12-Jul-2023
https://doi.org/10.1109/TSP59544.2023.10197750
Pavlov YGashkova AKasanov DKosachenko AKotyusov AKotchoubey B(2023)Task-evoked pulse wave amplitude tracks cognitive loadScientific Reports10.1038/s41598-023-48917-513:1Online publication date: 18-Dec-2023
https://doi.org/10.1038/s41598-023-48917-5
Finnegan EDavidson SHarford MWatkinson PTarassenko LVillarroel M(2023)Features from the photoplethysmogram and the electrocardiogram for estimating changes in blood pressureScientific Reports10.1038/s41598-022-27170-213:1Online publication date: 18-Jan-2023
https://doi.org/10.1038/s41598-022-27170-2
Wang JYang CFu ENgai GLeong H(2023)Is your mouse attracted by your eyes: Non-intrusive stress detection in off-the-shelf desktop environmentsEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.106495123(106495)Online publication date: Aug-2023
https://doi.org/10.1016/j.engappai.2023.106495
Fauquet-Alekhine PGranry J(2023)Physiological Assessment of the State of Mental Stress at WorkThe Palgrave Handbook of Occupational Stress10.1007/978-3-031-27349-0_5(65-95)Online publication date: 24-Aug-2023
https://doi.org/10.1007/978-3-031-27349-0_5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents