Abstract
In the usual human cognitive performance, the speed of the human-computer interaction is not critical, but in emergent technologies and in a high stream of information in a learning process, a human (learner) ability to process teaching tasks can be limited by the human abilities or lead to this human’s stress as a physiological “cost” of his/her successful performance. The goal of the paper is to carry out the comparison analysis of the speed and reliability of cognitive activity by subjects performing computer tasks at a free and fixed pace, considering the physiological “cost” of such activities to reveal potential preliminary markers of stress. We have studied 4 group of indices of subjects’ cognitive test performance: 1) operational - test performance including direct indices (rate of tasks solving, reliability) and their secondary indices including general productivity; 2) subjective test indices before and after test performance; 3) physiological support of activity by indices of the cardiovascular system; 4) indices of electropuncture diagnostics. Besides, to account external factors of possible influence on a human cognitive work, we used indices of the solar wind and geomagnetic field. The time limitations make a human more sensitive to external physical factors and influence his psychological state in addition to physiological regulation that can be considered as a stress condition of activity. This result has confirmed our guess that multimodal description is more effective to reveal a stress during cognitive activity of a simple nature.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
The Future of Growth Report 2024: World Economic Forum 2024. https://www3.weforum.org/docs/WEF_Future_of_Growth_Report_2024.pdf. Accessed 28 Jan 2024
Kim, J., Park, C.-Y.: Education, skill training, and lifelong learning in the era of technological revolution. Asian Development Bank, Economics Working Paper Series, no. 606, January 2020
Gratton, L.: An emerging landscape of skills for all. MIT Sloan Manag. Rev. (2021). https://sloanreview.mit.edu/article/an-emerging-landscape-of-skills-for-all/. Accessed 28 Jan 2024
Schools of the Future: Defining New Models of Education for the Fourth Industrial Revolution. Report. World Economic Forum 2020. https://www.weforum.org/reports/schools-of-the-future-defining-new-models-of-education-for-the-fourth-industrial-revolution. Accessed 28 Jan 2024
EU4Digital: Connecting Research and Education Communities (EaPConnect). https://eufordigital.eu/discover-eu/eap-connect/. Accessed 28 Jan2024
Kozák, S., Ružický, E., Štefanovič, J., Schindler, F.: Research and education for industry 4.0: present development. In: Cybernetics & Informatics (K&I), pp. 1–8 (2018)
Burov, O., Bykov, V., Lytvynova, S.: ICT evolution: from single computational tasks to modeling of life. In: Proceedings of the 16th International Conference on ICT in Education, Research and Industrial Applications. Integration, Harmonization and Knowledge Transfer. Volume II: Workshops, Kharkiv, Ukraine, 06–10 October 2020. Volume 2732 of CEUR Workshop Proceedings, pp. 583–590. CEUR-WS.org (2020)
Skarbez, R., Smith, M., Whitton, M.C.: Revisiting Milgram and Kishino’s reality-virtuality continuum. Front. Virtual Real. 2, 647997 (2021). https://doi.org/10.3389/frvir.2021.647997
Stratton, J.: The future of work starts with trust: How can we close the AI trust gap? World Economic Forum, 15 January 2024. https://www.weforum.org/agenda/2024/01/why-there-is-an-ai-trust-gap-in-the-workplace/. Accessed 28 Jan 2024
Zhao, J., Riecke, B.E., Kelly, J.W., Stefanucci, J., Klippel, A.: Editorial: human spatial perception, cognition, and behaviour in extended reality. Front. Virtual Real. 4, 1257230 (2023). https://doi.org/10.3389/frvir.2023.1257230
Lopes, P., Voigt-Antons, J.-N., Garcia, J., Melhart, D.: Editorial: user states in extended reality media experiences for entertainment games. Front. Virtual Real. 4, 1235004 (2023). https://doi.org/10.3389/frvir.2023.1235004
Kress, G., Selander, S.: Multimodal design, learning and cultures of recognition. Internet High. Educ. 15(1), 265–268 (2012)
Philippe, S., et al.: Multimodal teaching, learning and training in virtual reality: a review and case study. Virtual Real. Intell. Hardw. 2(5), 421–442 (2020). https://doi.org/10.1016/j.vrih.2020.07.008
VARK Modalities: What do Visual, Aural, Read/write & Kinesthetic really mean? Horizon Europe Guide. https://vark-learn.com/introduction-to-vark/the-vark-modalities/#google_vignette. Accessed 29 Jan 2024 (2024)
Kessler, M.: Multimodality. ELT J. 76(4), 551–554 (2022). https://doi.org/10.1093/elt/ccac028
Glazunova, O., et al.: Learning style identification system: design and data analysis. In: Proceedings of the 16th International Conference on ICT in Education, Research and Industrial Applications. Integration, Harmonization and Knowledge Transfer. Volume II: Workshops, Kharkiv, Ukraine, 06–10 October 2020, pp. 793–807 (2020). https://ceur-ws.org/Vol-2732/
Vuorre, M., Orben, A., Przybylski, Andrew, K.: There is no evidence that associations between adolescents’ digital technology engagement and mental health problems have increased. Clin. Psychol. Sci. (2021). https://doi.org/10.1177/2167702621994549
Pinchuk, O., et al.: VR in education: ergonomic features and cybersickness. In: Nazir, S., Ahram, T., Karwowski, W. (eds.) AHFE 2020. AISC, vol. 1211, pp. 350–355. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50896-8_50
Burov, O., et al.: Cognitive performance degradation in high school students as the response to the psychophysiological changes. In: Ayaz, H., Asgher, U. (eds.) AHFE 2020. AISC, vol. 1201, pp. 83–88. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-51041-1_12
Burov, O., et al.: On the way to hybrid intelligence: influence of the human-system interaction rate on the human cognitive performance. In: Ahram, T., Taiar, R. (eds.) Human Interaction and Emerging Technologies (IHIET-AI 2023): Artificial Intelligence and Future Applications. AHFE (2023) International Conference. AHFE Open Access, vol. 70. AHFE International, USA (2023). https://doi.org/10.54941/ahfe1002925
Mygal, G.V., Protasenko, O.F.: Functional state of the human-operator as a source of monitoring information. «ХАИ», Kharkiv, no. 40, pp. 187–193 (2008). https://dspace.library.khai.edu/xmlui/bitstream/handle/123456789/4491/Migal5.pdf?sequence=1
SEC’s Anonymous FTP Server (Solar-Geophysical Data). http://sec.noaa.gov/ftpmenu/lists/ace2.html
Burov, O.Yu., Pinchuk, O.P., Pertsev, M.A., Vasylchenko, Y.V.: Use of learners’ state indices for design of adaptive learning systems. In: Information Technologies and Learning Tools, vol. 68, no. 6, pp. 20–32 (2018)
Ahn, A.C., et al.: Electrical properties of acupuncture points and meridians: a systematic review. Bioelectromagnetics 29(4), 245–56 (2008)
Spirin, O., Burov, O.: Models and applied tools for prediction of student ability to effective learning. In: 14th International Conference on ICT in Education, Research and Industrial Applications. Integration, Harmonization and Knowledge Transfer, vol. 2104, pp. 404–411. CEUR-WS (2018)
Lavrov, E., Pasko, N., Siryk, O.: Information technology for assessing the operators working environment as an element of the ensuring automated systems ergonomics and reliability. In: IEEE 15th International Conference on Advanced Trends in Radioelectronics, Telecommunications and Computer Engineering (TCSET), Lviv-Slavske, Ukraine, pp. 570–575 (2020). https://doi.org/10.1109/TCSET49122.2020.235497
Acknowledgments
This research has been supported by the Institute of Information Technologies of the National Academy of Pedagogic Science, as well as the National Aerospace University “KhAI”, Kharkiv.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Burov, O. et al. (2024). Multimodal Recognition of the Stress When Performing Cognitive Tasks Under Limited Time Conditions. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. HCII 2024. Lecture Notes in Computer Science(), vol 14692. Springer, Cham. https://doi.org/10.1007/978-3-031-60728-8_2
Download citation
DOI: https://doi.org/10.1007/978-3-031-60728-8_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60727-1
Online ISBN: 978-3-031-60728-8
eBook Packages: Computer ScienceComputer Science (R0)