Nothing Special   »   [go: up one dir, main page]
Skip to main content
SpringerLink
Log in

Enhancing Our Understanding of Business Process Model Comprehension Using Biometric Data

  • Conference paper
  • First Online:
Enterprise, Business-Process and Information Systems Modeling (BPMDS 2024, EMMSAD 2024)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 511))

Abstract

Much research has been done on the comprehension and development of conceptual models. In related areas such as linguistics and software engineering one has taken techniques from neuroscience into use, to study the biological and neurological processes when working with textual knowledge representations in tasks such as program code debugging. The use of such techniques has only to a limited degree been used to improve our understanding of visual conceptual models so far.

We will in this paper present ongoing research on the use of techniques collecting biometric data to investigate how we work with visual conceptual models. The approach, which are based on techniques used in multi-modal learning analytics (MMLA), investigates how performance on modeling tasks is correlated with biometric data, collecting data in parallel from EEG, eye-tracking, wristbands, and facial expression (through cameras). We find that good understanding of performance of modeling tasks can be achieved by using biometric data in a natural usage situation. We have just scratched the surface of this topic, and we present the start of a larger research program in this area in the concluding remarks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    A saccade is a quick, simultaneous movement of both eyes between two or more phases of fixation.

References

  1. Abbad-Andaloussi, A., Burattin, A., Slaats, T., Kindler, E., Weber, B.: Complexity in declarative process models: metrics and multi-modal assessment of cognitive load. Expert Syst. Appl. 233 (2023)

    Google Scholar 

  2. Andrade, A., Danish, J.A., Maltese, A.V.: A measurement model of gestures in an embodied learning environment: accounting for temporal dependencies. J. Learn. Anal. 4(3), 18–46 (2017)

    Google Scholar 

  3. Antonenko, P., Paas, F., Grabner, R., Van Gog, T.: Using electroencephalography to measure cognitive load. Educ. Psychol. Rev. 22(4), 425–438 (2010)

    Article  Google Scholar 

  4. Antoun, M., Edwards, K.M., Sweeting, J., Ding, D.: The acute physiological stress response to driving: a systematic review. PLoS ONE 12(10), e0185517 (2017)

    Article  Google Scholar 

  5. Baker, R., D’Mello, S.K., Rodrigo, M.M.T., Graesser, A.C.: Better to be frustrated than bored: the incidence, persistence, and impact of learners’ cognitive–affective states during interactions with three different computer-based learning environments. Int. J. Hum. Comput. Stud. 68(4), 223–241 (2010)

    Article  Google Scholar 

  6. Batista Duarte, R., Silva da Silveira, D., de Albuquerque Brito, V., Lopes, C.S.: A systematic literature review on the usage of eye-tracking in understanding process models. Bus. Process Manag. J. 27(1), 346 (2021)

    Google Scholar 

  7. Blikstein, P., Worsley, M.: Multimodal learning analytics and education data mining: using computational technologies to measure complex learning tasks. J. Learn. Anal. 3(2), 220–238 (2016)

    Article  Google Scholar 

  8. Bravi, A., et al.: Do physiological and pathological stresses produce different changes in heart rate variability? Front. Physiol. 4, 197 (2013)

    Article  Google Scholar 

  9. Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1, 18–37 (2010)

    Article  Google Scholar 

  10. Craig, A., Tran, Y., Wijesuriya, N., Nguyen, H.: Regional brain wave activity changes associated with fatigue. Psychophysiology 49(4), 574–582 (2012)

    Article  Google Scholar 

  11. D’Mello, S., Graesser, A.: Dynamics of affective states during complex learning. Learn. Instr. 22, 145–157 (2012)

    Article  Google Scholar 

  12. Di Lascio, E., Gashi, S., Santini, S.: Unobtrusive assessment of students’ emotional engagement during lectures using electrodermal activity sensors. Proc. ACM Interact. Mob. Wearable Ubiquit. Technol. 2(3), 1–21 (2018)

    Article  Google Scholar 

  13. Di Mitri, D., Scheffel, M., Drachsler, H., Börner, D., Ternier, S., Specht, M.: Learning pulse: a machine learning approach for predicting performance in self-regulated learning using multimodal data. In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference, pp. 188–197. ACM (2017)

    Google Scholar 

  14. Di Stasi, L.L., Catena, A., Cañas, J.J., Macknik, S.L., Martinez-Conde, S.: Saccadic velocity as an arousal index in naturalistic tasks. Neurosci. Biobehav. Rev. 37(5), 968–975 (2013)

    Article  Google Scholar 

  15. Dietrich, A., Kanso, R.: A review of EEG, ERP, and neuroimaging studies of creativity and insight. Psychol. Bull. 136(5), 822 (2010)

    Article  Google Scholar 

  16. Dowhower, S.L.: Effects of repeated reading on second-grade transitional readers’ fluency and comprehension. Reading Res. Q. 389–406 (1987)

    Google Scholar 

  17. Duchowski, A.T., et al.: The index of pupillary activity: measuring cognitive load vis-à-vis task difficulty with pupil oscillation. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2018)

    Google Scholar 

  18. Giannakos, M.N., Sharma, K., Papavlasopoulou, S., Pappas, I.O., Kostakos, V.: Fitbit for learning: towards capturing the learning experience using wearable sensing. Int. J. Hum. Comput. Stud. 136, 102384 (2020)

    Article  Google Scholar 

  19. Greene, B.A.: Measuring cognitive engagement with self-report scales: reflections from over 20 years of research. Educ. Psychol. 50(1), 14–30 (2015)

    Article  Google Scholar 

  20. Hasson, U., et al.: Enhanced intersubject correlations during movie viewing correlate with successful episodic encoding. Neuron 57(3), 452–462 (2008). https://doi.org/10.1016/j.neuron.2007.12.009

    Article  Google Scholar 

  21. Jensen, O., Tesche, C.D.: Frontal theta activity in humans increases with memory load in a working memory task. Eur. J. Neurosci. 15, 1395–1399 (2002)

    Article  Google Scholar 

  22. Jermann, P., Nüssli, M.A.: Effects of sharing text selections on gaze cross-recurrence and interaction quality in a pair programming task. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, pp. 1125–1134 (2012)

    Google Scholar 

  23. Krogstie, J.: Quality in Business Process Modeling. Springer, Cham (2016)

    Book  Google Scholar 

  24. Krogstie, J., Heggset, M., Wesenberg, H.: Business process modeling of a quality system in a petroleum industry company. In: vom Brocke, J., Mendling, J. (eds.) Business Process Management Cases, pp. 557–575. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-58307-5_30

    Chapter  Google Scholar 

  25. Leiner, D., et al.: EDA positive change: a simple algorithm for electrodermal activity to measure general audience arousal during media exposure. Commun. Methods Measur. 6(4), 237–250 (2012). https://doi.org/10.1080/19312458.2012.732627

  26. Leopold, H., Mendling, J., Polyvyanyy, A.: Supporting process model validation through natural language generation. IEEE Trans. Software Eng. 40(8), 818–840 (2014)

    Article  Google Scholar 

  27. Malinova, M., Mendling, J.: Cognitive diagram understanding and task performance in system analysis and design. Manag. Inf. Syst. Q. 46 (2022)

    Google Scholar 

  28. Mangaroska, K., Sharma, K., Gašević, D., Giannakos, M.: Exploring students’ cognitive and affective states during problem solving through multimodal data: lessons learned from a programming activity J. Comput. Assisted Learn. (2022)

    Google Scholar 

  29. Martinez-Maldonado, R., et al.: Lessons learnt from a multimodal learning analytics deployment in-the-wild. ACM Trans. Comput.-Hum. Interact. 31, 1 (2023)

    Article  Google Scholar 

  30. McDaniel, B., et al.: Facial features for affective state detection in learning environments. In: Proceedings of the Annual Meeting of the Cognitive Science Society, vol. 29, no. 29 (2007)

    Google Scholar 

  31. Mendling, J., Malinova, M.: Experimental evidence on the cognitive effectiveness of diagrams. Procedia Comput. Sci. 197, 10–15 (2022)

    Article  Google Scholar 

  32. Millis, K.K., King, A.: Rereading strategically: the influences of comprehension ability and a prior reading on the memory for expository text. Read. Psychol. 22(1), 41–65 (2001)

    Article  Google Scholar 

  33. Mirjafari, S., et al.: Differentiating higher and lower job performers in the workplace using mobile sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3(2), 1–24 (2019)

    Article  Google Scholar 

  34. Missonnier, P., et al.: Frontal theta event-related synchronization: comparison of directed attention and working memory load effects. J. Neural Transm. 113, 1477–1486 (2006)

    Article  Google Scholar 

  35. Nordbotten, J.C., Crosby, M.E.: The effect of graphic style on data model interpretation. Inf. Syst. J. 9, 139–155 (1999)

    Article  Google Scholar 

  36. Ochoa, X., Domínguez, F., Guamán, B., Maya, R., Falcones, G., Castells, J.: The rap system: automatic feedback of oral presentation skills using multimodal analysis and low-cost sensors. In: Proceedings of the 8th International Conference on Learning Analytics and Knowledge, pp. 360–364. ACM (2018)

    Google Scholar 

  37. Olsen, A.: The Tobii I-VT Fixation Filter. Algorithm description. Tobii Technology (2012)

    Google Scholar 

  38. Paas, F., Van Merriënboer, J.J.: Instructional control of cognitive load in the training of complex cognitive tasks. Edu. Psych. Rev. 6, 351–371 (1994)

    Article  Google Scholar 

  39. Pappas, I., Sharma, K., Mikalef, P., Giannakos, M.: Visual aesthetics of E-commerce websites: an eye-tracking approach (2018)

    Google Scholar 

  40. Paris, S.G., Jacobs, J.E.: The benefits of informed instruction for children’s reading awareness and comprehension skills. Child Dev. 2083–2093 (1984)

    Google Scholar 

  41. Pekrun, R.: The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice. Educ. Psychol. Rev. 18(4), 315–341 (2006)

    Article  Google Scholar 

  42. Poole, A., Ball, L.J.: Eye tracking in HCI and usability research. In: Encyclopedia of Human Computer Interaction, pp. 211–219. IGI Global (2006)

    Google Scholar 

  43. Pope, A.T., Bogart, E.H., Bartolome, D.S.: Biocybernetic system evaluates indices of operator engagement in automated task. Biol. Psychol. 40(1–2), 187–195 (1995)

    Article  Google Scholar 

  44. Ray, W.J., Cole, H.W.: EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. Science 228(4700), 750–752 (1985)

    Article  Google Scholar 

  45. Razoumnikova, O.M.: Functional organization of different brain areas during convergent and divergent thinking: an EEG investigation. Cogn. Brain Res. 10(1–2), 11–18 (2000)

    Article  Google Scholar 

  46. Ritchi, H., Jans, M., Mendling, J., Reijers, H.A.: The influence of business process representation on performance of different task types. J. Inf. Syst. 34(1), 167–194 (2020)

    Google Scholar 

  47. Rosenthal, K., Strecker, S., Snoeck, M.: Modeling difficulties in creating conceptual data models. SOSYM 22, 1005–1030 (2023)

    Google Scholar 

  48. Rus, V., D’Mello, S., Hu, X., Graesser, A.: Recent advances in conversational intelligent tutoring systems. AI Mag. 34(3), 42–54 (2013)

    Google Scholar 

  49. Schmid, P.C., Mast, M.S., Bombari, D., Mast, F.W., Lobmaier, J.S.: How mood states affect information processing during facial emotion recognition: an eye tracking study. Swiss J. Psychol. (2011)

    Google Scholar 

  50. Schrepfer, M., Wolf, J., Mendling, J., Reijers, H.A.: The impact of secondary notation on process model understanding. In: Persson, A., Stirna, J. (eds.) PoEM 2009. LNBIP, vol. 39, pp. 161–175. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-05352-8_13

    Chapter  Google Scholar 

  51. Seipajarvi, S.M., et al.: Measuring psychosocial stress with heart rate variability-based methods in different health and age groups. Physiol. Measur. 43(5), 055002 (2022)

    Google Scholar 

  52. Sharma, K., Leftheriotis, I., Giannakos, M.: Utilizing interactive surfaces to enhance learning, collaboration and engagement: insights from learners’ gaze and speech. Sensors 20(7), 1964 (2020)

    Article  Google Scholar 

  53. Sharma, K., Papavlasopoulou, S., Giannakos, M.: Joint emotional state of children and perceived collaborative experience in coding activities. In: Proceedings of the 18th ACM International Conference on Interaction Design and Children, pp. 133–145. ACM (2019)

    Google Scholar 

  54. Sharma, K., Caballero, D., Verma, H., Jermann, P., Dillenbourg, P.: Looking AT versus looking THROUGH: a dual eye-tracking study in MOOC context. International Society of the Learning Sciences. Inc. [ISLS] (2015)

    Google Scholar 

  55. Sharma, K., Papamitsiou, Z., Giannakos, M.: Building pipelines for educational data using AI and multimodal analytics: a “grey-box” approach. Br. J. Edu. Technol. 50(6), 3004–3031 (2019)

    Article  Google Scholar 

  56. Sharma, K., Lee-Cultura, S., Giannakos, M.: Keep calm and do not carry-forward: toward sensor-data driven AI agent to enhance human learning. Front. Artif. Intell. 4, 713176 (2022)

    Article  Google Scholar 

  57. Shemyakina, N., Dan’ko, S.: Changes in the power and coherence of the beta EEG band in subjects performing creative tasks using emotionally significant and emotionally neutral words. Hum. Physiol. 33, 20–26 (2007)

    Google Scholar 

  58. Stern, J.A., Brown, T.B.: Bio-behavior analysis systems LLC St Louis MO. Detection of Human Fatigue (2005)

    Google Scholar 

  59. Thiruchselvam, R., Blechert, J., Sheppes, G., Rydstrom, A., Gross, J.J.: The temporal dynamics of emotion regulation: an EEG study of distraction and reappraisal. Biol. Psychol. 87(1), 84–92 (2011)

    Article  Google Scholar 

  60. TLX. https://humansystems.arc.nasa.gov/groups/TLX/. Accessed 16 Mar 2023

  61. van Loon, A.W., et al.: The effects of school-based interventions on physiological stress in adolescents: a meta-analysis. Stress. Health 38(2), 187–209 (2022)

    Article  Google Scholar 

  62. Weber, B., et al.: Fixation patterns during process model creation: initial steps toward neuro-adaptive process modeling environments. In: 49th Hawaii International Conference on System Sciences (HICSS), Koloa, HI, USA (2016)

    Google Scholar 

  63. Weber, B., Fischer, T., Riedl, R.: Brain and autonomic nervous system activity measurement in software engineering: a systematic literature review. J. Syst. Softw. 178 (2021)

    Google Scholar 

  64. Winter, M., Neumann, H., Pryss, R., Probst, T., Reichert, M.: Defining gaze patterns for process model literacy – exploring visual routines in process models with diverse mappings. Expert Syst. Appl. 213 (2023)

    Google Scholar 

  65. Winter, M., Bredemeyer, C., Reichert, M., Neumann, H., Pryss, R.: A Comparative Cross-Sectional Study on Process Model Comprehension driven by Eye Tracking and Electrodermal Activity Research Square (2023). https://doi.org/10.21203/rs.3.rs-3705553/v1

  66. Xiong, J., Zuo, M.: What does existing NeuroIS research focus on? Inf. Syst. 89 (2020)

    Google Scholar 

  67. Zimoch, M., Mohring, T., Pryss, R., Probst, T., Schlee, W., Reichert, M.: Using insights from cognitive neuroscience to investigate the effects of event-driven process chains on process model comprehension. In: Teniente, E., Weidlich, M. (eds.) BPM 2017. LNBIP, vol. 308, pp. 446–459. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-74030-0_35

    Chapter  Google Scholar 

Download references

Acknowledgements

We would like to thank all the participants in the experiment. Special thanks to Lea Marie Braun and Alevtina Roshchina for assisting in running the experiment.

Author information

Authors and Affiliations

  1. Norwegian University of Science and Technology (NTNU), Trondheim, Norway

    John Krogstie & Kshitij Sharma

Authors
  1. John Krogstie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kshitij Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to John Krogstie .

Editor information

Editors and Affiliations

  1. University of Vienna, Vienna, Austria

    Han van der Aa

  2. TU Wien, Vienna, Austria

    Dominik Bork

  3. Munich University of Applied Sciences, Munich, Germany

    Rainer Schmidt

  4. Ben-Gurion University of the Negev, Beer-Sheva, Israel

    Arnon Sturm

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Krogstie, J., Sharma, K. (2024). Enhancing Our Understanding of Business Process Model Comprehension Using Biometric Data. In: van der Aa, H., Bork, D., Schmidt, R., Sturm, A. (eds) Enterprise, Business-Process and Information Systems Modeling. BPMDS EMMSAD 2024 2024. Lecture Notes in Business Information Processing, vol 511. Springer, Cham. https://doi.org/10.1007/978-3-031-61007-3_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-61007-3_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-61006-6

  • Online ISBN: 978-3-031-61007-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation