short-paper

Experiences of studying Attention through EEG in the Context of Review Tasks

Authors:

Jefferson Seide Molléri,

Indira Nurdiani,

Farnaz Fotrousi,

Kai PetersenAuthors Info & Claims

EASE '19: Proceedings of the 23rd International Conference on Evaluation and Assessment in Software Engineering

Pages 313 - 318

https://doi.org/10.1145/3319008.3319357

Published: 15 April 2019 Publication History

Abstract

Context: Electroencephalograms (EEG) have been used in a few cases in the context of software engineering (SE). EEGs allow capturing emotions and cognitive functioning. Such human factors have already shown to be important to understand software engineering tasks. Therefore, it is essential to gain experience in the community to utilize EEG as a research tool. Objective: To report experiences of using EEG in the context of a software engineering education (review of master theses proposals). We provide our reflections and lessons learned of (1) how to plan an EEG study, (2) how to conduct and execute (e.g., tools), (3) how to analyze. Method: We carried out an experiment using an EEG headset to measure the participants' attention rate. The experiment task includes reviewing three master thesis project plans. Results: We describe how we evolved our understanding of experimentation practices to collect and analyze psychological and cognitive data. We also provide a set of lessons learned regarding the application of EEG technology for research. Conclusions: We believe that that EEG could benefit software engineering research to collect cognitive information under certain conditions. The lessons learned reported here should be used as inputs for future experiments in software engineering, where human aspects are of interest.

References

[1]

Per Lenberg, Robert Feldt, and Lars Göran Wallgren. Behavioral software engineering: A definition and systematic literature review. Journal of Systems and software, 107:15--37, 2015.

Digital Library

[2]

Daniel Graziotin, Xiaofeng Wang, and Pekka Abrahamsson. Understanding the affect of developers: theoretical background and guidelines for psychoempirical software engineering. In Proceedings of the 7th International Workshop on Social Software Engineering, pages 25--32. ACM, 2015.

Digital Library

[3]

Timothy A Judge, Daniel Heller, and Michael K Mount. Five-factor model of personality and job satisfaction: A meta-analysis. Journal of applied psychology, 87(3):530, 2002.

[4]

Daniel Graziotin, Xiaofeng Wang, and Pekka Abrahamsson. Do feelings matter? on the correlation of affects and the self-assessed productivity in software engineering. Journal of Software: Evolution and Process, 27(7):467--487, 2015.

Digital Library

[5]

Ning-Han Liu, Cheng-Yu Chiang, and Hsuan-Chin Chu. Recognizing the degree of human attention using eeg signals from mobile sensors. Sensors, 13(8):10273--10286, 2013.

[6]

Thomas Fritz, Andrew Begel, Sebastian C Müller, Serap Yigit-Elliott, and Manuela Züger. Using psycho-physiological measures to assess task difficulty in software development. In Proceedings of the 36th International Conference on Software Engineering, pages 402--413. ACM, 2014.

Digital Library

[7]

Xiyuan Hou, Fitri Trapsilawati, Yisi Liu, Olga Sourina, Chun-Hsien Chen, Wolfgang Mueller-Wittig, and Wei Tech Ang. Eeg-based human factors evaluation of conflict resolution aid and tactile user interface in future air traffic control systems. In Advances in Human Aspects of Transportation, pages 885--897. Springer, 2017.

[8]

Makrina Viola Kosti, Kostas Georgiadis, Dimitrios A Adamos, Nikos Laskaris, Diomidis Spinellis, and Lefteris Angelis. Towards an affordable brain computer interface for the assessment of programmersâĂ&Zacute; mental workload. International Journal of Human-Computer Studies, 115:52--66, 2018.

[9]

Janet Siegmund, Christian Kästner, Sven Apel, Chris Parnin, Anja Bethmann, Thomas Leich, Gunter Saake, and André Brechmann. Understanding understanding source code with functional magnetic resonance imaging. In Proceedings of the 36th International Conference on Software Engineering, pages 378--389. ACM, 2014.

Digital Library

[10]

Oliver Karras, Alexandra Risch, and Kurt Schneider. Interrelating use cases and associated requirements by links: An eye tracking study on the impact of different linking variants on the reading behavior. In Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018, pages 2--12. ACM, 2018.

Digital Library

[11]

Luis Fernández-Sanz and Sanjay Misra. Influence of human factors in software quality and productivity. In International Conference on Computational Science and Its Applications, pages 257--269. Springer, 2011.

Digital Library

[12]

Kazuhiro Esaki, Shigeru Yamada, Muneo Takahashi, and Keisuke Hihara. A quality engineering approach to human factors affecting software reliability in design process. Electronics and Communications in Japan (Part III: Fundamental Electronic Science), 85(3):33--42, 2002.

[13]

Robert Feldt, Richard Torkar, Lefteris Angelis, and Maria Samuelsson. Towards individualized software engineering: empirical studies should collect psychometrics. In Proceedings of the 2008 international workshop on Cooperative and human aspects of software engineering, pages 49--52. ACM, 2008.

Digital Library

[14]

Agata Kołakowska, Agnieszka Landowska, Mariusz Szwoch, Wioleta Szwoch, and Michał R Wróbel. Emotion recognition and its application in software engineering. In Human System Interaction (HSI), 2013 The 6th International Conference on, pages 532--539. IEEE, 2013.

[15]

Iftikhar Ahmed Khan, Willem-Paul Brinkman, and Robert M Hierons. Do moods affect programmers' debug performance? Cognition, Technology & Work, 13(4): 245--258, 2011.

Digital Library

[16]

Kia Nobre. The Oxford handbook of attention. Oxford University Press, 2014.

[17]

Vanessa Hill. Attention wars: Season 1, 2018. URL https://www.youtube.com/playlist?list=PLQwg0PxpUPlqyRdl_93W4oLLfCW4GAGB-.

[18]

Alexandra Fountaine and Bonita Sharif. Emotional awareness in software development: Theory and measurement. In 2017 IEEE/ACM 2nd International Workshop on Emotion Awareness in Software Engineering (SEmotion), pages 28--31. IEEE, 2017.

Digital Library

[19]

Claes Wohlin, Per Runeson, Martin Höst, Magnus C Ohlsson, Björn Regnell, and Anders Wesslén. Experimentation in software engineering. Springer Science & Business Media, 2012.

[20]

Joshua I Ekandem, Timothy A Davis, Ignacio Alvarez, Melva T James, and Juan E Gilbert. Evaluating the ergonomics of bci devices for research and experimentation. Ergonomics, 55(5):592--598, 2012.

[21]

Robert Lievesley, Martin Wozencroft, and David Ewins. The emotiv epoc neuroheadset: an inexpensive method of controlling assistive technologies using facial expressions and thoughts? Journal of Assistive Technologies, 5(2):67--82, 2011.

[22]

NeuroSky Inc. Mindwave user guide. Technical report, 2011.

[23]

R Robbins and M Stonehill. Investigating the neurosky mindwaveâĎć eeg headset. Transport Research Foundation, 1(28), 2014.

[24]

Daniel Graziotin. Towards a theory of affect and software developers' performance. arXiv preprint arXiv:1601.05330, 2016.

[25]

Adam R Clarke, Robert J Barry, Rory McCarthy, and Mark Selikowitz. Eeg analysis of children with attention-deficit/hyperactivity disorder and comorbid reading disabilities. Journal of Learning Disabilities, 35(3):276--285, 2002.

[26]

Troy Janzen, Ken Graap, Stephan Stephanson, Wilma Marshall, and George Fitzsimmons. Differences in baseline eeg measures for add and normally achieving preadolescent males. Biofeedback and self-regulation, 20(1):65--82, 1995.

[27]

Pavlo Antonenko, Fred Paas, Roland Grabner, and Tamara Van Gog. Using electroencephalography to measure cognitive load. Educational Psychology Review, 22(4):425--438, 2010.

[28]

Risto Näätänen. Attention and brain function. Psychology Press, 1992.

[29]

Nilli Lavie, Aleksandra Hirst, Jan W De Fockert, and Essi Viding. Load theory of selective attention and cognitive control. Journal of Experimental Psychology: General, 133(3):339, 2004.

[30]

Alan Gevins, Michael E Smith, Linda McEvoy, and Daphne Yu. High-resolution eeg mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. Cerebral cortex, 7(4):374--385, 1997.

Cited By

Gaspar-Figueiredo DAbrahao SInsfran EVanderdonckt J(2023)Measuring User Experience of Adaptive User Interfaces using EEG: A Replication StudyProceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering10.1145/3593434.3593452(52-61)Online publication date: 14-Jun-2023
https://dl.acm.org/doi/10.1145/3593434.3593452
Hijazi HCouceiro RCastelhano JCruz JCastelo-Branco Mde Carvalho PMadeira H(2022)Intelligent Biofeedback Comprehension Assessment: Theory, Research, and Tools2022 IEEE 21st Mediterranean Electrotechnical Conference (MELECON)10.1109/MELECON53508.2022.9843030(414-419)Online publication date: 14-Jun-2022
https://doi.org/10.1109/MELECON53508.2022.9843030

Index Terms

Experiences of studying Attention through EEG in the Context of Review Tasks
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Student assessment
    2. Management of computing and information systems
      1. Project and people management
        Computer and information systems training

Recommendations

A real-time EEG-based BCI system for attention recognition in ubiquitous environment
UAAII '11: Proceedings of 2011 international workshop on Ubiquitous affective awareness and intelligent interaction

Several types of biological signal, such as Electroencephalogram (EEG), electrooculogram(EOG), electrocardiogram(ECG), electromyogram (EMG), skin temperature variation and electrodermal activity, may be used to measure a human subject's attention level. ...
Personalized attention-based EEG channel selection for epileptic seizure prediction
Abstract
Epilepsy is a neurological disorder, characterized by intractable seizures with severe consequences. To predict these seizures, electroencephalogram (EEG) data has to be collected in a continuous manner. EEG signals are recorded ...
Highlights
- It is possible to use only two or three EEG channels for epileptic seizure prediction.
An Online Neurofeedback Game using Consumer-grade EEG for Improving Attention and Memory Skills
ICIIT '24: Proceedings of the 2024 9th International Conference on Intelligent Information Technology

Electroencephalography (EEG)-based neurofeedback training is an emerging paradigm that has the potential to enhance cognitive performance in healthy and cognitive-deficit patients. State-of-the-art methods focus on improving a single cognitive skill, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

EASE '19: Proceedings of the 23rd International Conference on Evaluation and Assessment in Software Engineering

April 2019

345 pages

ISBN:9781450371452

DOI:10.1145/3319008

Program Chairs:
Shaukat Ali,
Vahid Garousi

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

IT University of Copenhagen

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 April 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

EASE '19

EASE '19: Evaluation and Assessment in Software Engineering

April 15 - 17, 2019

Copenhagen, Denmark

Acceptance Rates

EASE '19 Paper Acceptance Rate 20 of 73 submissions, 27%;

Overall Acceptance Rate 71 of 232 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
195
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)4

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gaspar-Figueiredo DAbrahao SInsfran EVanderdonckt J(2023)Measuring User Experience of Adaptive User Interfaces using EEG: A Replication StudyProceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering10.1145/3593434.3593452(52-61)Online publication date: 14-Jun-2023
https://dl.acm.org/doi/10.1145/3593434.3593452
Hijazi HCouceiro RCastelhano JCruz JCastelo-Branco Mde Carvalho PMadeira H(2022)Intelligent Biofeedback Comprehension Assessment: Theory, Research, and Tools2022 IEEE 21st Mediterranean Electrotechnical Conference (MELECON)10.1109/MELECON53508.2022.9843030(414-419)Online publication date: 14-Jun-2022
https://doi.org/10.1109/MELECON53508.2022.9843030

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten