abstract

Look into my Eyes: Using Pupil Dilation to Estimate Mental Workload for Task Complexity Adaptation

Authors:

Daniel Buschek,

Albrecht SchmidtAuthors Info & Claims

CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: LBW617, Pages 1 - 6

https://doi.org/10.1145/3170427.3188643

Published: 20 April 2018 Publication History

Abstract

Cognition-aware systems acquire physiological data to derive implications about physical and mental states. Pupil dilation has recently attracted attention in the HCI community as an indicator for mental workload. The impact of mental workload on pupillary behavior has been extensively examined. However, systems making use of these measurements to alleviate mental workload have been scarcely evaluated. Our work investigates the expediency of task complexity adaption based on pupillary data in real-time. By conducting math tasks with different complexities, we calibrate a complexity adjustment system. In a pilot study (N=6), we evaluate the feasibility of changing task complexity using two different complexities. Our findings show less perceived mental workload during task complexity adaptation compared to presenting high task complexities only. We show the potential of pupil dilation as a valid metric for assessing mental workload as a modality for cognition-aware user interfaces.

References

[1]

Mark H Ashcraft and Elizabeth P Kirk. 2001. The relationships among working memory, math anxiety, and performance. Journal of experimental psychology: General 130, 2 (2001), 224.

[2]

Mark H Ashcraft and Jeremy A Krause. 2007. Working memory, math performance, and math anxiety. Psychonomic bulletin & review 14, 2 (2007), 243--248.

[3]

Simone Benedetto, Marco Pedrotti, Luca Minin, Thierry Baccino, Alessandra Re, and Roberto Montanari. 2011. Driver workload and eye blink duration. Transportation research part F: traffic psychology and behaviour 14, 3 (2011), 199--208.

[4]

Andreas Bulling, Ulf Blanke, and Bernt Schiele. 2014. A tutorial on human activity recognition using bodyworn inertial sensors. CSUR 46, 3 (2014), 33.

Digital Library

[5]

Andreas Bulling and Thorsten O Zander. 2014. Cognition-aware computing. IEEE Pervasive Computing 13, 3 (2014), 80--83.

[6]

Benedikt Gollan, Michael Haslgrübler, and Alois Ferscha. 2016. Demonstrator for Extracting Cognitive Load from Pupil Dilation for Attention Management Services. In UbiComp'16. ACM, New York, NY, USA, 1566--1571.

Digital Library

[7]

Sandra G Hart. 2006. NASA-task load index (NASATLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage Publications, 904--908.

[8]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52 (1988), 139--183.

[9]

Richard P Heitz, Josef C Schrock, Tabitha W Payne, and Randall W Engle. 2008. Effects of incentive on working memory capacity: Behavioral and pupillometric data. Psychophysiology 45, 1 (2008), 119--129.

[10]

Eckhard H Hess and James M Polt. 1964. Pupil size in relation to mental activity during simple problemsolving. Science 143, 3611 (1964), 1190--1192.

[11]

Daniel Kahneman and Jackson Beatty. 1966. Pupil diameter and load on memory. Science 154, 3756 (1966).

[12]

Peter Kiefer, Ioannis Giannopoulos, Andrew Duchowski, and Martin Raubal. 2016. Measuring cognitive load for map tasks through pupil diameter. In International Conference on Geographic Information Science. Springer, 323--337.

[13]

Annie Pauzié. 2008. A method to assess the driver mental workload: The driving activity load index (DALI). IET Intelligent Transport Systems 2, 4 (2008), 315--322.

[14]

Bastian Pfleging, Drea K Fekety, Albrecht Schmidt, and Andrew L Kun. 2016. A Model Relating Pupil Diameter to Mental Workload and Lighting Conditions. In CHI'16. ACM, 5776--5788.

Digital Library

[15]

Jianhua Tao and Tieniu Tan. 2005. Affective computing: A review. In International Conference on Affective Computing and Intelligent Interaction. Springer.

Digital Library

[16]

N Jane Zbrodoff and Gordon D Logan. 2005. What everyone finds: The problem-size effect. (2005).

Cited By

Grootjen JThalhammer PKosch T(2024)Your Eyes on Speed: Using Pupil Dilation to Adaptively Select Speed-Reading Parameters in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765318:MHCI(1-17)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676531
Chiossi FGruenefeld UHou BNewn JOu CLiao RWelsch RMayer S(2024)Understanding the Impact of the Reality-Virtuality Continuum on Visual Search Using Fixation-Related Potentials and Eye Tracking FeaturesProceedings of the ACM on Human-Computer Interaction10.1145/36765288:MHCI(1-33)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676528
Doumanis IEconomou D(2024)Enhanced Retention of Historical Information with Empathetic Pedagogical Conversational Agents (PCAs)Digital Transformation in Higher Education. Empowering Teachers and Students for Tomorrow’s Challenges10.1007/978-3-031-73990-3_6(63-79)Online publication date: 3-Nov-2024
https://doi.org/10.1007/978-3-031-73990-3_6
Show More Cited By

Index Terms

Look into my Eyes: Using Pupil Dilation to Estimate Mental Workload for Task Complexity Adaptation
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Your Eyes Tell: Leveraging Smooth Pursuit for Assessing Cognitive Workload
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

A common objective for context-aware computing systems is to predict how user interfaces impact user performance regarding their cognitive capabilities. Existing approaches such as questionnaires or pupil dilation measurements either only allow for ...
Beyond gaze: preliminary analysis of pupil dilation and blink rates in an fMRI study of program comprehension
EMIP '18: Proceedings of the Workshop on Eye Movements in Programming

Researchers have been employing psycho-physiological measures to better understand program comprehension, for example simultaneous fMRI and eye tracking to validate top-down comprehension models. In this paper, we argue that there is additional value in ...
Eye tracking as an MT evaluation technique

Eye tracking has been used successfully as a technique for measuring cognitive load in reading, psycholinguistics, writing, language acquisition etc. for some time now. Its application as a technique for measuring the reading ease of MT output has not ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

3155 pages

ISBN:9781450356213

DOI:10.1145/3170427

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 April 2018

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

German Federal Ministry of Education and Research

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI EA '18 Paper Acceptance Rate 1,208 of 3,955 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
623
Total Downloads

Downloads (Last 12 months)70
Downloads (Last 6 weeks)6

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Grootjen JThalhammer PKosch T(2024)Your Eyes on Speed: Using Pupil Dilation to Adaptively Select Speed-Reading Parameters in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765318:MHCI(1-17)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676531
Chiossi FGruenefeld UHou BNewn JOu CLiao RWelsch RMayer S(2024)Understanding the Impact of the Reality-Virtuality Continuum on Visual Search Using Fixation-Related Potentials and Eye Tracking FeaturesProceedings of the ACM on Human-Computer Interaction10.1145/36765288:MHCI(1-33)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676528
Doumanis IEconomou D(2024)Enhanced Retention of Historical Information with Empathetic Pedagogical Conversational Agents (PCAs)Digital Transformation in Higher Education. Empowering Teachers and Students for Tomorrow’s Challenges10.1007/978-3-031-73990-3_6(63-79)Online publication date: 3-Nov-2024
https://doi.org/10.1007/978-3-031-73990-3_6
Alt FHassib MDistler V(2023)Human-centered Behavioral and Physiological SecurityProceedings of the 2023 New Security Paradigms Workshop10.1145/3633500.3633504(48-61)Online publication date: 18-Sep-2023
https://dl.acm.org/doi/10.1145/3633500.3633504
Kosch TKarolus JZagermann JReiterer HSchmidt AWoźniak P(2023)A Survey on Measuring Cognitive Workload in Human-Computer InteractionACM Computing Surveys10.1145/358227255:13s(1-39)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3582272
Luo RWeng YJayakumar PBrudnak MPaul VDesaraju VStein JErsal TYang X(2023)Real-Time Workload Estimation Using Eye Tracking: A Bayesian Inference ApproachInternational Journal of Human–Computer Interaction10.1080/10447318.2023.220527440:15(4042-4057)Online publication date: 4-May-2023
https://doi.org/10.1080/10447318.2023.2205274
Aygun ANguyen THaga ZAeron SScheutz M(2022)Investigating Methods for Cognitive Workload Estimation for Assistive RobotsSensors10.3390/s2218683422:18(6834)Online publication date: 9-Sep-2022
https://doi.org/10.3390/s22186834
Chiossi FWelsch RVilla SChuang LMayer S(2022)Virtual Reality Adaptation Using Electrodermal Activity to Support the User ExperienceBig Data and Cognitive Computing10.3390/bdcc60200556:2(55)Online publication date: 13-May-2022
https://doi.org/10.3390/bdcc6020055
Deja JMayer SČopič Pucihar KKljun M(2022)A Survey of Augmented Piano Prototypes: Has Augmentation Improved Learning Experiences?Proceedings of the ACM on Human-Computer Interaction10.1145/35677196:ISS(226-253)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567719
Kosch TMatviienko AMüller FBersch JKatins CSchön DMühlhäuser M(2022)NotiBike: Assessing Target Selection Techniques for Cyclist Notifications in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/35467326:MHCI(1-24)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546732
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents