extended-abstract

The Future of Cognitive Personal Informatics

Authors:

Christina Schneegass,

Horia A. Maior,

Francesco Chiossi,

Jason WieseAuthors Info & Claims

MobileHCI '23 Companion: Proceedings of the 25th International Conference on Mobile Human-Computer Interaction

Article No.: 35, Pages 1 - 5

https://doi.org/10.1145/3565066.3609790

Published: 26 September 2023 Publication History

Abstract

While Human-Computer Interaction (HCI) has contributed to demonstrating that physiological measures can be used to detect cognitive changes, engineering and machine learning will bring these to application in consumer wearable technology. For HCI, many open questions remain, such as: What happens when this becomes a cognitive form of personal informatics? What goals do we have for our daily cognitive activity? How should such a complex concept be conveyed to users to be useful in their everyday life? How can we mitigate potential ethical concerns? These issues are different from physiologically controlled interactions, such as BCIs, to a time when we have new data about ourselves. This workshop will be the first to directly address the future of Cognitive Personal Informatics (CPI), by bringing together design, BCI and physiological data, ethics, and personal informatics researchers to discuss and set the research agenda in this inevitable future before it arrives.

References

[1]

Apple. 2023. Apple Watch Breathing Exercises. https://support.apple.com/en-gb/guide/watch/apd371dfe3d7/watchos

[2]

Johann Benerradi, Horia A. Maior, Adrian Marinescu, Jeremie Clos, and Max L. Wilson. 2019. Exploring machine learning approaches for classifying mental workload using fNIRS data from HCI tasks. In Proceedings of the Halfway to the Future Symposium 2019. 1–11. https://doi.org/10.1145/3363384.3363392

Digital Library

[3]

Francesco Chiossi, Luke Haliburton, Ou Changkun, Butz Andreas, and Schmidt Albrecht. 2023. Short-Form Videos Degrade Our Capacity to Retain Intentions: Effect of Context Switching On Prospective Memory. In ACM Conference on Human-Computer Interaction(CHI ’23). Association for Computing Machinery, Hamburg, Germany. https://doi.org/10.1145/3544548.3580778

Digital Library

[4]

Francesco Chiossi, Changkun Ou, and Sven Mayer. 2023. Exploring Physiological Correlates of Visual Complexity Adaptation: Insights from EDA, ECG, and EEG Data for Adaptation Evaluation in VR Adaptive Systems. In ACM Conference on Human-Computer Interaction(CHI ’23 Extended Abstracts). Association for Computing Machinery, Hamburg, Germany. https://doi.org/10.1145/3544549.3585624

Digital Library

[5]

Francesco Chiossi, Yagiz Turgut, Robin Welsch, and Sven Mayer. 2023. Adapting Visual Complexity Based on Electrodermal Activity Improves Working Memory Performance in Virtual Reality. Proc. ACM Hum.-Comput. Interact. 7, MHCI, Article 296, 26 pages. https://doi.org/10.1145/3604243

Digital Library

[6]

Francesco Chiossi, Robin Welsch, Steeven Villa, Lewis Chuang, and Sven Mayer. 2022. Virtual Reality Adaptation Using Electrodermal Activity to Support the User Experience. Big Data and Cognitive Computing 6, 2 (2022), 55. https://doi.org/10.3390/bdcc6020055

[7]

Daniel A Epstein, An Ping, James Fogarty, and Sean A Munson. 2015. A lived informatics model of personal informatics. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 731–742. https://doi.org/doi = 10.1145/2750858.2804250

Digital Library

[8]

Stephen H Fairclough and Chelsea Dobbins. 2020. Personal informatics and negative emotions during commuter driving: Effects of data visualization on cardiovascular reactivity & mood. International Journal of Human-Computer Studies 144 (2020), 102499. https://doi.org/10.1016/j.ijhcs.2020.102499

[9]

Feel. 2023. Feel Wristband. https://www.myfeel.co/individuals

[10]

Lex Fridman, Bryan Reimer, Bruce Mehler, and William T Freeman. 2018. Cognitive load estimation in the wild. In Proceedings of the 2018 chi conference on human factors in computing systems. 1–9. https://doi.org/10.1145/3173574.3174226

Digital Library

[11]

Christiane Glatz, Stas S Krupenia, Heinrich H Bülthoff, and Lewis L Chuang. 2018. Use the right sound for the right job: verbal commands and auditory icons for a task-management system favor different information processes in the brain. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3173574.3174046

Digital Library

[12]

Muse Headband. 2023. Muse Headband. https://choosemuse.com/

[13]

Toshiki Iso and Kenichi Yamazaki. 2006. Gait analyzer based on a cell phone with a single three-axis accelerometer. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services. 141–144. https://doi.org/10.1145/1152215.1152244

Digital Library

[14]

Thomas Kosch, Robin Welsch, Lewis Chuang, and Albrecht Schmidt. 2022. The Placebo Effect of Artificial Intelligence in Human-Computer Interaction. ACM Transactions on Computer-Human Interaction (2022). https://doi.org/10.1145/3529225

Digital Library

[15]

Serena Midha, Max L Wilson, and Sarah Sharples. 2022. Lived Experiences of Mental Workload in Everyday Life. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 282, 16 pages. https://doi.org/10.1145/3491102.3517690

Digital Library

[16]

Neurosity. 2023. Neurosity Headset. https://neurosity.co/

[17]

Oura. 2023. Oura Ring - readiness score. https://ouraring.com/blog/readiness-score/

[18]

Christina Schneegass, Thomas Kosch, Andrea Baumann, Marius Rusu, Mariam Hassib, and Heinrich Hussmann. 2020. BrainCoDe: Electroencephalography-based comprehension detection during reading and listening. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3313831.3376707

Digital Library

[19]

Spire Stone. 2023. Spire Stone - discontinued in 2019. https://www.outdoorgearlab.com/reviews/fitness/pedometer/spire-stone

[20]

Max L Wilson, Serena Midha, Horia A. Maior, Anna L Cox, Lewis L Chuang, and Lachlan D Urquhart. 2022. SIG: Moving from Brain-Computer Interfaces to Personal Cognitive Informatics. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 163, 4 pages. https://doi.org/10.1145/3491101.3516402

Digital Library

[21]

Max L Wilson, Natalia Sharon, Horia A Maior, Serena Midha, Michael P Craven, and Sarah Sharples. 2018. Mental workload as personal data: designing a cognitive activity tracker. In Proceedings of the 3rd Symposium on Computing and Mental Health.

Cited By

ElAgroudy PGruenerbl ABarbareschi GSpilski JKunze KLachmann TLukowicz P(2024)mobiCHAI - 1st International Workshop on Mobile Cognition-Altering Technologies (CAT) using Human-Centered AIAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680462(1-5)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680462
Stefanidi EWassmann JWoźniak PSpellmeyer GRogers YNiess J(2024)MoodGems: Designing for the Well-being of Children with ADHD and their Families at HomeProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655795(480-494)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655795
Ji KHettiachchi DSalim FScholer FSpina DHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Characterizing Information Seeking Processes with Multiple Physiological SignalsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657793(1006-1017)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657793
Show More Cited By

Index Terms

The Future of Cognitive Personal Informatics
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
  2. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing theory, concepts and paradigms

Recommendations

The CHI’24 Workshop on the Future of Cognitive Personal Informatics
CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

While Human-Computer Interaction (HCI) has contributed to demonstrating that physiological measures can be used to detect cognitive changes, engineering and machine learning will bring these to application in consumer wearable technology. For HCI, many ...
A lived informatics model of personal informatics
UbiComp '15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Current models of how people use personal informatics systems are largely based in behavior change goals. They do not adequately characterize the integration of self-tracking into everyday life by people with varying goals. We build upon prior work by ...
SIG: Moving from Brain-Computer Interfaces to Personal Cognitive Informatics
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

Consumer neurotechnology is arriving en masse, even while algorithms for user state estimation are being actively defined and developed. Indeed, many consumable wearables are now available that try to estimate cognitive changes from wrist data or body ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '23 Companion: Proceedings of the 25th International Conference on Mobile Human-Computer Interaction

September 2023

256 pages

ISBN:9781450399241

DOI:10.1145/3565066

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2023

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Funding Sources

UKRI EPSRC Trusted Data-Driven Products
Deutsche Forschungsgemeinschaft

Conference

MobileHCI '23

Sponsor:

SIGCHI

MobileHCI '23: 25th International Conference on Mobile Human-Computer Interaction

September 26 - 29, 2023

Athens, Greece

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
202
Total Downloads

Downloads (Last 12 months)150
Downloads (Last 6 weeks)13

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

ElAgroudy PGruenerbl ABarbareschi GSpilski JKunze KLachmann TLukowicz P(2024)mobiCHAI - 1st International Workshop on Mobile Cognition-Altering Technologies (CAT) using Human-Centered AIAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680462(1-5)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680462
Stefanidi EWassmann JWoźniak PSpellmeyer GRogers YNiess J(2024)MoodGems: Designing for the Well-being of Children with ADHD and their Families at HomeProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655795(480-494)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655795
Ji KHettiachchi DSalim FScholer FSpina DHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Characterizing Information Seeking Processes with Multiple Physiological SignalsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657793(1006-1017)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657793
Wilson MShaban JMaior HSchneegass CCox A(2024)The CHI’24 Workshop on the Future of Cognitive Personal InformaticsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636296(1-6)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636296
Chiossi FStepanova ETag BPerusquia-Hernandez MKitson ADey AMayer SEl Ali A(2024)PhysioCHI: Towards Best Practices for Integrating Physiological Signals in HCIExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636286(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3636286
Silva LCibrian FBonang CBhattacharya AMin AMonteiro EBeltran JSchuck SLakes KHayes GEpstein D(2024)Co-Designing Situated Displays for Family Co-Regulation with ADHD ChildrenProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642745(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642745

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents