research-article

SleepBandits: Guided Flexible Self-Experiments for Sleep

Authors:

Nediyana Daskalova,

Guillermo Beltran, Jr.,

Joseph Jay Williams,

Jeff HuangAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 13

https://doi.org/10.1145/3313831.3376584

Published: 23 April 2020 Publication History

Abstract

Self-experiments allow people to explore what behavioral changes lead to improved health and wellness. However, it is challenging to run such experiments in a scientifically valid way that is also flexible and able to accommodate the realities of daily life. We present a set of design principles for guided self-experiments that aim to lower this barrier to self-experimentation. We demonstrate the value of the principles by implementing them in SleepBandits, an integrated system that includes a smartphone application for sleep experiments. SleepBandits guides users through the steps of a single-case experiment, automatically collecting data from the built-in sensors and user input and calculating and presenting results in real-time. We released SleepBandits to the Google Play Store and people voluntarily downloaded and used it. Based on the data from 365 active users from this in-the-wild study, we discuss opportunities and challenges with the design principles and the SleepBandits system.

References

[1]

Shipra Agrawal and Navin Goyal. 2012. Analysis of Thompson Sampling for the Multi-armed Bandit Problem. In Proceedings of COLT, Vol. 23. 39.1--39.26.

[2]

J.S. Bauer, S. Consolvo, B. Greenstein, J. Schooler, E. Wu, N.F. Watson, and J. Kientz. 2012. ShutEye: Encouraging Awareness of Healthy Sleep Recommendations with a Mobile, Peripheral Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). 1401--1410.

Digital Library

[3]

Michael S Bernstein, Mark S Ackerman, Ed H Chi, and Robert C Miller. 2011. The trouble with social computing systems research. In CHI'11 Extended Abstracts on Human Factors in Computing Systems. ACM, 389--398.

[4]

A. Blaivas. 2014. Polysomnography. (2014). Retrieved August 25, 2018 from http://www.nlm.nih.gov/medlineplus/ency/article/003932.htm.

[5]

Daniel J Buysse. 2014. Sleep health: can we define it? Does it matter? Sleep 37, 1 (2014), 9--17.

[6]

Kelly Caine. 2016. Local standards for sample size at CHI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 981--992.

Digital Library

[7]

Marta E Cecchinato, John Rooksby, Alexis Hiniker, Sean Munson, Kai Lukoff, Luigina Ciolfi, Anja Thieme, and Daniel Harrison. 2019. Designing for Digital Wellbeing: A Research & Practice Agenda. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, W17.

Digital Library

[8]

Olivier Chapelle and Lihong Li. 2011. An empirical evaluation of thompson sampling. In Advances in neural information processing systems. 2249--2257.

[9]

Z. Chen, M. Lin, F. Chen, N.D. Lane, G. Cardone, R. Wang, T. Li, Y. Chen, T. Choudhury, and A.T. Campbell. 2013. Unobtrusive sleep monitoring using smartphones. In Pervasive Computing Technologies for Healthcare (Pervasive Health), 2013 7th International Conference on. IEEE, 145--152.

[10]

Eun Kyoung Choe, Bongshin Lee, Haining Zhu, Nathalie Henry Riche, and Dominikus Baur. 2017. Understanding self-reflection: how people reflect on personal data through visual data exploration. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare. ACM, 173--182.

Digital Library

[11]

Eun Kyoung Choe, Nicole B Lee, Bongshin Lee, Wanda Pratt, and Julie A Kientz. 2014. Understanding quantified-selfers' practices in collecting and exploring personal data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1143--1152.

Digital Library

[12]

Nediyana Daskalova, Karthik Desingh, Alexandra Papoutsaki, Diane Schulze, Han Sha, and Jeff Huang. 2017. Lessons Learned from Two Cohorts of Personal Informatics Self-Experiments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 46.

Digital Library

[13]

Nediyana Daskalova, Nathalie Ford, Ann Hu, Kyle Moorehead, Benjamin Wagnon, and Janet Davis. 2014. Informing Design of Suggestion and Self-Monitoring Tools through Participatory Experience Prototypes. In International Conference on Persuasive Technology. Springer, 68--79.

Digital Library

[14]

Nediyana Daskalova, Danaë Metaxa-Kakavouli, Adrienne Tran, Nicole Nugent, Julie Boergers, John McGeary, and Jeff Huang. 2016. SleepCoacher: A Personalized Automated Self-Experimentation System for Sleep Recommendations. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 347--358.

Digital Library

[15]

Gavin Doherty, David Coyle, and John Sharry. 2012. Engagement with online mental health interventions: an exploratory clinical study of a treatment for depression. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1421--1430.

Digital Library

[16]

Garabed Eknoyan. 1999. Santorio Sanctorius (1561--1636)--founding father of metabolic balance studies. American journal of nephrology 19, 2 (1999), 226--233.

[17]

Bob Evans. 2019. PACO: The Personal Analytics Companion. (2019). https://pacoapp.com/

[18]

National Sleep Foundation. 2014. Healthy Sleep Tips. (2014). Retrieved November 23, 2018 from http://sleepfoundation.org/sleep-tools-tips/healthy-sleep-tips.

[19]

T. Hao, G. Xing, and G. Zhou. 2013. iSleep: Unobtrusive Sleep Quality Monitoring Using Smartphones. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems (SenSys '13). Article 4.

Digital Library

[20]

Miguel A Hernán and Sonia Hernández-Díaz. 2012. Beyond the intention-to-treat in comparative effectiveness research. Clinical Trials 9, 1 (2012), 48--55.

[21]

Mieke Heyvaert and Patrick Onghena. 2014. Randomization tests for single-case experiments: State of the art, state of the science, and state of the application. Journal of Contextual Behavioral Science 3, 1 (2014), 51--64.

[22]

G. Jean-Louis, D.F. Kripke, R.J. Cole, J.D. Assmus, and R.D. Langer. 2001. Sleep detection with an accelerometer actigraph: comparisons with polysomnography. Physiology & Behavior 72, 1 (2001), 21--28.

[23]

Ravi Karkar, Jessica Schroeder, Daniel A Epstein, Laura R Pina, Jeffrey Scofield, James Fogarty, Julie A Kientz, Sean A Munson, Roger Vilardaga, and Jasmine Zia. 2017. TummyTrials: A Feasibility Study of Using Self-Experimentation to Detect Individualized Food Triggers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 6850--6863.

Digital Library

[24]

Ravi Karkar, Jasmine Zia, Roger Vilardaga, Sonali R Mishra, James Fogarty, Sean A Munson, and Julie A Kientz. 2015. A framework for self-experimentation in personalized health. Journal of the American Medical Informatics Association 23, 3 (2015), 440--448.

[25]

Matthew Kay, Eun Kyoung Choe, Jesse Shepherd, Benjamin Greenstein, Nathaniel Watson, Sunny Consolvo, and Julie A Kientz. 2012. Lullaby: a capture & access system for understanding the sleep environment. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, 226--234.

Digital Library

[26]

Geza Kovacs, Zhengxuan Wu, and Michael S Bernstein. 2018. Rotating Online Behavior Change Interventions Increases Effectiveness But Also Increases Attrition. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 95.

Digital Library

[27]

T. R. Kratochwill, J. H. Hitchcock, R. H. Horner, J. R. Levin, S. L. Odom, D. M. Rindskopf, and W. R. Shadish. 2012. Single-case intervention research design standards. Remedial and Special Education (2012), 0741932512452794.

[28]

Jisoo Lee, Erin Walker, Winslow Burleson, Matthew Kay, Matthew Buman, and Eric B Hekler. 2017. Self-experimentation for behavior change: Design and formative evaluation of two approaches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 6837--6849.

Digital Library

[29]

John A List and Steven D Levitt. 2005. What do laboratory experiments tell us about the real world. NBER working paper (2005), 14--20.

[30]

Localytics. 2018. Mobile Apps: What's A Good Retention Rate? (Mar 2018). http://info.localytics.com/blog/mobile-apps-whats-a-good-retention-rate

[31]

J Derek Lomas, Jodi Forlizzi, Nikhil Poonwala, Nirmal Patel, Sharan Shodhan, Kishan Patel, Ken Koedinger, and Emma Brunskill. 2016. Interface design optimization as a multi-armed bandit problem. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4142--4153.

Digital Library

[32]

Jun-Ki Min, Afsaneh Doryab, Jason Wiese, Shahriyar Amini, John Zimmerman, and Jason I Hong. 2014. Toss'n'turn: smartphone as sleep and sleep quality detector. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 477--486.

Digital Library

[33]

Lung National Heart, Blood Institute, National Institutes of Health, and others. 2005. Your Guide to Healthy Sleep (NIH Publication No. 06--5271). (2005).

[34]

Business of Apps. 2018. Mobile app uninstall rate after 30 days. (May 2018). Retrieved August 25, 2018.

[35]

Anthony O'Hagan, Caitlin E Buck, Alireza Daneshkhah, J Richard Eiser, Paul H Garthwaite, David J Jenkinson, Jeremy E Oakley, and Tim Rakow. 2006. Uncertain judgements: eliciting experts' probabilities. John Wiley & Sons.

[36]

Pablo Paredes, Ran Gilad-Bachrach, Mary Czerwinski, Asta Roseway, Kael Rowan, and Javier Hernandez. 2014. PopTherapy: coping with stress through pop-culture. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 109--117.

[37]

C. Pollak, W. Tryon, H. Nagaraja, and R. Dzwonczyk. 2001. How Accurately Does Wrist Actigraphy Identify the States of Sleep and Wakefulness? 24, 8 (2001), 957--965.

[38]

Nathan D Price, Andrew T Magis, John C Earls, Gustavo Glusman, Roie Levy, Christopher Lausted, Daniel T McDonald, Ulrike Kusebauch, Christopher L Moss, Yong Zhou, and others. 2017. A wellness study of 108 individuals using personal, dense, dynamic data clouds. Nature biotechnology 35, 8 (2017), 747.

[39]

Mashfiqui Rabbi, Min Hane Aung, Mi Zhang, and Tanzeem Choudhury. 2015. MyBehavior: automatic personalized health feedback from user behaviors and preferences using smartphones. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 707--718.

Digital Library

[40]

David K Randall. 2012. Insomnia: relax... and stop worrying about lack of sleep. (Sep 2012). https://www.theguardian.com/lifeandstyle/2012/sep/22/dreamland-insomnia-sleep-cbt-drugs

[41]

Katharina Reinecke and Krzysztof Z Gajos. 2015. LabintheWild: Conducting large-scale online experiments with uncompensated samples. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. ACM, 1364--1378.

Digital Library

[42]

Consumer Reports. 2016. Why Americans Can't Sleep. (Jan 2016). https://www.consumerreports.org/sleep/why-americans-cant-sleep/

[43]

Daniel J Russo, Benjamin Van Roy, Abbas Kazerouni, Ian Osband, Zheng Wen, and others. 2018. A tutorial on Thompson sampling. Foundations and Trends® in Machine Learning 11, 1 (2018), 1--96.

[44]

A. Sadeh, P.J. Hauri, D.F. Kripke, and P. Lavie. 1995. The role of actigraphy in the evaluation of sleep disorders. Sleep 18, 4 (1995), 288--302.

[45]

Akane Sano, Sara Taylor, Craig Ferguson, Akshay Mohan, and Rosalind W Picard. 2017. QuantifyMe: An Automated Single-Case Experimental Design Platform. In International Conference on Wireless Mobile Communication and Healthcare. Springer, 199--206.

[46]

Jessica Schroeder, Ravi Karkar, James Fogarty, Julie A Kientz, Sean A Munson, and Matthew Kay. 2019. A Patient-Centered Proposal for Bayesian Analysis of Self-Experiments for Health. Journal of healthcare informatics research 3, 1 (2019), 124--155.

[47]

J. D. Smith. 2012. Single-case experimental designs: A systematic review of published research and current standards. Psychological Methods 17, 4 (2012), 510.

[48]

Mayo Clinical Staff. 2014. Polysomnography (sleep study). (2014). Retrieved August 25, 2018 from http://www.mayoclinic.org/tests-procedures/polysomnography/basics/definition/prc-20013229.

[49]

Richard H Thaler and Cass R Sunstein. 1975. Nudge: Improving Decisions About Health, Wealth, and Happiness. (1975).

[50]

San Diego University of California. 2019. Galileo: Design and Run Experiments with people from around the world. (2019). https://galileo-ucsd.org/galileo/home

[51]

Joseph Jay Williams, Juho Kim, Anna Rafferty, Samuel Maldonado, Krzysztof Z Gajos, Walter S Lasecki, and Neil Heffernan. 2016. Axis: Generating explanations at scale with learner sourcing and machine learning. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale. ACM, 379--388.

Digital Library

[52]

Joseph Jay Williams, Anna N Rafferty, Dustin Tingley, Andrew Ang, Walter S Lasecki, and Juho Kim. 2018. Enhancing Online Problems Through Instructor-Centered Tools for Randomized Experiments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 207.

Digital Library

[53]

Ze Zhang, Michael J Peluso, Cary P Gross, Catherine M Viscoli, and Walter N Kernan. 2014. Adherence reporting in randomized controlled trials. Clinical trials 11, 2 (2014), 195--204.

Cited By

Recmanik MMartinek RNedoma JJaros RPelc MHajovsky RVelicka JPies MSevcakova MKawala-Sterniuk A(2024)A Review of Patient Bed Sensors for Monitoring of Vital SignsSensors10.3390/s2415476724:15(4767)Online publication date: 23-Jul-2024
https://doi.org/10.3390/s24154767
Bhattacharjee AGong ZWang BLuckcock TWatson EAbellan EGutman LHsu AWilliams J(2024)"Actually I Can Count My Blessings": User-Centered Design of an Application to Promote Gratitude Among Young AdultsProceedings of the ACM on Human-Computer Interaction10.1145/36869368:CSCW2(1-29)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686936
Yan DBourgeois JKortuem G(2024)Say You, Say Me: Investigating the Personal insights Generated from One's Own data and Other's dataProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685345(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685345
Show More Cited By

Index Terms

SleepBandits: Guided Flexible Self-Experiments for Sleep
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
  2. Ubiquitous and mobile computing
    1. Empirical studies in ubiquitous and mobile computing

Recommendations

Self-E: Smartphone-Supported Guidance for Customizable Self-Experimentation
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

The ubiquity of self-tracking devices and smartphone apps has empowered people to collect data about themselves and try to self-improve. However, people with little to no personal analytics experience may not be able to analyze data or run experiments ...
Making Sense of Sleep Sensors: How Sleep Sensing Technologies Support and Undermine Sleep Health
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Sleep is an important aspect of our health, but it is difficult for people to track manually because it is an unconscious activity. The ability to sense sleep has aimed to lower the barriers of tracking sleep. Although sleep sensors are widely available,...
Personalized Behavior-Powered Systems for Guiding Self-Experiments
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

The goal of my research is to study how individuals perform self-experiments and to build behavior-powered systems that help them run such experiments. I have developed SleepCoacher, a sleep-tracking system that provides and evaluates the effect of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Brown University Data Science Institute
National Science Foundation
Brown University Seed Award

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
895
Total Downloads

Downloads (Last 12 months)119
Downloads (Last 6 weeks)12

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Recmanik MMartinek RNedoma JJaros RPelc MHajovsky RVelicka JPies MSevcakova MKawala-Sterniuk A(2024)A Review of Patient Bed Sensors for Monitoring of Vital SignsSensors10.3390/s2415476724:15(4767)Online publication date: 23-Jul-2024
https://doi.org/10.3390/s24154767
Bhattacharjee AGong ZWang BLuckcock TWatson EAbellan EGutman LHsu AWilliams J(2024)"Actually I Can Count My Blessings": User-Centered Design of an Application to Promote Gratitude Among Young AdultsProceedings of the ACM on Human-Computer Interaction10.1145/36869368:CSCW2(1-29)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686936
Yan DBourgeois JKortuem G(2024)Say You, Say Me: Investigating the Personal insights Generated from One's Own data and Other's dataProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685345(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685345
Jung GPark SLee U(2024)DeepStress: Supporting Stressful Context Sensemaking in Personal Informatics Systems Using a Quasi-experimental ApproachProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642766(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642766
Yang FMortenson CNisbet EDiakopoulos NKay M(2024)In Dice We Trust: Uncertainty Displays for Maintaining Trust in Election Forecasts Over TimeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642371(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642371
Bhattacharjee AZeng YXu SKulzhabayeva DMa MKornfield RAhmed SMariakakis ACzerwinski MKuzminykh ALiut MWilliams J(2024)Understanding the Role of Large Language Models in Personalizing and Scaffolding Strategies to Combat Academic ProcrastinationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642081(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642081
Xu KYan XRyu MNewman MArriaga R(2024)Understanding the Effect of Reflective Iteration on Individuals’ Physical Activity PlanningProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641937(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641937
Kabir KWiese J(2023)A Meta-Synthesis of the Barriers and Facilitators for Personal Informatics SystemsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108937:3(1-35)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610893
Van Den Heuvel RLallemand C(2023)Personal Informatics at the Office: User-Driven, Situated Sensor Kits in the WorkplaceProceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3596671.3598577(1-13)Online publication date: 13-Jun-2023
https://dl.acm.org/doi/10.1145/3596671.3598577
Bentvelzen MNiess JWoźniak P(2023)Designing Reflective Derived Metrics for Fitness TrackersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694756:4(1-19)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569475
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents