research-article

Analyzing and Predicting Task Reminders

Authors:

Paul N. Bennett,

Eric HorvitzAuthors Info & Claims

UMAP '16: Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization

Pages 7 - 15

https://doi.org/10.1145/2930238.2930239

Published: 13 July 2016 Publication History

Abstract

Automated personal assistants such as Siri, Cortana, and Google Now provide services to help users accomplish tasks, including tools to set reminders. We study how people specify and use reminders. Our study analyzes a sample of six months of logs of user-specified reminders from Cortana (Microsoft's intelligent personal assistant), the first large-scale analysis of such reminders. We focus our analyses on time-based reminders, the most common type of reminder found in the logs. We perform a data-driven analysis to identify common categories of tasks that give rise to these reminders across a large number of users, and we arrange these tasks into a taxonomy. We identify temporal patterns linked to the type of task, time of creation, and terms in the reminder text. Finally, we show that these patterns generalize by addressing a prediction task. Specifically, we show that a reminder's creation time is a strong feature in predicting the notification time, and that including the reminder text further improves prediction accuracy. The results have implications for the design of systems aimed at helping people to complete tasks and to plan future activities.

References

[1]

Agichtein, E., Brill, E., and Dumais, S. (2006). Improving web search ranking by incorporating user behavior information. Proc. SIGIR (pp. 19--26).

Digital Library

[2]

Armentano, M.G. and Amandi, A.A. (2009). Recognition of User Intentions for Interface Agents with Variable Order Markov Models. Proc. UMAP '09 (pp. 173--184).

Digital Library

[3]

Barreau, D. and Nardi, B.A. (1995). Finding and reminding: File organization from the desktop. ACM SIGCHI Bulletin, 27(3), 39--43.

Digital Library

[4]

Barua, D., Kay, J., Kummerfeld, B., Paris, C. (2014). Modelling Long Term Goals. Proc. UMAP 2014. pp 1--12.

[5]

Brandimonte, M.A., Einstein, G.O., and McDaniel, M.A. (2014). Prospective Memory: Theory and applications. Psychology Press.

[6]

Chaurasia, P., McClean, S.D., Nugent, C., and Scotney, B. (2014). A duration-based online reminder system. Int. J. of Pervasive Computing and Communications, 10(3), 337--366.

[7]

Czerwinski, M., Horvitz, E., and Wilhite, S. (2004). A diary study of task switching and interruptions. Proc. SIGCHI (pp. 175--182).

Digital Library

[8]

DeVaul, R., Clarkson, B., and Pentland, A. (2000). The Memory Glasses: Towards a wearable context aware, situation-appropriate reminder system. Proc. SIGCHI Workshop on Situated Interaction in Ubiquitous Computing.

[9]

Dey, A.K. and Abowd, G.D. (2000). Cybreminder: A context-aware system for supporting reminders. In Handheld and Ubiquitous Computing (pp. 172--186).

Digital Library

[10]

Dismukes, R. K. (2012). Prospective Memory in Workplace and Everyday Situations. In Current Directions in Psychological Science, 21 (4): 215--220.

[11]

Einstein, G.O. and McDaniel, M.A. (1990). Normal aging and prospective memory. J. of Experimental Psychology: Learning, Memory, and Cognition, 16(4), 717.

[12]

Ellis, J. (1996). Prospective memory or the realization of delayed intentions: A conceptual framework for research. Prospective memory: Theory and applications, 1--22.

[13]

Ellis, J. and Kvavilashvili, L. (2000). Prospective memory in 2000: Past, present and future directions. Applied Cognitive Psychology, 14, 1--9.

[14]

Fertig, Scott, Freeman, E., and Gelernter, D. (1996). "Finding and reminding" reconsidered. SIGCHI Bulletin, 28(1), 66--69.

Digital Library

[15]

Fertig, S., Freeman, E., and Gelernter, D. (1996). Lifestreams: An alternative to the desktop metaphor. Proc. SIGCHI Conference Companion (pp. 410--411).

Digital Library

[16]

Friedman, J.H. (2002). Stochastic gradient boosting. Comput. Stat. Data Anal. 38(4), 367--378.

Digital Library

[17]

Hanauer, D.A., Wentzell, K., Laffel, N., and Laffel, L.M. (2009). Computerized Automated Reminder Diabetes System (CARDS): E-mail and SMS cell phone text messaging reminders to support diabetes management. Diabetes Technology and Therapeutics, 11(2), 99--106.

[18]

Hicks, J.L., Marsh, R.L., and Cook, G.I. (2005). Task interference in time-based, event-based, and dual intention prospective memory conditions. J. Memory and Language, 53(3), 430--444.

[19]

Intons-Peterson, M.J. and Fournier, J. (1986). External and internal memory aids: When and how often do we use them? Journal of Experimental Psychology: General 115(3), 267.

[20]

Joachims, T. (2002). Optimizing search engines using clickthrough data. Proc. SIGKDD (pp. 133--142).

Digital Library

[21]

Kamar, E. and Horvitz, E. (2011). Jogger: Models for context-sensitive reminding. Proc. AAMS (pp. 1089--1090).

Digital Library

[22]

Kapur, N., Glisky, E.L., and Wilson, B.A. (2004). Technological memory aids for people with memory deficits. Neuropsychological Rehabilitation, 14(1--2), 41--60.

[23]

Koren, Y., Liberty, E., Maarek, Y., and Sandler, R. (2011). Automatically tagging email by leveraging other users' folders. Proc. SIGKDD (pp. 913--921).

Digital Library

[24]

Lamming, M. and Flynn, M. (1994). Forget-me-not: Intimate computing in support of human memory. Proc. FRIEND21 (pp. 2--4).

[25]

Leskovec, J. and Horvitz, E. (2008). Planetary-scale views on a large instant-messaging network. Proc. WWW (pp. 915--924).

Digital Library

[26]

Ludford, P.J., Frankowski, D., Reily, K., Wilms, K., and Terveen, L. (2006). Because i carry my cell phone anyway: Functional location-based reminder applications. Proc. SIGCHI (pp. 889--898).

Digital Library

[27]

Malone, T.W. (1983). How do people organize their desks? Implications for the design of office information systems. ACM TOIS, 1(1), 99--112.

Digital Library

[28]

Marmasse, N. and Schmandt, C. (2000). Location-aware information delivery with commotion. Proc. Handheld and Ubiquitous Computing (pp. 157--171).

Digital Library

[29]

McGee-Lennon, M.R., Wolters, M.K., and Brewster, S. (2011). User-centred multimodal reminders for assistive living. Proc. SIGCHI (pp. 2105--2114).

Digital Library

[30]

McGee-Lennon, M., Wolters, M., McLachlan, R., Brewster, S., and Hall, C. (2011). Name that tune: Musicons as reminders in the home. Proc. SIGCHI (pp. 2803--2806).

Digital Library

[31]

O'Connail, B. and Frohlich, D. (1995). Timespace in the workplace: Dealing with interruptions. Proc. SIGCHI Conference Companion (pp. 262--263).

Digital Library

[32]

Partridge, K. and Price, R (2009). Enhancing mobile recommender systems with activity prediction. Proc. UMAP '09. 307--318.

Digital Library

[33]

Rhodes, B. and Starner, T. (1996). Remembrance Agent: A continuously running automated information retrieval system. Proc. Practical Application of Intelligent Agents and Multi Agent Technology (pp. 487--495).

[34]

Richardson, M. (2008). Learning about the world through long-term query logs. ACM TWEB, 2(4), 2

Digital Library

[35]

Sellen, A.J., Louie, G, Harris, J.E., and Wilkins, A.J. (1996). What brings intentions to mind? An in situ study of prospective memory. Memory, 5(4), 483--507.

[36]

Tu, Y., Chen, L., Lv, M., Ye, Y., Huang, W., and Chen, G. (2013). ireminder: An intuitive location-based reminder that knows where you are going. IJHCI, 29(12), 838--850.

[37]

White, R.W. and Drucker, S.M. (2007). Investigating behavioral variability in web search. Proc. WWW (pp. 21--30).

Digital Library

Cited By

Khaokaew YXue HRahaman MSalim FKostakos VKay JHoang T(2024)WorkR: Occupation Inference for Intelligent Task AssistanceProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676622(118-124)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676622
Frummet ASpeggiorin AElsweiler DLeuski ADalton J(2024)Cooking with Conversation: Enhancing User Engagement and Learning with a Knowledge-Enhancing AssistantACM Transactions on Information Systems10.1145/364950042:5(1-29)Online publication date: 29-Apr-2024
https://dl.acm.org/doi/10.1145/3649500
Miniyadan AG P NRajendran SK RV NP K N(2024)AIDoList - AI Powered Task Management System2024 International Conference on Intelligent Computing and Emerging Communication Technologies (ICEC)10.1109/ICEC59683.2024.10837412(1-6)Online publication date: 23-Nov-2024
https://doi.org/10.1109/ICEC59683.2024.10837412
Show More Cited By

Index Terms

Analyzing and Predicting Task Reminders
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
      1. Social recommendation

Recommendations

How to Remember What to Remember: Exploring Possibilities for Digital Reminder Systems

Digital reminder systems typically use time and place as triggers to remind people to perform activities. In this paper, we investigate how digital reminder systems could better support the process of remembering in a wider range of situations. We report ...
Tactile interruption management: tactile cues as task-switching reminders

Tactile cuing has been suggested as a method of interruption management for busy visual environments. This study examined the effectiveness of tactile cues as an interruption management strategy in a multi-tasking environment. Sixty-four participants ...
Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal
Notification user interfaces

We examine people's strategic cognitive responses to being interrupted while performing a task. Based on memory theory, we propose that resumption of a task after interruption is facilitated by preparation during the interruption lag, or the interval ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UMAP '16: Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization

July 2016

366 pages

ISBN:9781450343688

DOI:10.1145/2930238

General Chairs:
Julita Vassileva
University of Saskatchewan, Canada
,
James Blustein
Dalhousie University, Canada
,
Program Chairs:
Lora Aroyo
VU Amsterdam, the Netherlands
,
Sidney D'Mello
University of Notre Dame, USA

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 July 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UMAP '16

Sponsor:

UMAP '16: User Modeling, Adaptation and Personalization Conference

July 13 - 17, 2016

Nova Scotia, Halifax, Canada

Acceptance Rates

UMAP '16 Paper Acceptance Rate 21 of 123 submissions, 17%;

Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Sponsor:
sigchi
sigchi

33rd ACM Conference on User Modeling, Adaptation and Personalization

June 16 - 19, 2025

New York City , NY , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
529
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Khaokaew YXue HRahaman MSalim FKostakos VKay JHoang T(2024)WorkR: Occupation Inference for Intelligent Task AssistanceProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676622(118-124)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676622
Frummet ASpeggiorin AElsweiler DLeuski ADalton J(2024)Cooking with Conversation: Enhancing User Engagement and Learning with a Knowledge-Enhancing AssistantACM Transactions on Information Systems10.1145/364950042:5(1-29)Online publication date: 29-Apr-2024
https://dl.acm.org/doi/10.1145/3649500
Miniyadan AG P NRajendran SK RV NP K N(2024)AIDoList - AI Powered Task Management System2024 International Conference on Intelligent Computing and Emerging Communication Technologies (ICEC)10.1109/ICEC59683.2024.10837412(1-6)Online publication date: 23-Nov-2024
https://doi.org/10.1109/ICEC59683.2024.10837412
Williams AIqbal SKiseleva JWhite R(2023)Managing Tasks across the Work–Life Boundary: Opportunities, Challenges, and DirectionsACM Transactions on Computer-Human Interaction10.1145/358242930:3(1-31)Online publication date: 31-Jan-2023
https://dl.acm.org/doi/10.1145/3582429
Saxena RChaudhary MMaurya CPrasad S(2022)An Intelligent Recommendation-cum-Reminder SystemProceedings of the 5th Joint International Conference on Data Science & Management of Data (9th ACM IKDD CODS and 27th COMAD)10.1145/3493700.3493724(169-177)Online publication date: 8-Jan-2022
https://dl.acm.org/doi/10.1145/3493700.3493724
Schmidt SZimmermann SMason CSteinicke F(2022)Simulating Human Imprecision in Temporal Statements of Intelligent Virtual AgentsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517625(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517625
Zhang CKiseleva JJauhar SWhite R(2021)Grounded Task Prioritization with Context-Aware Sequential RankingACM Transactions on Information Systems10.1145/348686140:4(1-28)Online publication date: 8-Dec-2021
https://dl.acm.org/doi/10.1145/3486861
Shah CWhite RScholer FThomas PElsweiler DJoho HKando NSmith C(2021)Bridging Task Expressions and Search QueriesProceedings of the 2021 Conference on Human Information Interaction and Retrieval10.1145/3406522.3446045(319-323)Online publication date: 14-Mar-2021
https://dl.acm.org/doi/10.1145/3406522.3446045
Sai Swaroop Krishna NKrishna Tej ASuchithra M(2021)Smart Personal Task SchedulerIntelligent Manufacturing and Energy Sustainability10.1007/978-981-16-6482-3_44(443-451)Online publication date: 11-Dec-2021
https://doi.org/10.1007/978-981-16-6482-3_44
Engeler NGilbert S(2020)The effect of metacognitive training on confidence and strategic reminder settingPLOS ONE10.1371/journal.pone.024085815:10(e0240858)Online publication date: 23-Oct-2020
https://doi.org/10.1371/journal.pone.0240858
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten