research-article

Learning About Work Tasks to Inform Intelligent Assistant Design

Authors:

Johanne R. Trippas,

Ahmed Hassan Awadallah,

Paul N. Bennett,

Jonathan Liono,

Flora D. Salim,

Mark SandersonAuthors Info & Claims

CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval

Pages 5 - 14

https://doi.org/10.1145/3295750.3298934

Published: 08 March 2019 Publication History

Abstract

Intelligent assistants can serve many purposes, including entertainment (e.g. playing music), home automation, and task management (e.g. timers, reminders). The role of these assistants is evolving to also support people engaged in work tasks, in workplaces and beyond. To design truly useful intelligent assistants for work, it is important to better understand the work tasks that people are performing. Based on a survey of 401 respondents' daily tasks and activities in a work setting, we present a classification of work-related tasks, and analyze their key characteristics, including the frequency of their self-reported tasks, the environment in which they undertake the tasks, and which, if any, electronic devices are used. We also investigate the cyber, physical, and social aspects of tasks. Finally, we reflect on how intelligent assistants could influence and help people in a work environment to complete their tasks, and synthesize our findings to provide insight on the future of intelligent assistants in support of amplifying personal productivity.

References

[1]

Eugene Agichtein, Ryen W. White, Susan T. Dumais, and Paul N. Bennett. 2012. Search, Interrupted: Understanding and Predicting Search Task Continuation. In Proc. SIGIR. ACM, 315--324.

Digital Library

[2]

Australian Bureau of Statistics. 2013. Directories, Classifications and Manuals by Topic. http://www.abs.gov.au/ausstats/[email protected]/ViewContent?readform&view=DirClassManualsbyTopic&Action=Expand&Num=6.1.3 Accessed on 15-01--2019.

[3]

Peter Bailey, Liwei Chen, Scott Grosenick, Li Jiang, Yan Li, Paul Reinholdtsen, Charles Salada, Haidong Wang, and Sandy Wong. 2012. User Task Understanding: A Web Search Engine Perspective. In NII Shonan Meeting on Whole-Session Evaluation of Interactive Information Retrieval Systems.

[4]

Victoria Bellotti, Nicolas Ducheneaut, Mark Howard, and Ian Smith. 2003. Taking Email to Task: The Design and Evaluation of a Task Management Centered Email Tool. In Proc. CHI. ACM, 345--352.

Digital Library

[5]

Andrei Broder. 2002. A Taxonomy of Web Search. ACM SIGIR Foru, Vol. 36, 2 (2002), 3--10.

Digital Library

[6]

Jacques Charmes. 2015. Time Use across the World: Findings of a World Compilation of Time-Use Surveys. Background paper for Human Development Report (2015).

[7]

Justin Cheng, Jaime Teevan, Shamsi T. Iqbal, and Michael S. Bernstein. 2015. Break It Down: A Comparison of Macro- and Microtasks. In Proc. CHI. ACM, 4061--4064.

Digital Library

[8]

Karen Church, Mauro Cherubini, and Nuria Oliver. 2014. A Large-Scale Study of Daily Information Needs Captured In Situ. ACM Trans. on Computer-Human Interaction, Vol. 21, 2, Article 10 (Feb. 2014), bibinfonumpages46 pages.

Digital Library

[9]

Karen Church and Barry Smyth. 2009. Understanding the Intent Behind Mobile Information Needs. In Proc. IUI. ACM, 247--256.

Digital Library

[10]

Victoria Clarke and Virginia Braun. 2006. Using Thematic Analysis in Psychology. Qual. Res. Psychol., Vol. 3, 2 (2006), 77--101.

[11]

Victoria Clarke and Virginia Braun. 2013. Successful Qualitative Research: A Practical Guide for Beginners. Sage.

[12]

Mark Dredze and Hanna Wallach. 2008. User Models for Email Activity Management. In IUI Workshop on Ubiquitous User Modeling.

[13]

Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, Rashmi Gupta, Rami Albatal, Dang Nguyen, and Duc Tien. 2017. Overview of NTCIR-13 Lifelog-2 Task. In Proc. NTCIR.

[14]

Ahmed Hassan Awadallah, Ryen W. White, Patrick Pantel, Susan T. Dumais, and Yi-Min Wang. 2014. Supporting Complex Search Tasks. In Proc. CIKM. ACM, 829--838.

Digital Library

[15]

Shamsi T. Iqbal and Eric Horvitz. 2007. Disruption and Recovery of Computing Tasks: Field study, Analysis, and Directions. In Proc. CHI. ACM, 677--686.

Digital Library

[16]

Rosie Jones and Kristina Lisa Klinkner. 2008. Beyond the Session Timeout: Automatic Hierarchical Segmentation of Search Topics in Query Logs. In Proc. CIKM. ACM, 699--708.

Digital Library

[17]

Daniel Kahneman, Alan B. Krueger, David A. Schkade, Norbert Schwarz, and Arthur A. Stone. 2004. A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method. Science, Vol. 306, 5702 (2004), 1776--1780.

[18]

Diane Kelly and Nicholas J. Belkin. 2004. Display Time as Implicit Feedback: Understanding Task Effects. In Proc. SIGIR. ACM, 377--384.

Digital Library

[19]

Bret Kinsella and Ava Mutchler. 2018. Smart Speaker Consumer Adoption Report. https://voicebot.ai/wp-content/uploads/2018/03/smart_speaker_consumer_adoption_report_2018.pdf Accessed on 15-01--2019.

[20]

Alexander Kotov, Paul N. Bennett, Ryen W. White, Susan T. Dumais, and Jaime Teevan. 2011. Modeling and Analysis of Cross-Session Search Tasks. In Proc. SIGIR. ACM, 5--14.

Digital Library

[21]

Nicholas Kushmerick and Tessa Lau. 2005. Automated email activity management: an unsupervised learning approach. In Proc. IUI. ACM, 67--74.

Digital Library

[22]

Yuelin Li and Nicholas J. Belkin. 2008. A Faceted Approach to Conceptualizing Tasks in Information Seeking. Inf. Proc. & Man., Vol. 44, 6 (2008), 1822--1837.

Digital Library

[23]

Jonathan Liono, Johanne R. Trippas, Damiano Spina, Mohammad S. Rahaman, Yongli Ren, Flora D. Salim, Mark Sanderson, Falk Scholer, and Ryen W. White. 2019. Building a Benchmark for Task Progress in Digital Assistants. In Proc. WSDM'19 Task Intelligence Workshop (TI@WSDM19).

[24]

Claudio Lucchese, Salvatore Orlando, Raffaele Perego, Fabrizio Silvestri, and Gabriele Tolomei. 2011. Identifying Task-Based Sessions in Search Engine Query Logs. In Proc. WSDM. ACM, 277--286.

Digital Library

[25]

Gloria Mark, Victor M. Gonzalez, and Justin Harris. 2005. No Task Left Behind?: Examining the Nature of Fragmented Work. In Proc. CHI. ACM, 321--330.

Digital Library

[26]

Rishabh Mehrotra, Ahmed Hassan Awadallah, Ahmed E. Kholy, and Imed Zitouni. 2017. Hey Cortana! Exploring the Use Cases of a Desktop Based Digital Assistant. In Proc. 1st International Workshop on Conversational Approaches to Information Retrieval (CAIR'17).

[27]

Michael J. Paul, Ryen W. White, and Eric Horvitz. 2016. Search and Breast Cancer: On Episodic Shifts of Attention over Life Histories of an Illness. ACM Transactions on the Web (TWEB), Vol. 10, 2 (2016), 13.

Digital Library

[28]

Ashequl Qadir, Michael Gamon, Patrick Pantel, and Ahmed Hassan Awadallah. 2016. Activity Modeling in Email. In Proc. NAACL. 1452--1462.

[29]

Yongli Ren, Martin Tomko, Flora D. Salim, Jeffrey Chan, Charles L.A. Clarke, and Mark Sanderson. 2018. A Location-Query-Browse Graph for Contextual Recommendation. IEEE Trans. Know. Data Eng., Vol. 30, 2 (Feb 2018), 204--218.

[30]

Yongli Ren, Martin Tomko, Flora D. Salim, Kevin Ong, and Mark Sanderson. 2017. Analyzing Web Behavior in Indoor Retail Spaces. JASIST, Vol. 68, 1 (2017), 62--76.

Digital Library

[31]

Daniel E. Rose and Danny Levinson. 2004. Understanding User Goals in Web Search. In Proc. WWW. ACM, 13--19.

Digital Library

[32]

Miamaria Saastamoinen and Kalervo Järvelin. 2017. Search Task Features in Work Tasks of Varying Types and Complexity. JASIST, Vol. 68, 5 (2017), 1111--1123.

Digital Library

[33]

Jianqiang Shen, Lida Li, Thomas G. Dietterich, and Jonathan L. Herlocker. 2006. A Hybrid Learning System for Recognizing User Tasks from Desktop Activities and Email Messages. In Proc. IUI. ACM, 86--92.

Digital Library

[34]

Timothy Sohn, Kevin A. Li, William G. Griswold, and James D. Hollan. 2008. A Diary Study of Mobile Information Needs. In Proc. CHI. ACM, 433--442.

Digital Library

[35]

Simone Stumpf, Xinlong Bao, Anton Dragunov, Thomas G. Dietterich, Jon Herlocker, Kevin Johnsrude, Lida Li, and JianQiang Shen. 2005. Predicting User Tasks: I Know What You're Doing. In AAAI'05 Workshop on Human Comprehensible Machine Learning.

[36]

Johanne R. Trippas, Damiano Spina, Lawrence Cavedon, Hideo Joho, and Mark Sanderson. 2018. Informing the Design of Spoken Conversational Search. In Proc. CHIIR. ACM, 32--41.

Digital Library

[37]

Peter Tsai. 2018. AI Chatbots and Intelligent Assistants in the Workplace. https://community.spiceworks.com/blog/2964-data-snapshot-ai-chatbots_and-intelligent-assistants-in-the-workplace Accessed on 15-01-2019.

[38]

United Nations. Statistical Division. 2007. Guide to Producing Statistics on Time Use: Measuring Paid and Unpaid Work. United Nations Publications.

[39]

Ryen W. White and Diane Kelly. 2006. A study on the effects of personalization and task information on implicit feedback performance. In Proc. CIKM. ACM, 297--306.

Digital Library

[40]

Jessica L. Wildman, Amanda L. Thayer, Michael A. Rosen, Eduardo Salas, John E. Mathieu, and Sara R. Rayne. 2012. Task Types and Team-Level Attributes: Synthesis of Team Classification Literature. Human Resource Development Review, Vol. 11, 1 (2012), 97--129.

Cited By

Morrison KIqbal SHorvitz E(2024)AI-Powered Reminders for Collaborative Tasks: Experiences and FuturesProceedings of the ACM on Human-Computer Interaction10.1145/36537018:CSCW1(1-20)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653701
Li MPeng BGao JZhang Z(2024)OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking ExperienceACM Transactions on the Web10.1145/362338118:4(1-27)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3623381
Zhang XLiu C(2023)Examination of Information Problem Decomposition Strategies: A New Perspective for Understanding Users' Information Problems in Search as LearningProceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region10.1145/3624918.3625326(84-94)Online publication date: 26-Nov-2023
https://dl.acm.org/doi/10.1145/3624918.3625326
Show More Cited By

Index Terms

Learning About Work Tasks to Inform Intelligent Assistant Design
1. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence
      1. Intelligent agents
    2. Natural language processing
      1. Information extraction
2. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals
      1. Information extraction

Recommendations

Intelligent Task Recognition: Towards Enabling Productivity Assistance in Daily Life
ICMR '20: Proceedings of the 2020 International Conference on Multimedia Retrieval

We introduce the novel research problem of task recognition in daily life. We recognize tasks such as project management, planning, meal-breaks, communication, documentation, and family care. We capture Cyber, Physical, and Social (CPS) activities of 17 ...
A faceted approach to conceptualizing tasks in information seeking

The nature of the task that leads a person to engage in information interaction, as well as of information seeking and searching tasks, have been shown to influence individuals' information behavior. Classifying tasks in a domain has been viewed as a ...
Understanding the Variation of Software Development Tasks: a Qualitative Study
Internetware '17: Proceedings of the 9th Asia-Pacific Symposium on Internetware

In order to reduce cost, get to market faster and utilize global talents, large companies often organize their software development globally (distributed over Internet), a paradigm advocated by Internetware. Considering the complexity of distributed ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval

March 2019

463 pages

ISBN:9781450360258

DOI:10.1145/3295750

General Chairs:
Leif Azzopardi
University of Strathclyde, UK
,
Martin Halvey
University of Strathclyde, UK
,
Ian Ruthven
University of Strathclyde, UK
,
Program Chairs:
Hideo Joho
University of Tsukuba, Japan
,
Vanessa Murdock
Amazon, USA
,
Pernilla Qvarfordt
pxq Labs, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Microsoft Research

Conference

CHIIR '19

Sponsor:

CHIIR '19: Conference on Human Information Interaction and Retrieval

March 10 - 14, 2019

Glasgow, Scotland UK

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
472
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Morrison KIqbal SHorvitz E(2024)AI-Powered Reminders for Collaborative Tasks: Experiences and FuturesProceedings of the ACM on Human-Computer Interaction10.1145/36537018:CSCW1(1-20)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653701
Li MPeng BGao JZhang Z(2024)OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking ExperienceACM Transactions on the Web10.1145/362338118:4(1-27)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3623381
Zhang XLiu C(2023)Examination of Information Problem Decomposition Strategies: A New Perspective for Understanding Users' Information Problems in Search as LearningProceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region10.1145/3624918.3625326(84-94)Online publication date: 26-Nov-2023
https://dl.acm.org/doi/10.1145/3624918.3625326
He JPiorkowski DMuller MBrimijoin KHoude SWeisz J(2023)Rebalancing Worker Initiative and AI Initiative in Future Work: Four Task DimensionsProceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3596671.3598572(1-16)Online publication date: 13-Jun-2023
https://dl.acm.org/doi/10.1145/3596671.3598572
Williams AIqbal SKiseleva JWhite R(2023)Managing Tasks across the Work–Life Boundary: Opportunities, Challenges, and DirectionsACM Transactions on Computer-Human Interaction10.1145/358242930:3(1-31)Online publication date: 31-Jan-2023
https://dl.acm.org/doi/10.1145/3582429
Anderson CHeinisch JDeldari SSalim FOhly SDavid KPejović V(2023)Toward Social Role-Based Interruptibility ManagementIEEE Pervasive Computing10.1109/MPRV.2022.322990522:1(59-68)Online publication date: 1-Jan-2023
https://doi.org/10.1109/MPRV.2022.3229905
Li TLu YClark JChen MCox VJiang MYang YKay TWood DBrockman J(2022)A Bottom-Up End-User Intelligent Assistant Approach to Empower Gig Workers against AI InequalityProceedings of the 1st Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3533406.3533418(1-10)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3533406.3533418
Draxler FBrenner JEska MSchmidt AChuang L(2022)Agenda- and Activity-Based Triggers for MicrolearningProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511133(620-632)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490099.3511133
Zhang SWang MBalog KAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)Analyzing and Simulating User Utterance Reformulation in Conversational Recommender SystemsProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531936(133-143)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3531936
Kang YRahaman MRen YSanderson MWhite RSalim F(2022)App usage on-the-move: Context- and commute-aware next app predictionPervasive and Mobile Computing10.1016/j.pmcj.2022.10170487(101704)Online publication date: Dec-2022
https://doi.org/10.1016/j.pmcj.2022.101704
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents