Article

RADAR: a personal assistant that learns to reduce email overload

Authors:

Jaime Carbonell,

Daniel Siewiorek,

Aaron Steinfeld,

Anthony TomasicAuthors Info & Claims

AAAI'08: Proceedings of the 23rd national conference on Artificial intelligence - Volume 3

Pages 1287 - 1293

Published: 13 July 2008 Publication History

Abstract

Email client software is widely used for personal task management, a purpose for which it was not designed and is poorly suited. Past attempts to remedy the problem have focused on adding task management features to the client UI. RADAR uses an alternative approach modeled on a trusted human assistant who reads mail, identifies task-relevant message content, and helps manage and execute tasks. This paper describes the integration of diverse AI technologies and presents results from human evaluation studies comparing RADAR user performance to unaided COTS tool users and users partnered with a human assistant. As machine learning plays a central role in many system components, we also compare versions of RADAR with and without learning. Our tests show a clear advantage for learning-enabled RADAR over all other test conditions.

References

[1]

Balter, O. 1998. Electronic Mail in Working Context. PhD Thesis. Royal Institute of Technology, Stockholm, Sweden.

[2]

Bardak, U., Fink, E., Carbonell, J. 2006a. Scheduling with Uncertain Resources Part 2: Representation and Utility Function. Proc. IEEE International Conference on Systems, Man, and Cybernetics, pages 1486-1492.

[3]

Bardak, U., Fink, E., Martens, C., Carbonell, J. 2006b. Scheduling with Uncertain Resources Part 3: Elicitation of Additional Data. Proc. IEEE International Conference on Systems, Man, and Cybernetics, pages 1493-1498.

[4]

Belotti, V., Ducheneaut, M., Howard, M., Smith, I. 2003. Taking Email to Task: The Design and Evaluation of a Task Management Centered EMail Tool. Proc. 2003 Conference on Computer/Human Interaction, ACM Press, 345-352.

Digital Library

[5]

Belotti, V., Ducheneaut, N., Howard, M., Smith, I. and Grinter, R. 2005. Quality vs. Quantity: Email-centric task management and its relations with overload. Human-Computer Interaction, 20, 2/3, 89-138.

Digital Library

[6]

Cadiz, J. J., Dabbish, L., Gupta, A., and Venolia, G. D. 2001. Supporting Email Workflow. Technical Report MSR-TR-2001-88. Redmond, WA: Microsoft Research.

[7]

Carvalho, V., Cohen, W. 2006. Improving Email Speech Act Analysis via n-gram Selection. HLT/NAACL ACTS Workshop.

Digital Library

[8]

Cohen, W. 2004. Minorthird: Methods for identifying names and ontological relations in text using heuristics for inducing regularities from data. http://minorthird.sourceforge.net

[9]

Cohen, W., Minkov, E. and Tomasic, A. 2005. Learning to Understand Web Site Update Requests. Proc. 1995 International Joint Conference on Artificial Intelligence.

Digital Library

[10]

Dabbish, L., Kraut, R. 2006. Email Overload at Work: An Analysis of Factors Associated with Email Strain. Proc. 2006 Conference on Computer Supported Collaborative Work, ACM.

Digital Library

[11]

Donmez, P., Carbonell, J. 2008. Paired Sampling in Density-Sensitive Active Learning. Proc. 10th International Symposium on Artificial Intelligence and Mathematics, Florida.

[12]

Fink, E., Jennings, M., Bardak, U., Oh, J,. Smith, S. Carbonell, J. 2006. Scheduling with Uncertain Resources: Search for a Near-Optimal Solution. Proc. IEEE International Conference on Systems, Man, and Cybernetics, pages 137-144.

[13]

Han, B., Gates, D., Levin, L. 2006. From Language to Time: A Temporal Expression Anchorer. Proc. 13th International Symposium on Temporal Representation and Reasoning (TIME 2006).

Digital Library

[14]

Iqbal, S.T., Horvitz, E. 2007. Disruption and Recovery of Computing Tasks: Field Study, Analysis and Directions. Proc. 2007 Conference on Computer/Human Interaction.

Digital Library

[15]

Kumar, M., Garera, N., Rudnicky, A. 2006. "A Briefing Tool that Learns Report-writing Behavior", IEEE International Conference on Tools with Artificial Intelligence (ICTAI), Washington D.C., USA.

Digital Library

[16]

Mackay, W.E. 1988. More than Just a Communication System: diversity in the use of electronic mail. Proc. 1988 Conference on Computer Supported Collaboartive Work. ACM.

Digital Library

[17]

Mock, K. 2001. An Experimental Framework for Email Categorization and Management. Proc. SIGIR 2001. New York: ACM.

Digital Library

[18]

Oh, J., Smith, S. 2004. Learning User Preferences in Distributed Calendar Scheduling. Proc. 5th International Conference on the Practice and Theory of Automated Timetabling, Pittsburgh PA.

Digital Library

[19]

Rohall, S.L., Gruen, D., Moody, P., Kellerman, S. 2001. Email Visualizations to Aid Communications. Proc. 2001 Conference on Information Visualization, IEEE. 12-15.

[20]

Rossi, F., Venable, K. B., Yorke-Smith, N. 2006. Uncertainty in Soft Temporal Constraint Problems: A general framework and controllability algorithms for the fuzzy case. JAIR 27:617-674.

Digital Library

[21]

Smailagic, A., Siewiorek, D., De la Torre, F., Pradhan, P., Shah, A., Vigar, J. 2007. Task Interruptibility Analysis. Technical Report, Institute for Complex Engineered Systems, Carnegie Mellon University, Pittsburgh, PA.

[22]

Song, M., Halsey, V., Burress, T. 2007. The Hamster Revolution: How to Manage Your Email Before It Manages You, Berrett-Koehler.

Digital Library

[23]

Spira, J., Goldes, D. 2007. Information Overload: We Have Met the Enemy and He is Us. Report by Basex Inc.

[24]

Steinfeld, A. 2008. Airspace web site, http://www.cs.cmu.edu/~airspace

[25]

Steinfeld, A., Bennett, S. R., Cunningham, K., Lahut, M., Quinones, P.-A., Wexler, D., Siewiorek, D., Hayes, J., Cohen, P., Fitzgerald, J., Hansson, O., Pool, M., Drummond, M. 2007a. Evaluation of an Integrated Multi-Task Machine Learning System with Humans in the Loop. Proc. NIST Performance Metrics for Intelligent Systems Workshop.

Digital Library

[26]

Steinfeld, A., Quinones, P.-A., Zimmerman, J., Bennett, S. R., Siewiorek, D. 2007b. Survey Measures for Evaluation of Cognitive Assistants, Proc. NIST Performance Metrics for Intelligent Systems Workshop.

Digital Library

[27]

Tomasic, A., Simmons, I., Zimmerman, J. 2007. Learning Information Intent via Observation. Proc. International World Wide Web Conference (WWW).

Digital Library

[28]

Varakantham, P., Smith, S.F., "Advising Busy Users on How to Cut Corners", Technical Report CMU-RI-08-17, The Robotics Institute, Carnegie Mellon University, April 2008.

[29]

Whittaker, S., Sidner, C. 1996. Email overload: Exploring personal information management of email. Proc. 1996 Conference on Computer/Human Interaction. ACM.

Digital Library

[30]

Yang, Y., Yoo, S., Zhang, Z., Kisiel, B. 2005. Robustness of Adaptive Filtering Methods in a Cross-benchmark Evaluation. Proc. 28th Annual International ACM SIGIR Conference (SIGIR 2005), Brazil.

Digital Library

[31]

Zhang, H., Jiang, L., Su, J. 2005. Hidden Naive Bayes. Proc. AAAI, 919-924. AAAI Press.

Digital Library

[32]

Zimmerman, J., Tomasic, A., Simmons, I., Hargraves, I., Mohnkern, K., Cornwell, J., McGuire, R. 2007. VIO: A mixed-initiative approach to learning and automating procedural update tasks. Proc. 2007 Conference on Computer/Human Interaction.

Digital Library

Cited By

Zhang CKiseleva JJauhar SWhite R(2021)Grounded Task Prioritization with Context-Aware Sequential RankingACM Transactions on Information Systems10.1145/348686140:4(1-28)Online publication date: 8-Dec-2021
https://dl.acm.org/doi/10.1145/3486861
Pecune FChen JMatsuyama YCassell JAndre EKoenig SDastani MSukthankar G(2018)Field Trial Analysis of Socially Aware Robot AssistantProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3237883(1241-1249)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3237883
Berry PDonneau-Golencer TDuong KGervasio MPeintner BYorke-Smith N(2017)Evaluating intelligent knowledge systemsKnowledge and Information Systems10.1007/s10115-016-1011-352:2(379-409)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.1007/s10115-016-1011-3
Show More Cited By

Recommendations

Spotlight-Mode Synthetic Aperture Radar: A Signal Processing Approach
Automatic aircraft landing using interferometric inverse synthetic aperture radar imaging
ICIP '95: Proceedings of the 1995 International Conference on Image Processing (Vol. 1)-Volume 1 - Volume 1

This paper presents an interferometric processing of an aircraft's monostatic and bistatic inverse synthetic aperture radar signatures for automatic landing. The aircraft's squint angle in this ISAR imaging problem is near 90 degrees. We show that this ...
MIMO radar, SIMO radar, and IFIR radar: a comparison
Asilomar'09: Proceedings of the 43rd Asilomar conference on Signals, systems and computers

This paper focuses on a simple beamforming problem and compares the MIMO and SIMO radar systems for the case where the transmitter and receiver are collocated. The simplicity of the application allows one to see clearly where the advantages of MIMO ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

AAAI'08: Proceedings of the 23rd national conference on Artificial intelligence - Volume 3

July 2008

1892 pages

ISBN:9781577353683

Editor:
Anthony Cohn
University of Leeds

Sponsors

Association for the Advancement of Artificial Intelligence

Publisher

AAAI Press

Publication History

Published: 13 July 2008

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang CKiseleva JJauhar SWhite R(2021)Grounded Task Prioritization with Context-Aware Sequential RankingACM Transactions on Information Systems10.1145/348686140:4(1-28)Online publication date: 8-Dec-2021
https://dl.acm.org/doi/10.1145/3486861
Pecune FChen JMatsuyama YCassell JAndre EKoenig SDastani MSukthankar G(2018)Field Trial Analysis of Socially Aware Robot AssistantProceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems10.5555/3237383.3237883(1241-1249)Online publication date: 9-Jul-2018
https://dl.acm.org/doi/10.5555/3237383.3237883
Berry PDonneau-Golencer TDuong KGervasio MPeintner BYorke-Smith N(2017)Evaluating intelligent knowledge systemsKnowledge and Information Systems10.1007/s10115-016-1011-352:2(379-409)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.1007/s10115-016-1011-3
Hanrahan BPérez-Quiñones MBegole BKim JInkpen KWoo W(2015)Lost in EmailProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems10.1145/2702123.2702351(3981-3984)Online publication date: 18-Apr-2015
https://dl.acm.org/doi/10.1145/2702123.2702351
Kokkalis NKöhn TPfeiffer CChornyi DBernstein MKlemmer SBruckman ACounts SLampe CTerveen L(2013)EmailValetProceedings of the 2013 conference on Computer supported cooperative work10.1145/2441776.2441922(1291-1300)Online publication date: 23-Feb-2013
https://dl.acm.org/doi/10.1145/2441776.2441922
Kwong HYorke-Smith N(2012)Detection of imperative and declarative question--answer pairs in email conversationsAI Communications10.5555/2594622.259462325:4(271-283)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.5555/2594622.2594623
Gil YRatnakar VChklovski TGroth PVrandecic D(2012)Capturing Common Knowledge about TasksACM Transactions on Interactive Intelligent Systems10.1145/2362394.23623972:3(1-35)Online publication date: 1-Sep-2012
https://dl.acm.org/doi/10.1145/2362394.2362397
Choi DKim EChoi KMusen MCorcho O(2011)Boundary detection of multiple related temporal duration of schedules in emailProceedings of the sixth international conference on Knowledge capture10.1145/1999676.1999694(97-104)Online publication date: 26-Jun-2011
https://dl.acm.org/doi/10.1145/1999676.1999694
Refanidis IYorke-Smith N(2010)A constraint-based approach to scheduling an individual's activitiesACM Transactions on Intelligent Systems and Technology10.1145/1869397.18694011:2(1-32)Online publication date: 3-Dec-2010
https://dl.acm.org/doi/10.1145/1869397.1869401
Faulring AMyers BMohnkern KSchmerl BSteinfeld AZimmerman JSmailagic AHansen JSiewiorek DRich CYang QCavazza MZhou M(2010)Agent-assisted task management that reduces email overloadProceedings of the 15th international conference on Intelligent user interfaces10.1145/1719970.1719980(61-70)Online publication date: 7-Feb-2010
https://dl.acm.org/doi/10.1145/1719970.1719980
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents