Decide or Delegate: How Script Knowledge Based Conversational Assistants Should Act in Inconclusive Situations
Pages 69 - 73
Abstract
We present a study addressing the question how script knowledge based conversational assistants should act in situations of inconclusive information. Such situations occur for example in case of alternative or optional events that lead to multiple correct paths through the script. We have conducted a user study with four typical everyday activities (Making Coffee, Baking Cake, Finding the route to main station, Finding the route to camping ground) that may be represented in scripts. In this study, we have compared and evaluated four different presentation styles to handle situations of conflicting script information. A total of 182 persons participated in our study. The evaluation results show that, in case of a conflicting script state, users find the assistant most useful and are most satisfied if the assistant guesses the next correct event and provides a direct instruction instead of disclosing his incompetence. Alternatives in which the assistant delegates the decision to the user score worse.
References
[1]
Richard Edward Cullingford. 1978. Script application: computer understanding of newspaper stories.Technical Report. Yale University New Haven, Dept. of Computer Science.
[2]
Fred D Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly (1989), 319–340.
[3]
Lea Frermann, Ivan Titov, and Manfred Pinkal. 2014. A hierarchical bayesian model for unsupervised induction of script knowledge. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics. 49–57.
[4]
Toshiaki Fujiki, Hidetsugu Nanba, and Manabu Okumura. 2003. Automatic acquisition of script knowledge from a text collection. In Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics-Volume 2. Association for Computational Linguistics, 91–94.
[5]
David A Grant. 1948. The latin square principle in the design and analysis of psychological experiments.Psychological bulletin 45, 5 (1948), 427.
[6]
Ben Hixon, Peter Clark, and Hannaneh Hajishirzi. 2015. Learning knowledge graphs for question answering through conversational dialog. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 851–861.
[7]
James R Lewis. 1995. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction 7, 1(1995), 57–78.
[8]
Ashutosh Modi and Ivan Titov. 2014. Inducing neural models of script knowledge. In Proceedings of the Eighteenth Conference on Computational Natural Language Learning. 49–57.
[9]
Karl Pichotta and Raymond J Mooney. 2016. Learning Statistical Scripts with LSTM Recurrent Neural Networks. In AAAI. 2800–2806.
[10]
Lisa F Rau, Paul S Jacobs, and Uri Zernik. 1989. Information extraction and text summarization using linguistic knowledge acquisition. Information Processing & Management 25, 4 (1989), 419–428.
[11]
Michaela Regneri, Alexander Koller, and Manfred Pinkal. 2010. Learning script knowledge with web experiments. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 979–988.
[12]
Roger C Schank and Robert P Abelson. 1977. Scripts, plans, goals, and understanding: An inquiry into human knowledge structures. Lawrence Erlbaum Associates.
[13]
Reid Swanson and Andrew S Gordon. 2008. Say anything: A massively collaborative open domain story writing companion. In Joint International Conference on Interactive Digital Storytelling. Springer, 32–40.
Index Terms
- Decide or Delegate: How Script Knowledge Based Conversational Assistants Should Act in Inconclusive Situations
Index terms have been assigned to the content through auto-classification.
Recommendations
Does a Conversational Robot Need to Have its own Values?: A Study of Dialogue Strategy to Enhance People's Motivation to Use Autonomous Conversational Robots
HAI '16: Proceedings of the Fourth International Conference on Human Agent InteractionThis work studies a dialogue strategy aimed at building people's motivation for talking with autonomous conversational robots. Even though spoken dialogue systems continue to develop rapidly, the existing systems are insufficient for continuous use ...
Contextual Dialogue Act Classification for Open-Domain Conversational Agents
SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information RetrievalClassifying the general intent of the user utterance in a conversation, also known as Dialogue Act (DA), e.g., open-ended question, statement of opinion, or request for an opinion, is a key step in Natural Language Understanding (NLU) for conversational ...
Conversational system for information navigation based on POMDP with user focus tracking
HighlightsWe address a spoken dialogue system which conducts information navigation.We formulate the problem of dialogue management as a module selection with POMDP.The reward function of POMDP is defined by the quality of interaction.The POMDP tracks ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
January 2021
174 pages
ISBN:9781450381840
DOI:10.1145/3427477
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 January 2021
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Bundesministerium für Bildung und Forschung
- Deutsche Forschungsgemeinschaft
Conference
ICDCN '21
ICDCN '21: International Conference on Distributed Computing and Networking 2021
January 5 - 8, 2021
Nara, Japan
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 39Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format