research-article

Users Meet Clarifying Questions: Toward a Better Understanding of User Interactions for Search Clarification

Authors:

Mohammad Aliannejadi,

Evangelos Kanoulas,

Maria Soledad Pera,

Yiqun LiuAuthors Info & Claims

ACM Transactions on Information Systems, Volume 41, Issue 1

Article No.: 16, Pages 1 - 25

https://doi.org/10.1145/3524110

Published: 09 January 2023 Publication History

Abstract

The use of clarifying questions (CQs) is a fairly new and useful technique to aid systems in recognizing the intent, context, and preferences behind user queries. Yet, understanding the extent of the effect of CQs on user behavior and the ability to identify relevant information remains relatively unexplored. In this work, we conduct a large user study to understand the interaction of users with CQs in various quality categories, and the effect of CQ quality on user search performance in terms of finding relevant information, search behavior, and user satisfaction. Analysis of implicit interaction data and explicit user feedback demonstrates that high-quality CQs improve user performance and satisfaction. By contrast, low- and mid-quality CQs are harmful, and thus allowing the users to complete their tasks without CQ support may be preferred in this case. We also observe that user engagement, and therefore the need for CQ support, is affected by several factors, such as search result quality or perceived task difficulty. The findings of this study can help researchers and system designers realize why, when, and how users interact with CQs, leading to a better understanding and design of search clarification systems.

References

[1]

Abdalghani Abujabal, Rishiraj Saha Roy, Mohamed Yahya, and Gerhard Weikum. 2018. Never-ending learning for open-domain question answering over knowledge bases. In Proceedings of the 2018 World Wide Web Conference.1053–1062.

Digital Library

[2]

Mohammad Aliannejadi, Leif Azzopardi, Hamed Zamani, Evangelos Kanoulas, Paul Thomas, and Nick Craswell. 2021. Analysing mixed initiatives and search strategies during conversational search. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management.16–26.

Digital Library

[3]

Mohammad Aliannejadi, Morgan Harvey, Luca Costa, Matthew Pointon, and Fabio Crestani. 2019. Understanding mobile search task relevance and user behaviour in context. In Proceedings of the 2019 Conference on Human Information Interaction and Retrieval.143–151.

Digital Library

[4]

Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeff Dalton, and Mikhail Burtsev. 2020. ConvAI3: Generating clarifying questions for open-domain dialogue systems (ClariQ). arXiv preprint arXiv:2009.11352.

[5]

Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeff Dalton, and Mikhail S. Burtsev. 2021. Building and evaluating open-domain dialogue corpora with clarifying questions. In Proceedings of the EMNLP (1). 4473–4484.

[6]

Mohammad Aliannejadi, Hamed Zamani, Fabio Crestani, and W. Bruce Croft. 2019. Asking clarifying questions in open-domain information-seeking conversations. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 475–484.

Digital Library

[7]

Negar Arabzadeh, Fattane Zarrinkalam, Jelena Jovanovic, and Ebrahim Bagheri. 2020. Neural embedding-based metrics for pre-retrieval query performance prediction. In Proceedings of the European Conference on Information Retrieval. 78–85.

Digital Library

[8]

Leif Azzopardi. 2014. Modelling interaction with economic models of search. In Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval. 3–12.

Digital Library

[9]

Leif Azzopardi, Mohammad Aliannejadi, and Evangelos Kanoulas. 2022. Towards building economic models of conversational search. In Proceedings of the ECIR.

Digital Library

[10]

Leif Azzopardi, Mark Girolami, and Keith Van Risjbergen. 2003. Investigating the relationship between language model perplexity and IR precision-recall measures. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval. 369–370.

Digital Library

[11]

James Baird, Nick Redmond, Gregory Harrison, Brian Gebala, and John Kawamoto. 2016. Systems and methods for capturing and reporting metrics regarding user engagement including a canvas model. US Patent 9,390,438. [Access 12 Jul. 2016].

[12]

N. Belkin, Colleen Cool, A. Stein, and U. Thiel. 1995. Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval systems. Expert Systems With Applications 9, 3 (1995), 379–395.

[13]

Nicholas J. Belkin, Colleen Cool, Adelheit Stein, and Ulrich Thiel. 1995. Cases, scripts, and information-seeking strategies: On the design of interactive information retrieval systems. Expert Systems with Applications 9, 3 (1995), 379–395.

[14]

Michael Bendersky, Xuanhui Wang, Donald Metzler, and Marc Najork. 2017. Learning from user interactions in personal search via attribute parameterization. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining.791–799.

Digital Library

[15]

Janek Bevendorff, Benno Stein, Matthias Hagen, and Martin Potthast. 2018. Elastic chatnoir: Search engine for the clueweb and the common crawl. In Proceedings of the European Conference on Information Retrieval. 820–824.

[16]

Pia Borlund. 2003. The IIR evaluation model: A framework for evaluation of interactive information retrieval systems. Information Research 8, 3 (2003), 8–3.

[17]

Pavel Braslavski, Denis Savenkov, Eugene Agichtein, and Alina Dubatovka. 2017. What do you mean exactly? Analyzing clarification questions in CQA. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval. 345–348.

Digital Library

[18]

Viktoriia Chekalina and Alexander Panchenko. 2021. Retrieving comparative arguments using ensemble methods and neural information retrieval. In Proceedings of the Working Notes of CLEF 2021, Vol. 2936. 2354–2365.

[19]

Anni Coden, Daniel Gruhl, Neal Lewis, and Pablo N. Mendes. 2015. Did you mean A or B? Supporting clarification dialog for entity disambiguation. In Proceedings of the SumPre-HSWI@ ESWC.

[20]

Michael J. Cole, Chathra Hendahewa, Nicholas J. Belkin, and Chirag Shah. 2015. User activity patterns during information search. ACM Transactions on Information Systems 33, 1 (2015), 1–39.

Digital Library

[21]

Kevyn Collins-Thompson, Soo Young Rieh, Carl C. Haynes, and Rohail Syed. 2016. Assessing learning outcomes in web search: A comparison of tasks and query strategies. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. 163–172.

Digital Library

[22]

Marco De Boni and Suresh Manandhar. 2003. An analysis of clarification dialogue for question answering. In Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics. 48–55.

Digital Library

[23]

Ashlee Edwards and Diane Kelly. 2017. Engaged or frustrated?: Disambiguating emotional state in search. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.125–134.

Digital Library

[24]

George Ferguson, James F. Allen, and Bradford W. Miller. 1996. TRAINS-95: Towards a mixed-initiative planning assistant. In Proceedings of the AIPS. 70–77.

[25]

Jacek Gwizdka. 2008. Revisiting search task difficulty: Behavioral and individual difference measures. Proceedings of the American Society for Information Science and Technology 45, 1 (2008), 1–12.

[26]

Matthias Hagen, Martin Potthast, Payam Adineh, Ehsan Fatehifar, and Benno Stein. 2017. Source retrieval for web-scale text reuse detection. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 2091–2094.

Digital Library

[27]

Matthias Hagen, Martin Potthast, Michael Völske, Jakob Gomoll, and Benno Stein. 2016. How writers search: Analyzing the search and writing logs of non-fictional essays. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. 193–202.

Digital Library

[28]

Lei Han, Eddy Maddalena, Alessandro Checco, Cristina Sarasua, Ujwal Gadiraju, Kevin Roitero, and Gianluca Demartini. 2020. Crowd worker strategies in relevance judgment tasks. In Proceedings of the 13th International Conference on Web Search and Data Mining. 241–249.

Digital Library

[29]

Shuguang Han, Zhen Yue, and Daqing He. 2015. Understanding and supporting cross-device web search for exploratory tasks with mobile touch interactions. ACM Transactions on Information Systems 33, 4 (2015), 1–34.

Digital Library

[30]

Morgan Harvey and Matthew Pointon. 2017. Searching on the Go: The effects of fragmented attention on mobile web search tasks. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.155–164.

Digital Library

[31]

Helia Hashemi, Hamed Zamani, and W. Bruce Croft. 2020. Guided transformer: Leveraging multiple external sources for representation learning in conversational search. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval.1131–1140.

Digital Library

[32]

Seyyed Hadi Hashemi, Kyle Williams, Ahmed El Kholy, Imed Zitouni, and Paul A. Crook. 2018. Measuring user satisfaction on smart speaker intelligent assistants using intent sensitive query embeddings. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management.1183–1192.

Digital Library

[33]

Chien-Ju Ho and Jennifer Vaughan. 2012. Online task assignment in crowdsourcing markets. In Proceedings of the AAAI Conference on Artificial Intelligence.

[34]

Jeff Huang, Ryen W. White, Georg Buscher, and Kuansan Wang. 2012. Improving searcher models using mouse cursor activity. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval. 195–204.

Digital Library

[35]

Jiepu Jiang and James Allan. 2016. Correlation between system and user metrics in a session. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. 285–288.

Digital Library

[36]

Diane Kelly. 2009. Methods for Evaluating Interactive Information Retrieval Systems with Users. Now Publishers Inc.

Digital Library

[37]

Diane Kelly, Jaime Arguello, Ashlee Edwards, and Wan-Ching Wu. 2015. Development and evaluation of search tasks for IIR experiments using a cognitive complexity framework. In Proceedings of the 2015 International Conference on the Theory of Information Retrieval.101–110.

Digital Library

[38]

Diane Kelly and Leif Azzopardi. 2015. How many results per page? A study of SERP size, search behavior and user experience. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. 183–192.

Digital Library

[39]

Johannes Kiesel, Arefeh Bahrami, Benno Stein, Avishek Anand, and Matthias Hagen. 2018. Toward voice query clarification. In Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. 1257–1260.

Digital Library

[40]

Dae-Young Kim, Xinran Y. Lehto, and Alastair M. Morrison. 2007. Gender differences in online travel information search: Implications for marketing communications on the internet. Tourism Management 28, 2 (2007), 423–433.

[41]

Jeonghyun Kim. 2006. Task difficulty as a predictor and indicator of web searching interaction. In Proceedings of the CHI’06 Extended Abstracts on Human Factors in Computing Systems. 959–964.

Digital Library

[42]

Tae Kyun Kim. 2015. T test as a parametric statistic. Korean Journal of Anesthesiology 68, 6 (2015), 540.

[43]

Julia Kiseleva, Kyle Williams, Jiepu Jiang, Ahmed Hassan Awadallah, Aidan C. Crook, Imed Zitouni, and Tasos Anastasakos. 2016. Understanding user satisfaction with intelligent assistants. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval.121–130.

Digital Library

[44]

Antonios Minas Krasakis, Mohammad Aliannejadi, Nikos Voskarides, and Evangelos Kanoulas. 2020. Analysing the effect of clarifying questions on document ranking in conversational search. In Proceedings of the 2020 ACM SIGIR on International Conference on Theory of Information Retrieval. 129–132.

Digital Library

[45]

Aldo Lipani, Ben Carterette, and Emine Yilmaz. 2021. How am i doing?: Evaluating conversational search systems offline. ACM Transactions on Information Systems 39, 4 (2021), 1–22.

Digital Library

[46]

Mengyang Liu, Jiaxin Mao, Yiqun Liu, Min Zhang, and Shaoping Ma. 2019. Investigating cognitive effects in session-level search user satisfaction. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 923–931.

Digital Library

[47]

Tiziano Piccardi, Miriam Redi, Giovanni Colavizza, and Robert West. 2020. Quantifying engagement with citations on wikipedia. In Proceedings of the Web Conference 2020. 2365–2376.

Digital Library

[48]

Martin Potthast, Sebastian Günther, Janek Bevendorff, Jan Philipp Bittner, Alexander Bondarenko, Maik Fröbe, Christian Kahmann, Andreas Niekler, Michael Völske, and Benno Stein. 2021. The information retrieval anthology. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2550–2555.

Digital Library

[49]

Martin Potthast, Matthias Hagen, Benno Stein, Jan Graßegger, Maximilian Michel, Martin Tippmann, and Clement Welsch. 2012. ChatNoir: A search engine for the ClueWeb09 corpus. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1004–1004.

Digital Library

[50]

Filip Radlinski, Krisztian Balog, Bill Byrne, and Karthik Krishnamoorthi. 2019. Coached conversational preference elicitation: A case study in understanding movie preferences. In Proceedings of the SIGdial. 353–360.

[51]

Filip Radlinski and Nick Craswell. 2017. A theoretical framework for conversational search. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval. 117–126.

Digital Library

[52]

Pengjie Ren, Zhongkun Liu, Xiaomeng Song, Hongtao Tian, Zhumin Chen, Zhaochun Ren, and Maarten de Rijke. 2021. Wizard of search engine: Access to information through conversations with search engines. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 533–543.

Digital Library

[53]

Corbin Rosset, Chenyan Xiong, Xia Song, Daniel Campos, Nick Craswell, Saurabh Tiwary, and Paul Bennett. 2020. Leading conversational search by suggesting useful questions. In Proceedings of The Web Conference 2020. 1160–1170.

Digital Library

[54]

Ivan Sekulic, Mohammad Aliannejadi, and Fabio Crestani. 2021. User engagement prediction for clarification in search. In Proceedings of the European Conference on Informatin Retrieval.

Digital Library

[55]

Ivan Sekulić, Mohammad Aliannejadi, and Fabio Crestani. 2022. Evaluating mixed-initiative conversational search systems via user simulation. In Proceedings of the 15th ACM International Conference on Web Search and Data Mining.

Digital Library

[56]

Ivan Sekulić, Mohammad Aliannejadi, and Fabio Crestani. 2022. Exploiting document-based features for clarification in conversational search. In Proceedings of the European Conference on Information Retrieval.

Digital Library

[57]

Anna Sepliarskaia, Julia Kiseleva, Filip Radlinski, and Maarten de Rijke. 2018. Preference elicitation as an optimization problem. In Proceedings of the 12th ACM Conference on Recommender Systems.172–180.

Digital Library

[58]

Yunqiu Shao, Yiqun Liu, Fan Zhang, Min Zhang, and Shaoping Ma. 2019. On annotation methodologies for image search evaluation. ACM Transactions on Information Systems 37, 3 (2019), 1–32.

Digital Library

[59]

Benno Stein, Tim Gollub, and Dennis Hoppe. 2012. Search result presentation based on faceted clustering. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management. 1940–1944.

Digital Library

[60]

Svetlana Stoyanchev, Alex Liu, and Julia Hirschberg. 2014. Towards natural clarification questions in dialogue systems. In Proceedings of the AISB Symposium on Questions, Discourse and Dialogue, Vol. 20.

[61]

Hock-Hai Teo, Lih-Bin Oh, Chunhui Liu, and Kwok-Kee Wei. 2003. An empirical study of the effects of interactivity on web user attitude. International Journal of Human-computer Studies 58, 3 (2003), 281–305.

[62]

Maartje ter Hoeve, Robert Sim, Elnaz Nouri, Adam Fourney, Maarten de Rijke, and Ryen W. White. 2020. Conversations with documents: An exploration of document-centered assistance. In Proceedings of the 2020 Conference on Human Information Interaction and Retrieval.43–52.

Digital Library

[63]

Johanne R. Trippas, Damiano Spina, Lawrence Cavedon, and Mark Sanderson. 2017. How do people interact in conversational speech-only search tasks: A preliminary analysis. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval. 325–328.

Digital Library

[64]

Pertti Vakkari, Michael Völske, Martin Potthast, Matthias Hagen, and Benno Stein. 2019. Modeling the usefulness of search results as measured by information use. Information Processing & Management 56, 3 (2019), 879–894.

Digital Library

[65]

Alexandra Vtyurina, Denis Savenkov, Eugene Agichtein, and Charles L. A. Clarke. 2017. Exploring conversational search with humans, assistants, and wizards. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2187–2193.

Digital Library

[66]

Zhenduo Wang and Qingyao Ai. 2021. Controlling the risk of conversational search via reinforcement learning. arXiv preprint arXiv:2101.06327.

[67]

Ingmar Weber and Alejandro Jaimes. 2011. Who uses web search for what: and how. In Proceedings of the 4th ACM International Conference on Web Search and Data Mining. 15–24.

Digital Library

[68]

Ryen W. White, Mikhail Bilenko, and Silviu Cucerzan. 2007. Studying the use of popular destinations to enhance web search interaction. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 159–166.

Digital Library

[69]

Lynne J. Williams and Herve Abdi. 2010. Fisher’s least significant difference (LSD) test. Encyclopedia of Research Design 218 (2010), 840–853.

[70]

Zhijing Wu, Ke Zhou, Yiqun Liu, Min Zhang, and Shaoping Ma. 2019. Does diversity affect user satisfaction in image search. ACM Transactions on Information Systems 37, 3 (2019), 1–30.

Digital Library

[71]

Xiaohui Xie, Yiqun Liu, Maarten de Rijke, Jiyin He, Min Zhang, and Shaoping Ma. 2018. Why people search for images using web search engines. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 655–663.

Digital Library

[72]

Jingjing Xu, Yuechen Wang, Duyu Tang, Nan Duan, Pengcheng Yang, Qi Zeng, Ming Zhou, and SUN Xu. 2019. Asking clarification questions in knowledge-based question answering. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. 1618–1629.

[73]

Hamed Zamani, Susan Dumais, Nick Craswell, Paul Bennett, and Gord Lueck. 2020. Generating clarifying questions for information retrieval. In Proceedings of the Web Conference 2020. 418–428.

Digital Library

[74]

Hamed Zamani, Gord Lueck, Everest Chen, Rodolfo Quispe, Flint Luu, and Nick Craswell. 2020. Mimics: A large-scale data collection for search clarification. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management. 3189–3196.

Digital Library

[75]

Hamed Zamani, Bhaskar Mitra, Everest Chen, Gord Lueck, Fernando Diaz, Paul N. Bennett, Nick Craswell, and Susan T. Dumais. 2020. Analyzing and learning from user interactions for search clarification. arXiv preprint arXiv:2006.00166.

[76]

Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, and W. Bruce Croft. 2018. Towards conversational search and recommendation: System ask, user respond. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 177–186.

Digital Library

[77]

Zhiling Zhang and Kenny Q Zhu. 2021. Diverse and specific clarification question generation with keywords. arXiv preprint arXiv:2104.10317.

[78]

Kun Zhou, Wayne Xin Zhao, Hui Wang, Sirui Wang, Fuzheng Zhang, Zhongyuan Wang, and Ji-Rong Wen. 2020. Leveraging historical interaction data for improving conversational recommender system. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management. 2349–2352.

Digital Library

[79]

Jie Zou, Yifan Chen, and Evangelos Kanoulas. 2020. Towards question-based recommender systems. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 881–890.

Digital Library

[80]

Jie Zou and Evangelos Kanoulas. 2019. Learning to ask: Question-based sequential bayesian product search. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 369–378.

Digital Library

[81]

Jie Zou and Evangelos Kanoulas. 2020. Towards question-based high-recall information retrieval: Locating the last few relevant documents for technology-assisted reviews. ACM Transactions on Information Systems 38, 3 (2020), 35 pages.

Digital Library

[82]

Jie Zou, Evangelos Kanoulas, and Yiqun Liu. 2020. An empirical study on clarifying question-based systems. In Proceedings of the 29th ACM International Conference on Information and Knowledge Management. 2361–2364.

Digital Library

[83]

Jie Zou, Dan Li, and Evangelos Kanoulas. 2018. Technology assisted reviews: Finding the last few relevant documents by asking yes/no questions to reviewers. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval.949–952.

Digital Library

Cited By

Menta AGarcia-Serrano A(2024)Reaching quality and efficiency with a parameter-efficient controllable sentence simplification approachComputer Science and Information Systems10.2298/CSIS230912017M21:3(899-921)Online publication date: 2024
https://doi.org/10.2298/CSIS230912017M
Wang ZXu ZSrikumar VAi QChua TNgo CKa-Wei Lee RKumar RLauw H(2024)An In-depth Investigation of User Response Simulation for Conversational SearchProceedings of the ACM Web Conference 202410.1145/3589334.3645447(1407-1418)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645447
Ghosh SGhosh SShah CKlein MBen-David AJäschke RKelly M(2024)Toward Connecting Speech Acts and Search Actions in Conversational Search TasksProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00027(119-131)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1109/JCDL57899.2023.00027
Show More Cited By

Index Terms

Users Meet Clarifying Questions: Toward a Better Understanding of User Interactions for Search Clarification
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. HCI design and evaluation methods
      1. User studies
2. Information systems
  1. Information retrieval
    1. Users and interactive retrieval

Recommendations

Towards Facet-Driven Generation of Clarifying Questions for Conversational Search
ICTIR '21: Proceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval

Clarifying an underlying user information need is an important aspect of a modern-day IR system. The importance of clarification is even higher in limited-bandwidth scenarios, such as conversational or mobile search, where a user is unable to easily ...
Asking Clarifying Questions in Open-Domain Information-Seeking Conversations
SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval

Users often fail to formulate their complex information needs in a single query. As a consequence, they may need to scan multiple result pages or reformulate their queries, which may be a frustrating experience. Alternatively, systems can improve user ...
Asking Clarifying Questions: To benefit or to disturb users in Web search?
Abstract
Modern information-seeking systems are becoming more interactive, mainly through asking Clarifying Questions (CQs) to refine users’ information needs. System-generated CQs may be of different qualities. However, the impact of asking ...
Highlights
- A user study to explore the trajectory effects of showing clarifying questions.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems

ACM Transactions on Information Systems Volume 41, Issue 1

January 2023

759 pages

ISSN:1046-8188

EISSN:1558-2868

DOI:10.1145/3570137

Editor:
Min Zhang
Tsinghua University, China

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 January 2023

Online AM: 21 April 2022

Accepted: 04 March 2022

Revised: 13 January 2022

Received: 21 May 2021

Published in TOIS Volume 41, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Funding Sources

NWO Smart Culture—Big Data/Digital Humanities
NWO Innovational Research Incentives Scheme Vidi
H2020-EU.3.4.—SOCIETAL CHALLENGES—Smart, Green And Integrated Transport

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
1,031
Total Downloads

Downloads (Last 12 months)388
Downloads (Last 6 weeks)49

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Menta AGarcia-Serrano A(2024)Reaching quality and efficiency with a parameter-efficient controllable sentence simplification approachComputer Science and Information Systems10.2298/CSIS230912017M21:3(899-921)Online publication date: 2024
https://doi.org/10.2298/CSIS230912017M
Wang ZXu ZSrikumar VAi QChua TNgo CKa-Wei Lee RKumar RLauw H(2024)An In-depth Investigation of User Response Simulation for Conversational SearchProceedings of the ACM Web Conference 202410.1145/3589334.3645447(1407-1418)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645447
Ghosh SGhosh SShah CKlein MBen-David AJäschke RKelly M(2024)Toward Connecting Speech Acts and Search Actions in Conversational Search TasksProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00027(119-131)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1109/JCDL57899.2023.00027
Liu ZChen ZRen ZGao SMa JRen P(2024)Center-retained fine-tuning for conversational question ranking through unsupervised center identificationInformation Processing and Management: an International Journal10.1016/j.ipm.2023.10357861:2Online publication date: 12-Apr-2024
https://dl.acm.org/doi/10.1016/j.ipm.2023.103578
Landoni MHuibers TMurgia EPera M(2024)Good for Children, Good for All?Advances in Information Retrieval10.1007/978-3-031-56066-8_24(302-313)Online publication date: 24-Mar-2024
https://dl.acm.org/doi/10.1007/978-3-031-56066-8_24
Zou JHuang JRen ZKanoulas E(2022)Learning to Ask: Conversational Product Search via Representation LearningACM Transactions on Information Systems10.1145/355537141:2(1-27)Online publication date: 21-Dec-2022
https://dl.acm.org/doi/10.1145/3555371

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents