article

Eliciting better information need descriptions from users of information search systems

Authors:

Xin FuAuthors Info & Claims

Information Processing and Management: an International Journal, Volume 43, Issue 1

Pages 30 - 46

https://doi.org/10.1016/j.ipm.2006.03.006

Published: 01 January 2007 Publication History

Abstract

In this paper we investigate the effectiveness of a technique for eliciting more robust information need descriptions from users of information systems. We propose that such a technique can be used to elicit terms from users for use in query expansion and as a follow-up when ambiguous queries are initially posed. We design a feedback form to obtain additional information from users, administer the form to users after initial querying, and create a series of experimental runs based on the information that we obtained from the form. Results demonstrate that the form was successful at eliciting more information from users and that this additional information significantly improved retrieval performance. Our results further demonstrate a strong relationship between query length and performance.

References

[1]

Ahlberg, C., Williamson, C., & Shneiderman, B. (1992). Dynamic queries for information exploration: an implementation and evaluation. In Proceedings of the ACM conference on human-computer interaction (CHI'92) (pp. 619-626).

[2]

Allan, J. (2005). HARD Track overview in TREC 2004 high accuracy retrieval from documents. In E. M. Voorhees & L. P. Buckland (Eds.), TREC-2004, Proceedings of the thirteenth text retrieval conference. Washington, DC: Government Printing Office.

[3]

Anick, P. (2003). Using terminological feedback for web search refinement: a log based study. In Proceedings of the 26th annual ACM international conference on research and development in information retrieval (SIGIR'03) (pp. 88-95), Toronto, CA.

[4]

Beaulieu, M. (1997). Experiments on interfaces to support query expansion. Journal of Documentation, 53(1), 8-19.

[5]

Belkin, N. J. (1980). Anomalous states of knowledge as a basis for information retrieval. Canadian Journal of Information Science, 5, 133-143.

[6]

Belkin, N. J. (2000). Helping people find what they don't know. Communications of the ACM, 43(8), 58-61.

Digital Library

[7]

Belkin, N. J., Cool, C., Croft, W. B., & Callan, J. P. (1993). The effect of multiple query representations on information retrieval system performance. In Proceedings of the 16th annual ACM international conference on research and development in information retrieval (SIGIR'93) (pp. 339-346), Pittsburgh PA, USA.

[8]

Belkin, N. J., Cool, C., Kelly, D., Lee, H.-J., Muresan, G., Tang, M.-C., et al. (2003). Query length in interactive information retrieval. In Proceedings of the 26th annual ACM international conference on research and development in information retrieval (SIGIR'03) (pp. 205-212), Toronto, CA.

[9]

Belkin, N. J., Cool, C., Kelly, D., Lin, S. J., Park, S. Y., Perez-Carballo, J., et al. (2001). Iterative exploration, design and evaluation of support for query reformulation in interactive information retrieval. Information Processing & Management, 37(3), 404-434.

Digital Library

[10]

Belkin, N. J., Jeng, J., Keller, A., Kelly, D., Kim, J., Lee, H.-J., et al. (2002). Rutgers' TREC 2001 interactive track experience. In E. M. Voorhees & D. K. Harman (Eds.), The tenth text retrieval conference, TREC 2001. Washington, DC: GPO.

[11]

Bennett, J. L. (1972). The user interface in interactive systems. Annual Review of Information Science & Technology, 7, 159-196.

[12]

Blair, D. C., & Kimbrough, S. O. (2002). Exemplary documents: a foundation for information retrieval design. Information Processing & Management, 38(3), 363-379.

Digital Library

[13]

Brajnik, G., Guida, G., & Tasso, C. (1987). User modeling in intelligent information retrieval. Information Processing & Management, 23(4), 305-320.

Digital Library

[14]

Buckley, C., Salton, G., & Allan, J. (1994). The effect of adding relevance information in a relevance feedback environment. In Proceedings of the 17th annual ACM international conference on research and development in information retrieval (SIGIR'94) (pp. 292-300), Dublin, UK.

[15]

Cole, C. (1998). Intelligent information retrieval: diagnosing information need. Part I. The theoretical framework for developing an intelligent IR tool. Information Processing & Management, 34(6), 709-720.

Digital Library

[16]

Crestani, F. (2002). Spoken query processing for interactive information retrieval. Data and Knowledge Engineering, 41(1), 105-124.

Digital Library

[17]

Croft, W. B. & Das, R. (1990). Experiments with query acquisition and use in document retrieval systems. In Proceedings of the 13th annual ACM international conference on research and development in information retrieval (SIGIR'90) (pp. 349-368), Brussels, Belgium.

[18]

Croft, W. B., &; Thompson, R. H. (1987). I³R: a new approach to the design of document retrieval systems. Journal of the American Society for Information Science, 38, 389-404.

Digital Library

[19]

Cronen-Townsend, S., Zhou, Y., & Croft, W. B. (2002). Predicting query performance. In Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR'02) (pp. 299-306), Tampere, Finland.

[20]

Dekleva, S. M. (1994). Is natural language querying practical? ACM SIGMIS Database, 25(2), 24-36.

Digital Library

[21]

Dewdney, P., & Michell, G. (1997). Asking "why" questions in the reference interview: a theoretical justification. Library Quarterly, 67(1), 50-71.

[22]

Efthimiadis, E. N. (1996). Query expansion. Annual Review of Information Science & Technology, 31, 121-187.

[23]

{23} Furnas, G. W., Landauer, T. K., Gomez, L. M., & Dumais, S. T. (1987). The vocabulary problem in human-system communication: an analysis and a solution. Communications of the ACM, 30(11), 964-971.

Digital Library

[24]

Gilbert, J. E., & Zhong, Y. (2003). Speech user interfaces for information retrieval. In Proceedings of the twelfth international conference on information and knowledge management (CIKM'03) (pp. 77-82), New Orleans, LA, USA.

[25]

Grunfeld, L., Kwok, K. L., Dinstl, N., & Deng, P. (2004). TREC2003 robust, HARD and QA track experiments using PIRCS. In E. Voorhees & L. P. Buckland (Eds.), TREC-2003, Proceedings of the twelfth text retrieval conference. Washington, DC: Government Printing Office.

[26]

Harman, D. (1988). Towards interactive query expansion. In Proceedings of the 11th annual ACM international conference on research and development in information retrieval (SIGIR'88) (pp. 321-333), Grenoble.

[27]

Ingwersen, P. (1982). Search procedures in the library analyzed from the cognitive point of view. Journal of Documentation, 38, 165-191.

[28]

Ingwersen, P. (1996). Cognitive perspectives of information retrieval interaction: elements of a cognitive IR theory. Journal of Documentation, 52(1), 3-50.

[29]

Jansen, B. J., Spink, A., & Saracevic, T. (2000). Real life, real users, and real needs: a study and analysis of user queries on the web. Information Processing & Management, 36, 207-227.

Digital Library

[30]

Kalgren, J., & Franzen, K. (1997). Verbosity and interface design. Retrieved on 30 September 2005 at http://www.ling.su.se/staff/franzen/ irinterface.html.

[31]

Katz, W. A. (2002) (8th ed.). Introduction to reference work: reference services and reference processes(Vol. 2). New York: McGraw-Hill.

[32]

Kelly, D., Dollu, V. J., & Fu, X. (2005). The loquacious user: a document-independent source of terms for query expansion. In Proceedings of the 28th annual ACM international conference on research and development in information retrieval (SIGIR'05) (pp. 457-464), Salvador, Brazil.

[33]

Marsteller, M. R., & Mizzy, D. (2003). Exploring the synchronous digital reference interaction for query types, question negotiation, and patron response. Internet Reference Services Quarterly, 8(1-2), 149-165.

[34]

Robertson, S. E., Walker, S., Jones, S., Hancock-Beaulieu, M. M., & Gatford, M. (1995). Okapi at TREC-3. In D. Harman (Ed.), TREC-3, Proceedings of the third text retrieval conference. Washington, DC: Government Printing Office.

[35]

Ruthven, I. (2003). Re-examining the potential effectiveness of interactive query expansion. In Proceedings of the 26th annual ACM international conference on research and development in information retrieval (SIGIR'03) (pp. 213-220), Toronto, CA.

[36]

Saracevic, T., Mokros, H., & Su, L. (1990). Nature of interaction between users and search intermediaries in online searching: a qualitative analysis. In Proceedings of the annual meeting on the American society for information science (ASIS'90) (pp. 47-54).

[37]

Spink, A. (1994). Term relevance feedback and query expansion: relation to design. In Proceedings of the 17th annual ACM international conference on research and development in information retrieval (SIGIR'94) (pp. 81-90), Dublin, Ireland.

[38]

Taylor, R. S. (1968). Question negotiation and information seeking in libraries. College & Research Libraries, 29(3), 178-194.

[39]

Turtle, H. (1994). Natural language vs. Boolean query evaluation: a comparison of retrieval performance. In Proceedings of the 17th annual international ACM SIGIR conference on research and development in information retrieval (SIGIR'90) (pp. 212-220), Dublin, Ireland.

[40]

Vickery, A., & Brooks, H. M. (1987). PLEXUS: the expert system for referral. Information Processing & Management, 23(2), 99-117.

Digital Library

[41]

Voorhees, E. M. (2005). Overview of TREC 2004. In E. M. Voorhees & L. P. Buckland (Eds.), TREC-2004, Proceedings of the thirteenth text retrieval conference. Washington, DC: Government Printing Office.

[42]

White, M. D. (1998). Questions in reference interviews. Journal of Documentation, 54(4), 443-465.

Cited By

Shah CBender E(2024)Envisioning Information Access Systems: What Makes for Good Tools and a Healthy Web?ACM Transactions on the Web10.1145/364946818:3(1-24)Online publication date: 26-Feb-2024
https://dl.acm.org/doi/10.1145/3649468
Papenmeier AKern DHienert DSliwa AAker AFuhr NScholer FThomas PElsweiler DJoho HKando NSmith C(2021)Starting Conversations with Search Engines - Interfaces that Elicit Natural Language QueriesProceedings of the 2021 Conference on Human Information Interaction and Retrieval10.1145/3406522.3446035(261-265)Online publication date: 14-Mar-2021
https://dl.acm.org/doi/10.1145/3406522.3446035
Paisalnan SPollick FMoshfeghi Y(2021)Towards Understanding Neuroscience of Realisation of Information Need in Light of Relevance and Satisfaction JudgementMachine Learning, Optimization, and Data Science10.1007/978-3-030-95467-3_3(41-56)Online publication date: 4-Oct-2021
https://dl.acm.org/doi/10.1007/978-3-030-95467-3_3
Show More Cited By

Index Terms

Eliciting better information need descriptions from users of information search systems

Recommendations

A theory of information need for information retrieval that connects information to knowledge

This article proposes a theory of information need for information retrieval (IR). Information need traditionally denotes the start state for someone seeking information, which includes information search using an IR system. There are two perspectives ...
Vertical and horizontal relationships amongst task-based information needs
Highlights
- Information needs are described as task-based activities.
- Task-based ...
Abstract
In this article, we present a conceptual framework of information needs for task-based information studies. The framework accounts for both vertical and horizontal relationships between information needs as fluid activities in work-...
Intelligent browser for TEXPROS
IIS '97: Proceedings of the 1997 IASTED International Conference on Intelligent Information Systems (IIS '97)

Browsing is a technique which is employed in information retrieval systems to help users formulate their queries and retrieve information. This technique provides users with capabilities of understanding their information needs and gaining system ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Information Processing and Management: an International Journal

Information Processing and Management: an International Journal Volume 43, Issue 1

January 2007

294 pages

ISSN:0306-4573

Issue’s Table of Contents

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 January 2007

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shah CBender E(2024)Envisioning Information Access Systems: What Makes for Good Tools and a Healthy Web?ACM Transactions on the Web10.1145/364946818:3(1-24)Online publication date: 26-Feb-2024
https://dl.acm.org/doi/10.1145/3649468
Papenmeier AKern DHienert DSliwa AAker AFuhr NScholer FThomas PElsweiler DJoho HKando NSmith C(2021)Starting Conversations with Search Engines - Interfaces that Elicit Natural Language QueriesProceedings of the 2021 Conference on Human Information Interaction and Retrieval10.1145/3406522.3446035(261-265)Online publication date: 14-Mar-2021
https://dl.acm.org/doi/10.1145/3406522.3446035
Paisalnan SPollick FMoshfeghi Y(2021)Towards Understanding Neuroscience of Realisation of Information Need in Light of Relevance and Satisfaction JudgementMachine Learning, Optimization, and Data Science10.1007/978-3-030-95467-3_3(41-56)Online publication date: 4-Oct-2021
https://dl.acm.org/doi/10.1007/978-3-030-95467-3_3
Moshfeghi YPollick F(2019)Neuropsychological model of the realization of information needJournal of the Association for Information Science and Technology10.1002/asi.2424270:9(954-967)Online publication date: 2-Aug-2019
https://dl.acm.org/doi/10.1002/asi.24242
Tamine LDaoud M(2018)Evaluation in Contextual Information RetrievalACM Computing Surveys10.1145/320494051:4(1-36)Online publication date: 25-Jul-2018
https://dl.acm.org/doi/10.1145/3204940
Azzopardi LZuccon GCarterette BFang HLalmas MNie J(2016)An Analysis of the Cost and Benefit of Search InteractionsProceedings of the 2016 ACM International Conference on the Theory of Information Retrieval10.1145/2970398.2970412(59-68)Online publication date: 12-Sep-2016
https://dl.acm.org/doi/10.1145/2970398.2970412
Moshfeghi YTriantafillou PPollick FPerego RSebastiani FAslam JRuthven IZobel J(2016)Understanding Information NeedProceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval10.1145/2911451.2911534(335-344)Online publication date: 7-Jul-2016
https://dl.acm.org/doi/10.1145/2911451.2911534
Harvey MHauff CElsweiler DBaeza-Yates RLalmas MMoffat ARibeiro-Neto B(2015)Learning by ExampleProceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/2766462.2767731(133-142)Online publication date: 9-Aug-2015
https://dl.acm.org/doi/10.1145/2766462.2767731
Abbasi MFrommholz I(2015)Cluster-based polyrepresentation as science modelling approach for information retrievalScientometrics10.1007/s11192-014-1478-1102:3(2301-2322)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1007/s11192-014-1478-1
Hoenkamp EBruza P(2015)How everyday language can and will boost effective information retrievalJournal of the Association for Information Science and Technology10.1002/asi.2327966:8(1546-1558)Online publication date: 1-Aug-2015
https://dl.acm.org/doi/10.1002/asi.23279
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents