research-article

Expertise drift and query expansion in expert search

Authors:

Craig Macdonald,

Iadh OunisAuthors Info & Claims

CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management

Pages 341 - 350

https://doi.org/10.1145/1321440.1321490

Published: 06 November 2007 Publication History

Abstract

Pseudo-relevance feedback, or query expansion, has been shown to improve retrieval performance in the adhoc retrieval task. In such a scenario, a few top-ranked documents are assumed to be relevant, and these are then used to expand and refine the initial user query, such that it retrieves a higher quality ranking of documents. However, there has been little work in applying query expansion in the expert search task. In this setting, query expansion is applied by assuming a few top-ranked candidates have relevant expertise, and using these to expand the query. Nevertheless, retrieval is not improved as expected using such an approach. We show that the success of the application of query expansion is hindered by the presence of topic drift within the profiles of experts that the system considers. In this work, we demonstrate how topic drift occurs in the expert profiles, and moreover, we propose three measures to predict the amount of drift occurring in an expert's profile. Finally, we suggest and evaluate ways of enhancing query expansion in expert search using our new insights. Our results show that, once topic drift has been anticipated, query expansion can be successfully applied in a general manner in the expert search task.

References

[1]

G. Amati. Probabilistic Models for Information Retrieval based on Divergence from Randomness. PhD thesis, Univ. of Glasgow, 2003.

[2]

E. Amitay, D. Carmel, A. Darlow, M. Herscovici, R. Lempel, A. Soffer, R. Kraft, and J. Y. Zien. Juru at TREC 2003 - Topic Distillation using Query-Sensitive Tuning and Cohesiveness Filtering. In TREC 2003, pages 276--282.

[3]

K. Balog, L. Azzopardi, and M. de Rijke. Formal models for expert finding in enterprise corpora. In Proceedings of SIGIR 2006, pages 43--50.

Digital Library

[4]

Y. Cao, H. Li, J. Liu, and S. Bao. Research on Expert Search at Enterprise Track of TREC 2005. In Proceedings of TREC 2005.

[5]

N. Craswell, A. P. de Vries, and I. Soboroff Overview of the TREC-2005 Enterprise Track. In Proceedings of TREC 2005.

[6]

N. Craswell, and D. Hawking. Overview of the TREC-2002 Web Track. In Proceedings of TREC 2002.

[7]

N. Craswell, D. Hawking, A.-M. Vercoustre, and P. Wilkins. Panoptic expert: Searching for experts not just for documents. In Ausweb Poster Proceedings, 2001.

[8]

M. Hertzum and A. M. Pejtersen. The information-seeking practices of engineers: searching for documents as well as for people. Inf. Process. Manage., 36(5):761--778, 2000.

Digital Library

[9]

J. Lin. Divergence measures based on the Shannon entropy. Information Theory, IEEE Transactions on, 37(1):145--151, 1991.

Digital Library

[10]

C. Macdonald, B. He, V. Plachouras, and I. Ounis. University of Glasgow at TREC 2005: Experiments in Terabyte and Enterprise tracks with Terrier. In Proceedings of TREC 2005.

[11]

C. Macdonald and I. Ounis. Voting for candidates: Adapting Data Fusion techniques for an Expert Search task. In Proceedings of CIKM 2006.

Digital Library

[12]

C. Macdonald and I. Ounis. Using relevance feedback in expert search. In Proceedings of ECIR 2007, pages 431--443, LNCS, Springer.

Digital Library

[13]

I. Ounis, G. Amati, V. Plachouras, B. He, C. Macdonald, and C. Lioma. Terrier: A high performance and scalable information retrieval platform. In Proceedings of OSIR Workshop 2006, pages 18--25.

[14]

D. Petkova and W. B. Croft. Hierarchical language models for expert finding in enterprise corpora. Proceedings of ICTAI 2006, pages 599--608.

Digital Library

[15]

S. Robertson and S. Walker. Okapi/Keenbow at TREC-8. In Proceedings of TREC 8, 2000.

[16]

J. J. Rocchio. Relevance Feedback in Information Retrieval. Prentice-Hall, 1971.

[17]

X. Shen and C. Zhai. Active feedback in ad hoc information retrieval. In Proceedings of SIGIR 2005, pages 59--66.

Digital Library

[18]

I. Soboroff, A. P. de Vries, and N. Craswell. Overview of the TREC-2006 Enterprise Track. In Proceedings of TREC 2006.

[19]

J. Xu and W. B. Croft. Improving the effectiveness of information retrieval with local context analysis. ACM Trans. Inf. Syst., 18(1):79--112, 2000.

Digital Library

[20]

E. Yom-Tov, S. Fine, D. Carmel, and A. Darlow. Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval. In Proceedings of SIGIR 2005, pages 512--519.

Digital Library

Cited By

Kostric IBalog KHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)A Surprisingly Simple yet Effective Multi-Query Rewriting Method for Conversational Passage RetrievalProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657933(2271-2275)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657933
Chandra GDwivedi S(2024)Query Expansion Using Proposed Location-Based Algorithm for Hindi–English CLIR: Analyzing Three Test CollectionsInternational Journal of Pattern Recognition and Artificial Intelligence10.1142/S021800142459001838:05Online publication date: 11-May-2024
https://doi.org/10.1142/S0218001424590018
Selmi WKammoun HAmous I(2022)Semantic-Based Hybrid Query Reformulation for Biomedical Information RetrievalThe Computer Journal10.1093/comjnl/bxac07866:9(2296-2316)Online publication date: 2-Jul-2022
https://doi.org/10.1093/comjnl/bxac078
Show More Cited By

Index Terms

Expertise drift and query expansion in expert search
1. Information systems
  1. Information retrieval
    1. Users and interactive retrieval
      1. Personalization
  2. World Wide Web
    1. Web searching and information discovery
      1. Personalization

Recommendations

Voting techniques for expert search

In an expert search task, the users' need is to identify people who have relevant expertise to a topic of interest. An expert search system predicts and ranks the expertise of a set of candidate persons with respect to the users' query. In this paper, ...
Query-drift prevention for robust query expansion
SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval

Pseudo-feedback-based automatic query expansion yields effective retrieval performance on average, but results in performance inferior to that of using the original query for many information needs. We address an important cause of this robustness issue,...
Query expansion based on term distribution and DBpedia features
Highlights
- Query expansion based on term distribution is better than Pseudo Relevance Feedback.
Abstract
Query Expansion (QE) approaches that involve the reformulation of queries by adding new terms to the initial user query, are intended to ameliorate the vocabulary mismatch between the query keywords and the documents’ in Information ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management

November 2007

1048 pages

ISBN:9781595938039

DOI:10.1145/1321440

Co-chair:
Alberto H. F. Laender,
Conference Chairs:
André O. Falcão
Universidade de Lisboa, Portugal
,
Øystein Haug Olsen,
General Chair:
Mário J. Silva
(Universidade de Lisboa, Portugal)
,
Program Chairs:
Ricardo Baeza-Yates,
Deborah L. McGuinness,
Bjorn Olstad

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIKM07

Sponsor:

CIKM07: Conference on Information and Knowledge Management

November 6 - 10, 2007

Lisbon, Portugal

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

68
Total Citations
View Citations
612
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kostric IBalog KHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)A Surprisingly Simple yet Effective Multi-Query Rewriting Method for Conversational Passage RetrievalProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657933(2271-2275)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657933
Chandra GDwivedi S(2024)Query Expansion Using Proposed Location-Based Algorithm for Hindi–English CLIR: Analyzing Three Test CollectionsInternational Journal of Pattern Recognition and Artificial Intelligence10.1142/S021800142459001838:05Online publication date: 11-May-2024
https://doi.org/10.1142/S0218001424590018
Selmi WKammoun HAmous I(2022)Semantic-Based Hybrid Query Reformulation for Biomedical Information RetrievalThe Computer Journal10.1093/comjnl/bxac07866:9(2296-2316)Online publication date: 2-Jul-2022
https://doi.org/10.1093/comjnl/bxac078
Zeng HHong ZLiu JWei B(2021)Multi-task Learning for Multi-turn Dialogue Generation with Topic Drift Modeling2021 IEEE International Conference on Big Knowledge (ICBK)10.1109/ICKG52313.2021.00061(410-417)Online publication date: Dec-2021
https://doi.org/10.1109/ICKG52313.2021.00061
Bendella MQuafafou M(2021)Leveraging Closed Patterns and Formal Concept Analysis for Enhanced Microblogs RetrievalComplex Data Analytics with Formal Concept Analysis10.1007/978-3-030-93278-7_7(151-166)Online publication date: 8-Dec-2021
https://doi.org/10.1007/978-3-030-93278-7_7
Chandra GDwivedi S(2020)Term Ordering-Based Query Expansion Technique for Hindi-English CLIR SystemHandling Priority Inversion in Time-Constrained Distributed Databases10.4018/978-1-7998-2491-6.ch016(283-302)Online publication date: 2020
https://doi.org/10.4018/978-1-7998-2491-6.ch016
Sharma DPamula RChauhan D(2020)A contemporary combined approach for query expansionMultimedia Tools and Applications10.1007/s11042-020-09172-281:24(35195-35221)Online publication date: 3-Jul-2020
https://doi.org/10.1007/s11042-020-09172-2
Raiber FKurland O(2019)Relevance FeedbackACM Transactions on Information Systems10.1145/336048737:4(1-28)Online publication date: 4-Oct-2019
https://dl.acm.org/doi/10.1145/3360487
Sharma DPamula RChauhan D(2019)Combined techniques based query expansion approach for document retrieval system2019 International Conference on contemporary Computing and Informatics (IC3I)10.1109/IC3I46837.2019.9055709(101-105)Online publication date: Dec-2019
https://doi.org/10.1109/IC3I46837.2019.9055709
Li GDong MYang FZeng JYuan JJin CHung NCong PZheng B(2019)Misinformation-oriented expert finding in social networksWorld Wide Web10.1007/s11280-019-00717-623:2(693-714)Online publication date: 23-Aug-2019
https://doi.org/10.1007/s11280-019-00717-6
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents