Article

Document re-ranking using cluster validation and label propagation

Authors:

Guozheng XiaoAuthors Info & Claims

CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

Pages 690 - 697

https://doi.org/10.1145/1183614.1183713

Published: 06 November 2006 Publication History

Abstract

This paper proposes a novel document re-ranking approach in information retrieval, which is done by a label propagation-based semi-supervised learning algorithm to utilize the intrinsic structure underlying in the large document data. Since no labeled relevant or irrelevant documents are generally available in IR, our approach tries to extract some pseudo labeled documents from the ranking list of the initial retrieval. For pseudo relevant documents, we determine a cluster of documents from the top ones via cluster validation-based k-means clustering; for pseudo irrelevant ones, we pick a set of documents from the bottom ones. Then the ranking of the documents can be conducted via label propagation. Evaluation on benchmark corpora shows that the approach can achieve significant improvement over standard baselines and performs better than other related approaches.

References

[1]

Balinski, J., Danilowicz, C. 2005. Re-ranking Method Based on Inter-document Distance. Information Processing and Management 41(2005) 759--775.

Digital Library

[2]

Bear J., Israel, D., Petit J., Martin D. Using Information Extraction to Improve Document Retrieval. Proceedings of the Sixth Text Retrieval Conference. 1997.

[3]

Belkin, M., & Niyogi, P. 2002. Using Manifold Structure for Partially Labeled Classification. Advances in Neural Information Processing Systems 15.

[4]

Crouch, C., Crouch, D., Chen, Q. and Holtz, S. 2002. Improving the Retrieval Effectiveness of Very Short Queries. Information Processing and Management, 38(2002).

Digital Library

[5]

Diaz, F., Regularizing Ad Hoc Retrieval Scores. In the Proceedings of the Fourteenth International Conference on Information and Knowledge Management (CIKM), 2005.

Digital Library

[6]

Kamps, J. 2004. Improving Retrieval Effectiveness by Reranking Documents Based on Controlled Vocabulary. The 21th European Conference on In-formation Retrieval.

[7]

Kurland O., Lee L. 2005. PageRank without Hyper-links: Structural Re-ranking using Links Induced by Language models. In the Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.

Digital Library

[8]

Lee K., Park Y., Choi, K. S. 2001. Document Re-ranking Model Using Clusters. Information Processing and Management. V. 37 n.1, p1--14.

Digital Library

[9]

Lin, J. 1991. Divergence Measures Based on the Shannon Entropy. IEEE Transactions on Information Theory, 37:1, 145--150.

Digital Library

[10]

Liu, X.Y and Croft W.B, 2004. Cluster Based Retrieval Using Language Models. In Proceedings of SIGIR, pp. 186--193.

Digital Library

[11]

Luk, R. W. P., Wong, K. F. 2004. Pseudo-Relevance Feedback and Title Re-Ranking for Chinese IR. In Proceedings of NTCIR Workshop 4.

[12]

M. Mitra., A. Singhal. and C. Buckley. 1998. Improving Automatic Query Expansion. In Proc. ACM SIGIR'98.

Digital Library

[13]

Niu Z. Y., Ji D. H., and Tan C. L. 2005. Word Sense Disambiguation Using Label Propagation Based Semi-supervised Learning. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL05), Ann Arbor, Michigan, US, pp.395--402.

Digital Library

[14]

Niu Z. Y., Ji D. H., and Tan C. L. 2004. Document Clustering based on Cluster Validation. In Proceedings of the 13th ACM International Conference on Information and Knowledge Management (CIKM-2004), Washington, DC, USA, pp.501--506.

Digital Library

[15]

Qu, Y. L., Xu, G. W., Wang J. 2000. Rerank Method Based on Individual Thesaurus. Proceedings of NTCIR2 Workshop.

[16]

Szummer, M., & Jaakkola, T. 2001. Partially Labeled Classification with Markov Random Walks. Advances in Neural Information Processing Systems 14.

[17]

Xu J., Croft, W. B. 1996. Query Expansion Using Local and Global Document Analysis. In Proc. ACM SIGIR'96.

Digital Library

[18]

Xu J., Croft, W. B. 2000. Improving the Effectiveness of Information Retrieval with Local Context Analysis. ACM Transactions on Information Systems, 18(1):79--112, 2000.

Digital Library

[19]

Yang L. P., Ji D. H. 2005(a). Chinese Information Retrieval Based on Terms and Relevant terms. ACM Transactions on Asian Language Information Processing. Vol. 4, Issue 3 (2005). pp. 357--374.

Digital Library

[20]

Yang L.P. Ji D.H. and Leong M.K. 2005(b). Chinese Document Re-ranking Based on Term Distribution and Maximal Marginal Relevance. Second Asia Information Retrieval Symposium (AIRS 2005). LNCS 3689, Pp. 299--311.

Digital Library

[21]

Zhang B. Y, .Li H., Liu Y., Ji L., Xi W., Fan W., Chen Z., Ma W. 2005. Improving Search Results using Affinity Graph. In the Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.

Digital Library

[22]

Zhu, X. & Ghahramani, Z. 2002. Learning from Labeled and Unlabeled Data with Label Propagation. CMU CALD technical report CMU-CALD-02-107.

[23]

Zhu, X., Ghahramani, Z., & Lafferty, J. 2003. Semi-Supervised Learning Using Gaussian Fields and Harmonic Functions. In Proceedings of the 20th International Conference on Machine Learning.

Digital Library

Cited By

Roitman HRabinovich ESar Shalom OLee DSastry NWeber I(2018)As Stable As You AreProceedings of the 29th on Hypertext and Social Media10.1145/3209542.3209567(33-37)Online publication date: 3-Jul-2018
https://dl.acm.org/doi/10.1145/3209542.3209567
Levi OGuy IRaiber FKurland O(2018)Selective Cluster Presentation on the Search Results PageACM Transactions on Information Systems10.1145/315867236:3(1-42)Online publication date: 28-Feb-2018
https://dl.acm.org/doi/10.1145/3158672
Zhao WZhou D(2017)A Normalized Framework Based on Multiple Relationships for Document Re-rankingInformation Retrieval10.1007/978-3-319-68699-8_10(122-135)Online publication date: 21-Oct-2017
https://doi.org/10.1007/978-3-319-68699-8_10
Show More Cited By

Index Terms

Document re-ranking using cluster validation and label propagation
1. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals
      1. Clustering and classification
  2. Information systems applications
    1. Data mining
      1. Clustering

Recommendations

A Study on Pseudo Labeled Document Constructed for Document Re-ranking
AICI '09: Proceedings of the 2009 International Conference on Artificial Intelligence and Computational Intelligence - Volume 03

Document re-ranking is a middle module in information retrieval system. It’s expected that more relevant documents with query appear in higher rankings, from which automatic query expansion can benefit, and it aims at improving the performance of the ...
Semi-supervised partial label learning algorithm via reliable label propagation
Abstract
Partial label learning (PLL) is a weakly supervised learning method that is able to predict one label as the correct answer from a given candidate label set. In PLL, when all possible candidate labels are as signed to real-world training examples, ...
Exploration of query context for information retrieval
WWW '07: Proceedings of the 16th international conference on World Wide Web

A number of existing information retrieval systems propose the notion of query context to combine the knowledge of query and user into retrieval to reveal the most exact description of user's information needs. In this paper we interpret query context ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

November 2006

916 pages

ISBN:1595934332

DOI:10.1145/1183614

General Chair:
Philip S. Yu
IBM T.J. Watson Research Center (USA)
,
Program Chairs:
Vassilis Tsotras
University of California-Riverside (USA)
,
Edward Fox
Virginia Tech (USA)
,
Bing Liu
University of Illinois at Chicago (USA)

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CIKM06

Sponsor:

CIKM06: Conference on Information and Knowledge Management

November 6 - 11, 2006

Virginia, Arlington, USA

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
857
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Roitman HRabinovich ESar Shalom OLee DSastry NWeber I(2018)As Stable As You AreProceedings of the 29th on Hypertext and Social Media10.1145/3209542.3209567(33-37)Online publication date: 3-Jul-2018
https://dl.acm.org/doi/10.1145/3209542.3209567
Levi OGuy IRaiber FKurland O(2018)Selective Cluster Presentation on the Search Results PageACM Transactions on Information Systems10.1145/315867236:3(1-42)Online publication date: 28-Feb-2018
https://dl.acm.org/doi/10.1145/3158672
Zhao WZhou D(2017)A Normalized Framework Based on Multiple Relationships for Document Re-rankingInformation Retrieval10.1007/978-3-319-68699-8_10(122-135)Online publication date: 21-Oct-2017
https://doi.org/10.1007/978-3-319-68699-8_10
Levi ORaiber FKurland OGuy IMukhopadhyay SZhai CBertino ECrestani FMostafa JTang JSi LZhou XChang YLi YSondhi P(2016)Selective Cluster-Based Document RetrievalProceedings of the 25th ACM International on Conference on Information and Knowledge Management10.1145/2983323.2983737(1473-1482)Online publication date: 24-Oct-2016
https://dl.acm.org/doi/10.1145/2983323.2983737
Kılınç DYücalar FBorandağ EAslan E(2016)Multi-level reranking approach for bug localizationExpert Systems: The Journal of Knowledge Engineering10.1111/exsy.1215033:3(286-294)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1111/exsy.12150
Raiber FKurland ORadlinski FShokouhi MAllan JCroft Bde Vries AZhai C(2015)Learning Asymmetric Co-RelevanceProceedings of the 2015 International Conference on The Theory of Information Retrieval10.1145/2808194.2809454(281-290)Online publication date: 27-Sep-2015
https://dl.acm.org/doi/10.1145/2808194.2809454
Zoidi OFotiadou ENikolaidis NPitas I(2015)Graph-Based Label Propagation in Digital MediaACM Computing Surveys10.1145/270038147:3(1-35)Online publication date: 1-Apr-2015
https://dl.acm.org/doi/10.1145/2700381
Kurland O(2014)The Cluster Hypothesis in Information RetrievalProceedings of the 36th European Conference on IR Research on Advances in Information Retrieval - Volume 841610.1007/978-3-319-06028-6_105(823-826)Online publication date: 13-Apr-2014
https://dl.acm.org/doi/10.1007/978-3-319-06028-6_105
Lee KCroft W(2013)A deterministic resampling method using overlapping document clusters for pseudo-relevance feedbackInformation Processing and Management: an International Journal10.1016/j.ipm.2013.01.00149:4(792-806)Online publication date: 1-Jul-2013
https://dl.acm.org/doi/10.1016/j.ipm.2013.01.001
Raiber FKurland OChen XLebanon GWang HZaki M(2012)Exploring the cluster hypothesis, and cluster-based retrieval, over the webProceedings of the 21st ACM international conference on Information and knowledge management10.1145/2396761.2398678(2507-2510)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1145/2396761.2398678
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents