Article

Measure-based metasearch

Authors:

SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval

Pages 571 - 572

https://doi.org/10.1145/1076034.1076133

Published: 15 August 2005 Publication History

Get Access

Abstract

We propose a simple method for converting many standard measures of retrieval performance into metasearch algorithms. Our focus is both on the analysis of retrieval measures themselves and on the development of new metasearch algorithms. Given the conversion method proposed, our experimental results using TREC data indicate that system-oriented measures of overall retrieval performance (such as average precision) yield good metasearch algorithms whose performance equals or exceeds that of benchmark techniques such as CombMNZ and Condorcet.

References

[1]

E. A. Fox and J. A. Shaw. Combination of multiple searches. In The Second Text REtrieval Conference (TREC-2), pages 243--249, Gaithersburg, MD, USA, Mar. 1994. U.S. Government Printing Office, Washington D.C.

Google Scholar

[2]

J. H. Lee. Analyses of multiple evidence combination. In Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 267--275, Philadelphia, Pennsylvania, USA, July 1997. ACM Press, New York.

Digital Library

Google Scholar

[3]

M. Montague and J. A. Aslam. Condorcet fusion for improved retrieval. In Proceedings of the Eleventh International Conference on Information and Knowledge Management, pages 538--548. ACM Press, November 2002.

Digital Library

Google Scholar

Cited By

View all

Bin-Hezam RStevenson MHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)RLStop: A Reinforcement Learning Stopping Method for TARProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657911(2604-2608)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657911
Stevenson MBin-Hezam R(2023)Stopping Methods for Technology-assisted Reviews Based on Point ProcessesACM Transactions on Information Systems10.1145/363199042:3(1-37)Online publication date: 29-Dec-2023
https://dl.acm.org/doi/10.1145/3631990
Rashidi LZobel JMoffat A(2023)The Impact of Judgment Variability on the Consistency of Offline Effectiveness MeasuresACM Transactions on Information Systems10.1145/359651142:1(1-31)Online publication date: 18-Aug-2023
https://dl.acm.org/doi/10.1145/3596511
Show More Cited By

Index Terms

Measure-based metasearch
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

Supporting metasearch with XSL
Special issue: Performance modeling and analysis of computer systems and networks

Metasearch engines offer better coverage and are more fault-tolerant and expandable than single search engines. A metasearch engine is required to post queries with and obtain retrieval results from several other Internet search engines. In this paper, ...
Building efficient and effective metasearch engines

Frequently a user's information needs are stored in the databases of multiple search engines. It is inconvenient and inefficient for an ordinary user to invoke multiple search engines and identify useful documents from the returned results. To support ...
Rank aggregation using ant colony approach for metasearch

Metasearch engines provide a plethora of information to the user through World Wide Web. They are the prominent sources of query-based search and centralized human---world interactions. Metasearch engine shows a list of Web sites to a particular query ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval

August 2005

708 pages

ISBN:1595930345

DOI:10.1145/1076034

General Chairs:
Ricardo Baeza-Yates
University of Chile, Chile
,
Nivio Ziviani
Federal University of Minas Gerais, Brazil
,
Program Chairs:
Gary Marchionini
University of North Carolina, USA
,
Alistair Moffat
University of Melbourne, Australia
,
John Tait
University of Sunderland, UK

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 August 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGIR05

Sponsor:

SIGIR

SIGIR05: The 28th ACM/SIGIR International Symposium on Information Retrieval 2005

August 15 - 19, 2005

Salvador, Brazil

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
488
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bin-Hezam RStevenson MHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)RLStop: A Reinforcement Learning Stopping Method for TARProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657911(2604-2608)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657911
Stevenson MBin-Hezam R(2023)Stopping Methods for Technology-assisted Reviews Based on Point ProcessesACM Transactions on Information Systems10.1145/363199042:3(1-37)Online publication date: 29-Dec-2023
https://dl.acm.org/doi/10.1145/3631990
Rashidi LZobel JMoffat A(2023)The Impact of Judgment Variability on the Consistency of Offline Effectiveness MeasuresACM Transactions on Information Systems10.1145/359651142:1(1-31)Online publication date: 18-Aug-2023
https://dl.acm.org/doi/10.1145/3596511
Li DKanoulas E(2020)When to Stop Reviewing in Technology-Assisted ReviewsACM Transactions on Information Systems10.1145/341175538:4(1-36)Online publication date: 30-Sep-2020
https://dl.acm.org/doi/10.1145/3411755
Kurland OCulpepper JCollins-Thompson KMei QDavison BLiu YYilmaz E(2018)Fusion in Information RetrievalThe 41st International ACM SIGIR Conference on Research & Development in Information Retrieval10.1145/3209978.3210186(1383-1386)Online publication date: 27-Jun-2018
https://dl.acm.org/doi/10.1145/3209978.3210186
Li DKanoulas ELim EWinslett MSanderson MFu ASun JCulpepper SLo EHo JDonato DAgrawal RZheng YCastillo CSun ATseng VLi C(2017)Active Sampling for Large-scale Information Retrieval EvaluationProceedings of the 2017 ACM on Conference on Information and Knowledge Management10.1145/3132847.3133015(49-58)Online publication date: 6-Nov-2017
https://dl.acm.org/doi/10.1145/3132847.3133015
Anava YShtok AKurland ORabinovich EMukhopadhyay SZhai CBertino ECrestani FMostafa JTang JSi LZhou XChang YLi YSondhi P(2016)A Probabilistic Fusion FrameworkProceedings of the 25th ACM International on Conference on Information and Knowledge Management10.1145/2983323.2983739(1463-1472)Online publication date: 24-Oct-2016
https://dl.acm.org/doi/10.1145/2983323.2983739
Rabinovich ERom OKurland OGeva STrotman ABruza PClarke CJärvelin K(2014)Utilizing relevance feedback in fusion-based retrievalProceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval10.1145/2600428.2609573(313-322)Online publication date: 3-Jul-2014
https://dl.acm.org/doi/10.1145/2600428.2609573
Chandar PWebber WCarterette BJones GSheridan PKelly Dde Rijke MSakai T(2013)Document features predicting assessor disagreementProceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval10.1145/2484028.2484161(745-748)Online publication date: 28-Jul-2013
https://dl.acm.org/doi/10.1145/2484028.2484161
Webber WChandar PCarterette BChen XLebanon GWang HZaki M(2012)Alternative assessor disagreement and retrieval depthProceedings of the 21st ACM international conference on Information and knowledge management10.1145/2396761.2396781(125-134)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1145/2396761.2396781
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Supporting metasearch with XSL

Building efficient and effective metasearch engines

Rank aggregation using ant colony approach for metasearch