review-article

Report on INEX 2013

Pages 21 - 32

Published: 21 January 2013 Publication History

Abstract

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2013 evaluation campaign, which consisted of four activities addressing three themes: searching professional and user generated data (Social Book Search track); searching structured or semantic data (Linked Data track); and focused retrieval (Snippet Retrieval and Tweet Contextualization tracks). INEX 2013 was an exciting year for INEX in which we consolidated the collaboration with (other activities in) CLEF and for the second time ran our workshop as part of the CLEF labs in order to facilitate knowledge transfer between the evaluation forums. This paper gives an overview of all the INEX 2013 tracks, their aims and task, the built test-collections, and gives an initial analysis of the results.

References

[1]

S. Amer-Yahia and M. Lalmas. XML search: languages, INEX and scoring. SIGMOD Record, 35, 2006.

Digital Library

Google Scholar

[2]

P. Bellot, V. Moriceau, J. Mothe, E. Sanjuan, and X. Tannier. Overview of the INEX 2013 tweet contextualization track. In CLEF 2013 Evaluation Labs and Workshop, Online Working Notes, 2013.

Google Scholar

[3]

A. Doucet, G. Kazai, S. Colutto, and G. Muehlberger. Overview of the ICDAR 2013 Competition on Book Structure Extraction. In Proceedings of the Twelfth International Conference on Document Analysis and Recognition (ICDAR'2013), Washington, USA, September 2013.

Digital Library

Google Scholar

[4]

S. Gurajada, J. Kamps, A. Mishra, R. Schenkel, M. Theobald, and Q. Wang. Overview of the INEX 2013 linked data track. In CLEF 2013 Evaluation Labs and Workshop, Online Working Notes, 2013.

Google Scholar

[5]

J. Kamps, J. Pehcevski, G. Kazai, M. Lalmas, and S. Robertson. INEX 2007 evaluation measures. In Focused access to XML documents (INEX 2007), volume 4862 of LNCS, pages 24--33. Springer Verlag, 2008.

Digital Library

Google Scholar

[6]

M. Koolen, J. Kamps, and G. Kazai. Social Book Search: The Impact of Professional and User-Generated Content on Book Suggestions. In Proceedings of the International Conference on Information and Knowledge Management (CIKM 2012). ACM, 2012.

Google Scholar

[7]

review

Google Scholar

[8]

E. SanJuan, P. Bellot, V. Moriceau, and X. Tannier. Overview of the inex 2010 question answering track (qa@inex). In Comparative Evaluation of Focused Retrieval, INEX 2010, volume 6932 of Lecture Notes in Computer Science, pages 269--281. Springer, 2010.

[9]

Cited By

View all

Truică CApostol EDarmont JAssent I(2021)TextBenDS: a Generic Textual Data Benchmark for Distributed SystemsInformation Systems Frontiers10.1007/s10796-020-09999-y23:1(81-100)Online publication date: 1-Feb-2021
https://dl.acm.org/doi/10.1007/s10796-020-09999-y
Truică CDarmont JBoicea ARădulescu F(2018)Benchmarking top-k keyword and top-k document processing with T2K2 and T2K2D2 Future Generation Computer Systems10.1016/j.future.2018.02.03785:C(60-75)Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1016/j.future.2018.02.037
Popat KMukherjee SStrötgen JWeikum GBarrett RCummings RAgichtein EGabrilovich E(2017)Where the Truth LiesProceedings of the 26th International Conference on World Wide Web Companion10.1145/3041021.3055133(1003-1012)Online publication date: 3-Apr-2017
https://dl.acm.org/doi/10.1145/3041021.3055133
Show More Cited By

Index Terms

Report on INEX 2013
1. General and reference

Recommendations

Report on INEX 2012

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX'12 evaluation ...
Report on INEX 2011

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2011 ...
Overview of INEX 2013
CLEF 2013: Proceedings of the 4th International Conference on Information Access Evaluation. Multilinguality, Multimodality, and Visualization - Volume 8138

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2013 ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACM SIGIR Forum Volume 47, Issue 2

December 2013

135 pages

ISSN:0163-5840

DOI:10.1145/2568388

Editors:
Fernando Diaz
Microsoft Research NYC, New York, NY
,
Raman Chandrasekar
Serials Solutions, Seattle, WA

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 January 2013

Published in SIGIR Volume 47, Issue 2

Check for updates

Qualifiers

Review-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
76
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Truică CApostol EDarmont JAssent I(2021)TextBenDS: a Generic Textual Data Benchmark for Distributed SystemsInformation Systems Frontiers10.1007/s10796-020-09999-y23:1(81-100)Online publication date: 1-Feb-2021
https://dl.acm.org/doi/10.1007/s10796-020-09999-y
Truică CDarmont JBoicea ARădulescu F(2018)Benchmarking top-k keyword and top-k document processing with T2K2 and T2K2D2 Future Generation Computer Systems10.1016/j.future.2018.02.03785:C(60-75)Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1016/j.future.2018.02.037
Popat KMukherjee SStrötgen JWeikum GBarrett RCummings RAgichtein EGabrilovich E(2017)Where the Truth LiesProceedings of the 26th International Conference on World Wide Web Companion10.1145/3041021.3055133(1003-1012)Online publication date: 3-Apr-2017
https://dl.acm.org/doi/10.1145/3041021.3055133
Popat KBarrett RCummings RAgichtein EGabrilovich E(2017)Assessing the Credibility of Claims on the WebProceedings of the 26th International Conference on World Wide Web Companion10.1145/3041021.3053379(735-739)Online publication date: 3-Apr-2017
https://dl.acm.org/doi/10.1145/3041021.3053379
Yin XZhang BCui XQu JGeng BZhou FSong LHao H(2016)ISART: A Generic Framework for Searching Books with Social InformationPLOS ONE10.1371/journal.pone.014847911:2(e0148479)Online publication date: 10-Feb-2016
https://doi.org/10.1371/journal.pone.0148479
Mishra ABerberich K(2016)Leveraging Semantic Annotations to Link Wikipedia and News ArchivesAdvances in Information Retrieval10.1007/978-3-319-30671-1_3(30-42)Online publication date: 2016
https://doi.org/10.1007/978-3-319-30671-1_3
Kenter Tde Rijke MBailey JMoffat AAggarwal Cde Rijke MKumar RMurdock VSellis TYu J(2015)Short Text Similarity with Word EmbeddingsProceedings of the 24th ACM International on Conference on Information and Knowledge Management10.1145/2806416.2806475(1411-1420)Online publication date: 17-Oct-2015
https://dl.acm.org/doi/10.1145/2806416.2806475

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Report on INEX 2012

Report on INEX 2011

Overview of INEX 2013