Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Developing a Test Collection for the Evaluation of Integrated Search

  • Conference paper
Advances in Information Retrieval (ECIR 2010)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5993))

Included in the following conference series:

Abstract

The poster discusses the characteristics needed in an information retrieval (IR) test collection to facilitate the evaluation of integrated search, i.e. search across a range of different sources but with one search box and one ranked result list, and describes and analyses a new test collection constructed for this purpose. The test collection consists of approx. 18,000 monographic records, 160,000 papers and journal articles in PDF and 275,000 abstracts with a varied set of metadata and vocabularies from the physics domain, 65 topics based on real work tasks and corresponding graded relevance assessments. The test collection may be used for systems- as well as user-oriented evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Sullivan, D.: Google Universal Search: 2008 Edition (2008), http://searchengineland.com/google-universal-search-2008-edition-13256

  2. Järvelin, K.: An analysis of two approaches in information retrieval: from frameworks to study designs. JASIST 58(7), 971–986 (2007)

    Article  Google Scholar 

  3. Gómez, N.D.: Physicists’ information behaviour: a qualitative study of users. In: 70th IFLA Council and General Conference IFLA, Buenos Aires, August 22-27 (2004)

    Google Scholar 

  4. Kelly, D., Fu, X.: Eliciting better information need descriptions from users of information search systems. Information Processing & Management 43(1), 30–46 (2007)

    Article  Google Scholar 

  5. Sormunen, E.: Liberal relevance criteria of TREC – Counting on negligible documents? In: Proceedings of SIGIR 2002, pp. 320–330. ACM Press, New York (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Interaction and Information Architecture., Royal School of Library and Information Science, Birketinget 6, DK-2300, Copenhagen S, Denmark

    Marianne Lykke, Birger Larsen, Haakon Lund & Peter Ingwersen

Authors
  1. Marianne Lykke
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Birger Larsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haakon Lund
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peter Ingwersen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Adaptive Information Cluster, Dublin City University, Dublin, 9, Ireland

    Cathal Gurrin

  2. The Open University, Walton Hall, MK7 6HF, Milton Keynes, UK

    Yulan He

  3. Microsoft Research Ltd, 7 JJ Thomson Avenue, CB3 0FB, Cambridge, UK

    Gabriella Kazai

  4. Department of Computer Science, University of Essex, Wivenhoe Park, CO4 3SQ, Colchester, UK

    Udo Kruschwitz

  5. The Open University, Walton Hall, Milton Keynes, UK

    Suzanne Little

  6. University of London, London, UK

    Thomas Roelleke

  7. Knowledge Media Institute, The Open University, MK7 6AA, Milton Keynes, UK

    Stefan Rüger

  8. Department of Computing Science, University of Glasgow, 17 Lilybank Gardens, G12 8QQ, Glasgow, UK

    Keith van Rijsbergen

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lykke, M., Larsen, B., Lund, H., Ingwersen, P. (2010). Developing a Test Collection for the Evaluation of Integrated Search. In: Gurrin, C., et al. Advances in Information Retrieval. ECIR 2010. Lecture Notes in Computer Science, vol 5993. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12275-0_63

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12275-0_63

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12274-3

  • Online ISBN: 978-3-642-12275-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation