Abstract
Online book search services allow users to tag and review books but do not include such data in the search index, which only contains titles, author names and professional subject descriptors. Such professional metadata is a limited description of the book, whereas tags and reviews can describe the content in more detail and cover many other aspects such as quality, writing style and engagement. In this paper we investigate the impact of including such user-generated content in the search index of a large collection of book records from Amazon and LibraryThing. We find that professional metadata is often too limited to provide good recall and precision and that both user reviews and tags can substantially improve performance. We perform a detailed analysis of different types of metadata and their impact on a number of topic categories and find that user-generated content is effective for a range of information needs. These findings are of direct relevance to large online book sellers and social cataloguing sites.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bartley, P.: Book tagging on librarything: How, why, and what are in the tags? Proceedings of the American Society for Information Science and Technology 46(1), 1–22 (2009)
Buckland, M.: Vocabulary as a Central Concept in Library and Information Science. In: Proceedings of CoLIS3 (1999)
Chandler, O.: How Consumers Discover Books Online (2012), http://cdn.oreillystatic.com/en/assets/1/event/73/How
Cleverdon, C.W.: The Cranfield tests on index language devices. Aslib 19, 173–192 (1967)
Golder, S.A., Huberman, B.A.: Usage patterns of collaborative tagging systems. Journal of Information Science 32(2), 198–208 (2006)
Golovchinsky, G., Price, M.N., Schilit, B.N.: From reading to retrieval: free-form ink annotations as queries. In: SIGIR 1999, pp. 19–25 (1999)
Gross, T., Taylor, A.G.: What Have We Got to Lose? The Effect of Controlled Vocabulary on Keyword Searching Results. College & Research Libraries 66(3) (2005)
Ingwersen, P.: Polyrepresentation of information needs and semantic entities: Elements of a cognitive theory for information retrieval interaction. In: Croft, W.B., van Rijsbergen, C.J. (eds.) SIGIR, pp. 101–110. ACM/Springer (1994)
Kazai, G., Milic-Frayling, N.: Effects of social approval votes on search performance. In: Third International Conference on Information Technology: New Generations, pp. 1554–1559 (2009)
Koolen, M., Kamps, J., Kazai, G.: Social Book Search: The Impact of Professional and User-Generated Content on Book Suggestions. In: CIKM 2012. ACM (2012)
Koolen, M., Kazai, G., Kamps, J., Doucet, A., Landoni, M.: Overview of the INEX 2012 Social Book Search Track. In: Geva, S., Kamps, J., Schenkel, R. (eds.) INEX 2011. LNCS, vol. 7424, pp. 1–29. Springer, Heidelberg (2012)
Lancaster, F.W.: Vocabulary control for information retrieval, 2nd edn. Information Resources Press, Arlington (1986)
Lu, C., Jung-ran, P., Hu, X.: User tags versus expert-assigned subject terms: A comparison of librarything tags and library of congress subject headings. Journal of Information Science 36(6), 763–779 (2010)
Mathes, A.: Folksonomies - cooperative classification and communication through shared metadata (December 2004)
Rolla, P.J.: User Tags versus Subject Headings. Library Resources & Technical Services 53(3), 174–184 (2009)
Sterken, V.: Folksonomy as a thing for a library: An analysis of user generated metadata in Library Thing. Cahiers de la Documentation–Bladen Voor Documentatie 1, 9 (2009)
Svenonius, E.: Unanswered questions in the design of controlled vocabularies. Journal of the American Society for Information Science 37(5), 331–340 (1986)
Svenonius, E.: The Intellectual Foundation of Information Organization. MIT Press (2000) ISBN 0-262-19433-3
Voss, J.: Tagging, folksonomy & co - renaissance of manual indexing? CoRR, abs/cs/0701072 (2007)
Yi, K.: A semantic similarity approach to predicting library of congress subject headings for social tags. JASIST 61(8), 1658–1672 (2010)
Yi, K., Chan, L.M.: Linking folksonomy to Library of Congress subject headings: an exploratory study. Journal of Documentation 65(6), 872–900 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Koolen, M. (2014). “User Reviews in the Search Index? That’ll Never Work!”. In: de Rijke, M., et al. Advances in Information Retrieval. ECIR 2014. Lecture Notes in Computer Science, vol 8416. Springer, Cham. https://doi.org/10.1007/978-3-319-06028-6_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-06028-6_27
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-06027-9
Online ISBN: 978-3-319-06028-6
eBook Packages: Computer ScienceComputer Science (R0)