research-article

Vertical selection in the information domain of children

Authors:

Sergio Duarte Torres,

Djoerd Hiemstra,

Theo HuibersAuthors Info & Claims

JCDL '13: Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries

Pages 57 - 66

https://doi.org/10.1145/2467696.2467714

Published: 22 July 2013 Publication History

Abstract

In this paper we explore the vertical selection methods in aggregated search in the specific domain of topics for children between 7 and 12 years old. A test collection consisting of 25 verticals, 3.8K queries and relevant assessments for a large sample of these queries mapping relevant verticals to queries was built. We gather relevant assessment by envisaging two aggregated search systems: one in which the Web vertical is always displayed and in which each vertical is assessed independently from the web vertical. We show that both approaches lead to a different set of relevant verticals and that the former is prone to bias of visually oriented verticals. In the second part of this paper we estimate the size of the verticals for the target domain. We show that employing the global size and domain specific size estimation of the verticals lead to significant improvements when using state-of-the art methods of vertical selection. We also introduce a novel vertical and query representation based on tags from social media and we show that its use lead to significant performance gains.

References

[1]

J. Arguello, F. Diaz, J. Callan, and B. Carterette. A methodology for evaluating aggregated search results. In Proceedings of the 33rd European conference on Advances in information retrieval, ECIR'11, pages 141--152, Berlin, Heidelberg, 2011. Springer-Verlag.

Digital Library

[2]

J. Arguello, F. Diaz, J. Callan, and J.-F. Crespo. Sources of evidence for vertical selection. In SIGIR'09, pages 315--322, New York, NY, USA, 2009. ACM.

Digital Library

[3]

J. Arguello, F. Diaz, and J.-F. Paiement. Vertical selection in the presence of unlabeled verticals. In SIGIR, pages 691--698, 2010.

Digital Library

[4]

J. Arguello, W.-C. Wu, D. Kelly, and A. Edwards. Task complexity, vertical display and user interaction in aggregated search. SIGIR'12, pages 435--444, New York, NY, USA, 2012. ACM.

Digital Library

[5]

A. Bermingham and A. F. Smeaton. A study of inter-annotator agreement for opinion retrieval. SIGIR'09, pages 784--785, New York, NY, USA, 2009. ACM.

Digital Library

[6]

D. Downey, S. Dumais, D. Liebling, and E. Horvitz. Understanding the relationship between searchers' queries and information goals. CIKM'08, pages 449--458, New York, NY, USA, 2008. ACM.

Digital Library

[7]

S. Duarte, D. Hiemstra, and P. Serdyukov. An analysis of queries intended to search information for children. In IIiX 2010.

Digital Library

[8]

S. Duarte Torres, D. Hiemstra, I. Weber, and P. Serdyukov. Query recommendation for children. CIKM'12, pages 2010--2014, New York, NY, USA, 2012. ACM.

Digital Library

[9]

S. Duarte Torres and I. Weber. What and how children search on the web. CIKM'11, pages 393--402, New York, NY, USA, 2011. ACM.

Digital Library

[10]

C. Eickhoff, P. Serdyukov, and A. P. de Vries. A combined topical/non-topical approach to identifying web sites for children. WSDM'11, pages 505--514, New York, NY, USA, 2011. ACM.

Digital Library

[11]

E. Foss, A. Druin, R. Brewer, P. Lo, L. Sanchez, E. Golub, and H. Hutchinson. Children's search roles at home: Implications for designers, researchers, educators, and parents. JASIST, 63(3):558--573, 2012.

Digital Library

[12]

K. Gyllstrom and M.-F. Moens. Wisdom of the ages: toward delivering the children's web with the link-based agerank algorithm. In CIKM, pages 159--168, 2010.

Digital Library

[13]

A. Hassan, R. Jones, and K. L. Klinkner. Beyond dcg: user behavior as a predictor of a successful search. In Proceedings of the third ACM international conference on Web search and data mining, WSDM'10, pages 221--230, New York, NY, USA, 2010. ACM.

Digital Library

[14]

D. Hiemstra. Term-specific smoothing for the language modeling approach to information retrieval: the importance of a query term. In SIGIR, pages 35--41, 2002.

Digital Library

[15]

Ilad Shokouhi and L. Si. Federated search. In FNTIR, 2011.

Digital Library

[16]

G. Pass, A. Chowdhury, and C. Torgeson. A picture of search. In Proceedings of the 1st international conference on Scalable information systems, InfoScale'06, New York, NY, USA, 2006. ACM.

Digital Library

[17]

P. Schaer. Better than their reputation? on the reliability of relevance assessments with students. In CLEF, pages 124--135, 2012.

Digital Library

[18]

M. Shokouhi, J. Zobel, F. Scholer, and S. M. M. Tahaghoghi. Capturing collection size for distributed non-cooperative retrieval. SIGIR'06, pages 316--323, New York, NY, USA, 2006. ACM.

Digital Library

[19]

L. Si and J. Callan. Relevant document distribution estimation method for resource selection. SIGIR'03, pages 298--305, New York, NY, USA, 2003. ACM.

Digital Library

[20]

S. Sushmita, H. Joho, and M. Lalmas. A task-based evaluation of an aggregated search interface. In SPIRE, pages 322--333, 2009.

Digital Library

[21]

P. Thomas and D. Hawking. Evaluation by comparing result sets in context. CIKM'06, pages 94--101, New York, NY, USA, 2006. ACM.

Digital Library

[22]

P. Thomas and D. Hawking. Evaluating sampling methods for uncooperative collections. SIGIR'07, pages 503--510, New York, NY, USA, 2007. ACM.

Digital Library

[23]

S. D. Torres, D. Hiemstra, and P. Serdyukov. Query log analysis in the context of information retrieval for children. In SIGIR, pages 847--848, 2010.

Digital Library

[24]

R. Wetzker, C. Zimmermann, and C. Bauckhage. Analyzing social bookmarking systems: A del.icio.us cookbook. In MSoDa, pages 26--30, 2008.

[25]

J. Xu, S. Wu, and X. Li. Estimating collection size with logistic regression. SIGIR'07, pages 789--790, New York, NY, USA, 2007. ACM.

Digital Library

[26]

K. Zhou, R. Cummins, M. Lalmas, and J. Jose. Evaluating large-scale distributed vertical search. LSDS-IR'11, pages 9--14, New York, NY, USA, 2011. ACM.

Digital Library

Cited By

Achsas SNfaoui E(2022)Academic Aggregated Search Approach Based on BERT Language Model2022 2nd International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET)10.1109/IRASET52964.2022.9737888(1-9)Online publication date: 3-Mar-2022
https://doi.org/10.1109/IRASET52964.2022.9737888
Downs BPera MWright KKennington CFails J(2022)KidSpell: Making a difference in spellchecking for childrenInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2021.10037332(100373)Online publication date: Jun-2022
https://doi.org/10.1016/j.ijcci.2021.100373
Arguello J(2018)Aggregated SearchFoundations and Trends in Information Retrieval10.1561/150000005210:5(365-502)Online publication date: 14-Dec-2018
https://dl.acm.org/doi/10.1561/1500000052
Show More Cited By

Index Terms

Vertical selection in the information domain of children
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking
    2. Retrieval tasks and goals

Recommendations

Evaluating reward and risk for vertical selection
CIKM '12: Proceedings of the 21st ACM international conference on Information and knowledge management

The aggregation of search results from heterogeneous verticals (news, videos, blogs, etc) has become an important consideration in search. When aiming to select suitable verticals, from which items are selected to be shown along with the standard "ten ...
Which vertical search engines are relevant?
WWW '13: Proceedings of the 22nd international conference on World Wide Web

Aggregating search results from a variety of heterogeneous sources, so-called verticals, such as news, image and video, into a single interface is a popular paradigm in web search. Current approaches that evaluate the effectiveness of aggregated search ...
Sources of evidence for vertical selection
SIGIR '09: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval

Web search providers often include search services for domain-specific subcollections, called verticals, such as news, images, videos, job postings, company summaries, and artist profiles. We address the problem of vertical selection, predicting ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

JCDL '13: Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries

July 2013

480 pages

ISBN:9781450320771

DOI:10.1145/2467696

General Chairs:
J. Stephen Downie
University of Illinois at Urbana-Champaign, USA
,
Robert H. McDonald
Indiana University Bloomington, USA
,
Program Chairs:
Timothy W. Cole
University of Illinois at Urbana-Champaign, USA
,
Robert Sanderson
Los Alamos National Laboratory, USA
,
Frank Shipman
Texas A&M University, USA

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

JCDL '13

Sponsor:

JCDL '13: 13th ACM/IEEE-CS Joint Conference on Digital Libraries

July 22 - 26, 2013

Indiana, Indianapolis, USA

Acceptance Rates

JCDL '13 Paper Acceptance Rate 28 of 95 submissions, 29%;

Overall Acceptance Rate 415 of 1,482 submissions, 28%

Upcoming Conference

JCDL '24

Sponsor:
sigir
sigir

The 2024 ACM/IEEE Joint Conference on Digital Libraries

December 16 - 20, 2024

Hong Kong , China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
137
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Achsas SNfaoui E(2022)Academic Aggregated Search Approach Based on BERT Language Model2022 2nd International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET)10.1109/IRASET52964.2022.9737888(1-9)Online publication date: 3-Mar-2022
https://doi.org/10.1109/IRASET52964.2022.9737888
Downs BPera MWright KKennington CFails J(2022)KidSpell: Making a difference in spellchecking for childrenInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2021.10037332(100373)Online publication date: Jun-2022
https://doi.org/10.1016/j.ijcci.2021.100373
Arguello J(2018)Aggregated SearchFoundations and Trends in Information Retrieval10.1561/150000005210:5(365-502)Online publication date: 14-Dec-2018
https://dl.acm.org/doi/10.1561/1500000052
Arguello JCapra R(2016)The Effects of Aggregated Search Coherence on Search BehaviorACM Transactions on Information Systems10.1145/293574735:1(1-30)Online publication date: 22-Sep-2016
https://dl.acm.org/doi/10.1145/2935747

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents