Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2766462.2767705acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

From Queries to Cards: Re-ranking Proactive Card Recommendations Based on Reactive Search History

Published: 09 August 2015 Publication History

Abstract

The growing accessibility of mobile devices has substantially reformed the way users access information. While the reactive search by query remains as common as before, recent years have witnessed the emergence of various proactive systems such as Google Now and Microsoft Cortana. In these systems, relevant content is presented to users based on their context without a query. Interestingly, despite the increasing popularity of such services, there is very little known about how users interact with them.
In this paper, we present the first study on user interactions with information cards. We demonstrate that the usage patterns of these cards vary depending on time and location. We also show that while overall different topics are clicked by users on proactive and reactive platforms, the topics of the clicked documents by the same user tend to be consistent cross-platform. Furthermore, we propose a supervised framework for re-ranking proactive cards based on the user's context and past history. To train our models, we use the viewport duration and clicks to infer pseudo-relevance labels for the cards. Our results suggest that the quality of card ranking can be significantly improved particularly when the user's reactive search history is %leveraged and matched against the proactive data about the cards.

References

[1]
Google, Inside AdWords. http://bit.ly/1JrajCg/. Accessed: 2015-05--14.
[2]
Cortana - Microsoft - USA. http://www.microsoft.com/en-us/mobile/campaign-cortana/. Accessed: 2015-05--14.
[3]
DMOZ - the Open Directory Project. http://www.dmoz.org/. Accessed: 2015-05--14.
[4]
Google now. https://www.google.com/landing/now/. Accessed: 2015-05--14.
[5]
Apple - iOS 8 - Siri. https://www.apple.com/ios/siri/. Accessed: 2015-05--14.
[6]
2013 Strategic Imperative: Marketing as Applied Science | RKG Blog. http://bit.ly/1AnYMNZ, 2013. Accessed: 2015-05--14.
[7]
E. Agichtein, E. Brill, S. Dumais, and R. Ragno. Learning user interaction models for predicting web search result preferences. In Proc. SIGIR, pages 3--10, Seattle, WA, 2006.
[8]
J. Allan, B. Croft, A. Moffat, and M. Sanderson. Frontiers, challenges, and opportunities for information retrieval: Report from swirl 2012 the second strategic workshop on information retrieval in lorne. SIGIR Forum, 46 (1): 2--32, May 2012.
[9]
J. Arguello, J. Callan, and F. Diaz. Classification-based resource selection. In Proc. CIKM, Hong Kong, China, 2009.
[10]
S. M. Beitzel, E. C. Jensen, A. Chowdhury, D. Grossman, and O. Frieder. Hourly analysis of a very large topically categorized web query log. In Proc. SIGIR, pages 321--328, Sheffield, UK, 2004.
[11]
P. N. Bennett, K. Svore, and S. T. Dumais. Classification-enhanced ranking. In Proc. WWW, pages 111--120, Raleigh, NC, 2010.
[12]
P. N. Bennett, F. Radlinski, R. W. White, and E. Yilmaz. Inferring and using location metadata to personalize web search. In Proc. SIGIR, pages 135--144, Beijing, China, 2011.
[13]
P. N. Bennett, R. W. White, W. Chu, S. T. Dumais, P. Bailey, F. Borisyuk, and X. Cui. Modeling the impact of short- and long-term behavior on search personalization. In Proc. SIGIR, pages 185--194, Portland, OR, 2012.
[14]
J. Budzik and K. Hammond. Watson: Anticipating and contextualizing information needs. In Proc. ASIS, volume 36, pages 727--740, 1999.
[15]
C. Burges, R. Ragno, and Q. Le. Learning to rank with non-smooth cost functions. In Advances in Neural Information Processing Systems 19. MIT Press, Cambridge, MA, January 2007.
[16]
G. Buscher, L. van Elst, and A. Dengel. Segment-level display time as implicit feedback: A comparison to eye tracking. In Proc. SIGIR, pages 67--74, 2009.
[17]
L. D. Catledge and J. E. Pitkow. Characterizing browsing strategies in the world-wide web. Comput. Netw. ISDN Syst., 27 (6): 1065--1073, Apr. 1995.
[18]
O. Chapelle and Y. Chang. Yahoo! Learning to Rank Challenge Overview. In Proceedings of the Yahoo! Learning to Rank Challenge, pages 1--24, Haifa, Israel, 2011.
[19]
O. Chapelle and Y. Zhang. A dynamic bayesian network click model for web search ranking. In Proc. WWW, pages 1--10, Madrid, Spain, 2009.
[20]
E. Cho, S. A. Myers, and J. Leskovec. Friendship and mobility: User movement in location-based social networks. In Proc. KDD, pages 1082--1090, San Diego, CA, 2011.
[21]
F. Diaz. Integration of news content into web results. In Proc. WSDM, pages 182--191, Barcelona, Spain, 2009.
[22]
S. Fox, K. Karnawat, M. Mydland, S. Dumais, and T. White. Evaluating implicit measures to improve web search. ACM Trans. Inf. Syst., 23 (2), Apr. 2005.
[23]
J. H. Friedman. Greedy function approximation: a gradient boosting machine. Annals of Statistics, pages 1189--1232, 2001.
[24]
Q. Guo, H. Jin, D. Lagun, S. Yuan, and E. Agichtein. Mining touch interaction data on mobile devices to predict web search result relevance. In Proc. SIGIR, pages 153--162, Dublin, Ireland, 2013.
[25]
M. Halvey, M. T. Keane, and B. Smyth. Time based patterns in mobile-internet surfing. In Proc. CHI, pages 31--34. ACM, 2006.
[26]
K. Hofmann, B. Mitra, F. Radlinski, and M. Shokouhi. An eye-tracking study of user interactions with query auto completion. In Proc. CIKM, pages 549--558, Shanghai, China, 2014.
[27]
B. J. Jansen, A. Spink, and T. Saracevic. Real life, real users, and real needs: A study and analysis of user queries on the web. Inf. Process. Manage., 36 (2): 207--227, Jan. 2000.
[28]
T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Trans. Inf. Syst., 25 (2), Apr. 2007.
[29]
D. Lagun, C.-H. Hsieh, D. Webster, and V. Navalpakkam. Towards better measurement of attention and satisfaction in mobile search. In Proc. SIGIR, pages 113--122, Gold Coast, Queensland, Australia, 2014.
[30]
J. Li, S. Huffman, and A. Tokuda. Good abandonment in mobile and pc internet search. In Proc. SIGIR, pages 43--50, 2009.
[31]
H. Lieberman. Autonomous interface agents. In Proc. CHI, pages 67--74. ACM, 1997.
[32]
Q. Mei and K. Church. Entropy of search logs: How hard is search? with personalization? with backoff? In Proc. WSDM, pages 45--54, Palo Alto, CA, 2008.
[33]
G. D. Montanez, R. W. White, and X. Huang. Cross-device search. In Proc. CIKM, pages 1669--1678, Shanghai, China, 2014.
[34]
A. K. Ponnuswami, K. Pattabiraman, Q. Wu, R. Gilad-Bachrach, and T. Kanungo. On composition of a federated web search result page: Using online users to provide pairwise preference for heterogeneous verticals. In Proc. WSDM, Hong Kong, China, 2011.
[35]
F. Radlinski and T. Joachims. Query chains: Learning to rank from implicit feedback. In Proc. KDD, pages 239--248, Chicago, Illinois, USA, 2005.
[36]
P. Resnick and H. R. Varian. Recommender systems. Commun. ACM, 40 (3): 56--58, Mar. 1997.
[37]
B. J. Rhodes and P. Maes. Just-in-time information retrieval agents. IBM Syst. J., 39 (3--4): 685--704, July 2000.
[38]
M. Shokouhi. Learning to personalize query auto-completion. In Proc. SIGIR, pages 103--112, Dublin, Ireland, 2013.
[39]
M. Shokouhi, R. W. White, P. Bennett, and F. Radlinski. Fighting search engine amnesia: Reranking repeated results. In Proc. SIGIR, Dublin, Ireland, 2013.
[40]
X. Su and T. M. Khoshgoftaar. A survey of collaborative filtering techniques. Adv. in Artif. Intell., 2009: 4:2--4:2, Jan. 2009.
[41]
J. Teevan, D. J. Liebling, and G. Ravichandran Geetha. Understanding and predicting personal navigation. In Proc. WSDM, pages 85--94, Hong Kong, China, 2011.
[42]
L. Wang, P. N. Bennett, and K. Collins-Thompson. Robust ranking models via risk-sensitive optimization. In Proc. SIGIR, Portland, OR, 2012.
[43]
Y. Wang, X. Huang, and R. W. White. Characterizing and supporting cross-device search tasks. In Proc. WSDM, pages 707--716, Rome, Italy, 2013.
[44]
I. Weber and C. Castillo. The demographics of web search. In Proc. SIGIR, pages 523--530, Geneva, Switzerland, 2010.
[45]
R. W. White and S. M. Drucker. Investigating behavioral variability in web search. In Proc. WWW, pages 21--30, Banff, Alberta, Canada, 2007.
[46]
R. W. White, W. Chu, A. Hassan, X. He, Y. Song, and H. Wang. Enhancing personalized search by mining and modeling task behavior. In Proc. WWW, pages 1411--1420, Rio de Janeiro, Brazil, 2013.
[47]
Q. Wu, C. J. Burges, K. M. Svore, and J. Gao. Adapting boosting for information retrieval measures. Inf. Retr., 13 (3): 254--270, June 2010.
[48]
S. Xu, H. Jiang, and F. C. M. Lau. Mining user dwell time for personalized web search re-ranking. In Proc. IJCAI, pages 2367--2372, Barcelona, Catalonia, Spain, 2011.

Cited By

View all
  • (2024)Entity Footprinting: Modeling Contextual User States via Digital Activity MonitoringACM Transactions on Interactive Intelligent Systems10.1145/364389314:2(1-27)Online publication date: 5-Feb-2024
  • (2024)Veracity Estimation for Entity-Oriented Search with Knowledge GraphsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679561(1649-1659)Online publication date: 21-Oct-2024
  • (2024)Web Search Engine Results Page Viewing Formats for Different Search TasksInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2376358(1-16)Online publication date: 29-Jul-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '15: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval
August 2015
1198 pages
ISBN:9781450336215
DOI:10.1145/2766462
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 August 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. information cards
  2. proactive ranking
  3. zero query

Qualifiers

  • Research-article

Conference

SIGIR '15
Sponsor:

Acceptance Rates

SIGIR '15 Paper Acceptance Rate 70 of 351 submissions, 20%;
Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)2
Reflects downloads up to 16 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Entity Footprinting: Modeling Contextual User States via Digital Activity MonitoringACM Transactions on Interactive Intelligent Systems10.1145/364389314:2(1-27)Online publication date: 5-Feb-2024
  • (2024)Veracity Estimation for Entity-Oriented Search with Knowledge GraphsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679561(1649-1659)Online publication date: 21-Oct-2024
  • (2024)Web Search Engine Results Page Viewing Formats for Different Search TasksInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2376358(1-16)Online publication date: 29-Jul-2024
  • (2021)Entity Recommendation for Everyday Digital TasksACM Transactions on Computer-Human Interaction10.1145/345891928:5(1-41)Online publication date: 20-Aug-2021
  • (2021)Spoken Conversational Context Improves Query Auto-completion in Web SearchACM Transactions on Information Systems10.1145/344787539:3(1-32)Online publication date: 5-May-2021
  • (2021)Context-aware Target Apps Selection and Recommendation for Enhancing Personal Mobile AssistantsACM Transactions on Information Systems10.1145/344767839:3(1-30)Online publication date: 5-May-2021
  • (2021)Interacting with Information in Immersive Virtual EnvironmentsProceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3404835.3462787(2600-2604)Online publication date: 11-Jul-2021
  • (2020)Investigating Examination Behavior in Mobile SearchProceedings of the 13th International Conference on Web Search and Data Mining10.1145/3336191.3371797(771-779)Online publication date: 20-Jan-2020
  • (2020)Improving Session-Based Recommendation Adopting Linear Regression-Based Re-ranking2020 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN48605.2020.9207680(1-8)Online publication date: Jul-2020
  • (2020)Proactivity: The Next Step in Voice Assistants for the TV EcosystemApplications and Usability of Interactive TV10.1007/978-3-030-56574-9_7(103-116)Online publication date: 25-Aug-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media