Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2939672.2939746acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Towards Conversational Recommender Systems

Published: 13 August 2016 Publication History

Abstract

People often ask others for restaurant recommendations as a way to discover new dining experiences. This makes restaurant recommendation an exciting scenario for recommender systems and has led to substantial research in this area. However, most such systems behave very differently from a human when asked for a recommendation. The goal of this paper is to begin to reduce this gap. In particular, humans can quickly establish preferences when asked to make a recommendation for someone they do not know. We address this cold-start recommendation problem in an online learning setting. We develop a preference elicitation framework to identify which questions to ask a new user to quickly learn their preferences. Taking advantage of latent structure in the recommendation space using a probabilistic latent factor model, our experiments with both synthetic and real world data compare different types of feedback and question selection strategies. We find that our framework can make very effective use of online user feedback, improving personalized recommendations over a static model by 25% after asking only 2 questions. Our results demonstrate dramatic benefits of starting from offline embeddings, and highlight the benefit of bandit-based explore-exploit strategies in this setting.

References

[1]
D. Agarwal and B.-C. Chen. Regression-based latent factor models. In KDD, 19--28, 2009.
[2]
N. Ailon, Z. Karnin, and T. Joachims. Reducing dueling bandits to cardinal bandits. In ICML, 856--864, 2014.
[3]
P. Auer. Using confidence bounds for exploitation-exploration trade-offs. In JMLR, 3:397--422, 2003.
[4]
P. Auer, N. Cesa-Bianchi, Y. Freund, and R. E. Schapire.% Gambling in a rigged casino: The adversarial multi-armed bandit problem. In 36th% Annual Symposium on Foundations of Computer Science, 322--331, 1995.
[5]
J. Bennett and S. Lanning. The netflix prize. In KDD cup and workshop, 2007.
[6]
G. Bresler, G. H. Chen, and D. Shah. A latent source model for online collaborative filtering. In NIPS, 3347--3355, 2014.
[7]
O. Chapelle and L. Li. An empirical evaluation of thompson sampling. In NIPS, 2249--2257, 2011.
[8]
H. Chen and D. R. Karger. Less is more: probabilistic models for retrieving fewer relevant documents. In SIGIR, 429--436, 2006.
[9]
L. Chen and P. Pu. Critiquing-based recommenders: survey and emerging trends. In User Modeling and User-Adapted Interaction, 22(1--2):125--150, 2012.
[10]
I. J. Cox, M. L. Miller, T. P. Minka, T. V. Papathomas and P. N. Yianilos. The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments. In Image Processing, IEEE transactions, 9(1):20--37, 2000.
[11]
K. Christakopoulou and A. Banerjee.% Collaborative ranking with a push at the top. In WWW, 205--215, 2015.
[12]
A. S. Das, M. Datar, A. Garg, and S. Rajaram. Google news personalization: scalable online collaborative filtering. In WWW, 271--280, 2007.
[13]
%M. Dudík, K. Hofmann, R. E. Schapire, A. Slivkins, and M. Zoghi. Contextual dueling bandits. In COLT, 2015.
[14]
P. Gajane, T. Urvoy, and F. Clérot. A relative exponential weighing algorithm for adversarial utility-based dueling bandits. In ICML, 218--227, 2015.
[15]
A. Felfernig, G. Friedrich, D. Jannach and M. Zanker. Developing Constraint-based Recommenders. In Recommender systems handbook, 187--212, 2011.
[16]
M. P. Graus and M. C. Willemsen. Improving the user experience during cold start through choice-based preference elicitation. In RecSys, 273--276, 2015.
[17]
K. Hofmann, A. Schuth, A. Bellogin and M. de Rijke. Effects of position bias on click-based recommender evaluation. In ECIR, 624--630, 2014.
[18]
D. Kahneman and A. Tversky. Prospect theory: An analysis of decision under risk. In Econometrica, 263--291, 1979.
[19]
P. Kantor, P. B Rokach, F. Ricci, B. Shapira, and S. Chawla. Recommender systems handbook. Springer, 2011.
[20]
J. Kawale, H. H Bui, B. Kveton, L. Tran-Thanh, and S. Chawla. Efficient Thompson Sampling for Online Matrix-Factorization Recommendation. In NIPS, 1297--1305, 2015.
[21]
Y. Koren, R. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. In Computer, (8):30--37, 2009.
[22]
H. Li. A short introduction to learning to rank. In IEICE TIS, 94(10):1854--1862, 2011.
[23]
L. Li, W. Chu, J. Langford, and R. E. Schapire. A contextual-bandit approach to personalized news article recommendation. In WWW, 661--670, 2010.
[24]
E. Liebman, M. Saar-Tsechansky, and P. Stone. Dj-mc: A reinforcement-learning agent for music playlist recommendation. In AAMAS, 591--599, 2015.
[25]
B. Loepp, T. Hussein, and J. Ziegler. Choice-based preference elicitation for collaborative filtering recommender systems. In CHI, 3085--3094, 2014.
[26]
Y. Lu, S. N Negahban. Individualized rank aggregation using nuclear norm regularization. arXiv:1410.0860, 2014.
[27]
T. Mahmood and F. Ricci. Improving recommender systems with adaptive conversational strategies. In Hypertext, 73--82, 2009.
[28]
L. McGinty and J. Reilly. On the evolution of critiquing recommenders. In Recommender Systems Handbook, 419--453, 2011.
[29]
T. Minka, J. Winn, J. Guiver, and D. Knowles. Infer .net 2.5. Microsoft Research Cambridge, 2012.
[30]
T. Minka. Expectation propagation for approximate bayesian inference. In UAI, 362--369, 2001.
[31]
A. Mnih and R. Salakhutdinov. Probabilistic matrix factorization. In NIPS, 1257--1264, 2007.
[32]
J. Neidhardt, R. Schuster, L. Seyfang, and H. Werthner. Eliciting the users' unknown preferences. In RecSys, 309--312, 2014.
[33]
P. A. Ortega and D. A. Braun. Generalized thompson sampling for sequential decision-making and causal inference. In Complex Adaptive Systems Modeling, 2(1):2, 2014.
[34]
M. J. Pazzani and D. Billsus. Content-based recommendation systems. In The adaptive web, 325--341, 2007.
[35]
P. Pu, B. Faltings, L. Chen, J. Zhang, and P. Viappiani. Usability guidelines for product recommenders based on example critiquing research. In Recommender Systems Handbook, 511--545, 2011.
[36]
S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme. Bpr: Bayesian personalized ranking from implicit feedback. In UAI, 452--461, 2009.
[37]
J. Ritchie and J. Lewis. Qualitative research practice. In Sage, 2003.
[38]
N. Rubens, D. Kaplan, and M. Sugiyama. Active learning in recommender systems. In Recommender systems handbook, 735--767, 2011.
[39]
T. Salimans, U. Paquet, and T. Graepel. Collaborative learning of preference rankings. In RecSys, 261--264, 2012.
[40]
B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. Item-based collaborative filtering recommendation algorithms. In WWW, 285--295, 2001.
[41]
E. M. Schwartz. Optimizing adaptive marketing experiments with the multi-armed bandit. 2013.
[42]
Y. Shi, A. Karatzoglou, L. Baltrunas, M. Larson, N. Oliver, and A. Hanjalic. Climf: learning to maximize reciprocal rank with collaborative% less-is-more filtering. In RecSys, 139--146, 2012.
[43]
D. H. Stern, R. Herbrich, and T. Graepel. Matchbox: large scale online bayesian recommendations. In WWW, 111--120, 2009.
[44]
M. Sun, F. Li, J. Lee, K. Zhou, G. Lebanon, and H. Zha. Learning multiple-question decision trees for cold-start recommendation. In WSDM, 445--454, 2013.
[45]
L. Tang, Y. Jiang, L. Li, and T. Li. Ensemble contextual bandits for personalized recommendation. In RecSys, 73--80, 2014.
[46]
L. Tang, Y. Jiang, L. Li, C. Zeng, and T. Li. Personalized recommendation via parameter-free contextual bandits. In SIGIR, 323--332, 2015.
[47]
H. P. Vanchinathan, I. Nikolic, F. De Bona, and A. Krause. Explore-exploit in top-n recommender systems via gaussian processes. In RecSys, 225--232, 2014.
[48]
X. Zhao, W. Zhang, and J. Wang. Interactive collaborative filtering. In CIKM, 1411--1420, 2013.
[49]
M. Zoghi, S. A. Whiteson, M. de Rijke, and R. Munos. Relative confidence sampling for efficient on-line ranker evaluation. In WSDM, 73--82, 2014.

Cited By

View all
  • (2025)A Comprehensive Review of Food Recommendation Systems in the Context of Nutritional Therapy for Diabetes MellitusCurrent Nutrition & Food Science10.2174/011573401329700224052206324121:1(14-34)Online publication date: Jan-2025
  • (2024)Conversational recommender based on graph sparsification and multi-hop attentionIntelligent Data Analysis10.3233/IDA-23014828:1(99-119)Online publication date: 3-Feb-2024
  • (2024)Knowledge-Enhanced Conversational Recommendation via Transformer-Based Sequential ModelingACM Transactions on Information Systems10.1145/367737642:6(1-27)Online publication date: 18-Oct-2024
  • Show More Cited By

Index Terms

  1. Towards Conversational Recommender Systems

                          Recommendations

                          Comments

                          Please enable JavaScript to view thecomments powered by Disqus.

                          Information & Contributors

                          Information

                          Published In

                          cover image ACM Conferences
                          KDD '16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
                          August 2016
                          2176 pages
                          ISBN:9781450342322
                          DOI:10.1145/2939672
                          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

                          Sponsors

                          Publisher

                          Association for Computing Machinery

                          New York, NY, United States

                          Publication History

                          Published: 13 August 2016

                          Permissions

                          Request permissions for this article.

                          Check for updates

                          Author Tags

                          1. cold-start
                          2. online learning
                          3. recommender systems

                          Qualifiers

                          • Research-article

                          Conference

                          KDD '16
                          Sponsor:

                          Acceptance Rates

                          KDD '16 Paper Acceptance Rate 66 of 1,115 submissions, 6%;
                          Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

                          Contributors

                          Other Metrics

                          Bibliometrics & Citations

                          Bibliometrics

                          Article Metrics

                          • Downloads (Last 12 months)235
                          • Downloads (Last 6 weeks)34
                          Reflects downloads up to 25 Nov 2024

                          Other Metrics

                          Citations

                          Cited By

                          View all
                          • (2025)A Comprehensive Review of Food Recommendation Systems in the Context of Nutritional Therapy for Diabetes MellitusCurrent Nutrition & Food Science10.2174/011573401329700224052206324121:1(14-34)Online publication date: Jan-2025
                          • (2024)Conversational recommender based on graph sparsification and multi-hop attentionIntelligent Data Analysis10.3233/IDA-23014828:1(99-119)Online publication date: 3-Feb-2024
                          • (2024)Knowledge-Enhanced Conversational Recommendation via Transformer-Based Sequential ModelingACM Transactions on Information Systems10.1145/367737642:6(1-27)Online publication date: 18-Oct-2024
                          • (2024)Self-Supervised Bot Play for Transcript-Free Conversational Critiquing with RationalesACM Transactions on Recommender Systems10.1145/36655023:1(1-20)Online publication date: 2-Aug-2024
                          • (2024)SCREEN: A Benchmark for Situated Conversational RecommendationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681651(9591-9600)Online publication date: 28-Oct-2024
                          • (2024)TUT4CRS: Time-aware User-preference Tracking for Conversational Recommendation SystemProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681259(5856-5864)Online publication date: 28-Oct-2024
                          • (2024)A Pilot Study on Multi-Party Conversation Strategies for Group RecommendationsProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665569(1-7)Online publication date: 8-Jul-2024
                          • (2024)Neighborhood-Based Collaborative Filtering for Conversational RecommendationProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688191(1045-1050)Online publication date: 8-Oct-2024
                          • (2024)Bayesian Optimization with LLM-Based Acquisition Functions for Natural Language Preference ElicitationProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688142(74-83)Online publication date: 8-Oct-2024
                          • (2024)Towards Empathetic Conversational Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688133(84-93)Online publication date: 8-Oct-2024
                          • Show More Cited By

                          View Options

                          Login options

                          View options

                          PDF

                          View or Download as a PDF file.

                          PDF

                          eReader

                          View online with eReader.

                          eReader

                          Media

                          Figures

                          Other

                          Tables

                          Share

                          Share

                          Share this Publication link

                          Share on social media