Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3079628.3079681acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
research-article

A Multi-Armed Bandit Model Selection for Cold-Start User Recommendation

Published: 09 July 2017 Publication History

Abstract

How can we effectively recommend items to a user about whom we have no information? This is the problem we focus on in this paper, known as the cold-start problem. In most existing works, the cold-start problem is handled through the use of many kinds of information available about the user. However, what happens if we do not have any information? Recommender systems usually keep a substantial amount of prediction models that are available for analysis. Moreover, recommendations to new users yield uncertain returns. Assuming that a number of alternative prediction models is available to select items to recommend to a cold user, this paper introduces a multi-armed bandit based model selection, named PdMS. In comparison with three baselines, PdMS improves the performance as measured by the nDCG. These improvements are demonstrated on real, public datasets.

References

[1]
Gediminas Adomavicius and Alexander Tuzhilin. 2011. Context-Aware Recommender Systems. In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, Bracha Shapira, and Paul B. Kantor (Eds.). Springer US, Boston, MA, 217--253.
[2]
D. H. Alahmadi and X. J. Zeng. 2015. Twitter-Based Recommender System to Address Cold-Start: A Genetic Algorithm Based Trust Modelling and Probabilistic Sentiment Analysis. In IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI'15). 1045--1052.
[3]
Peter Auer, ò Cesa-Bianchi, and Paul Fischer. 2002. Finite-time Analysis of the Multiarmed Bandit Problem. Machine Learning 47, 2 (2002), 235--256.
[4]
Iman Barjasteh, Rana Forsati, Farzan Masrour, Abdol-Hossein Esfahanian, and Hayder Radha. 2015. Cold-Start Item and User Recommendation with Decoupled Completion and Transduction. In Proceedings of the 9th ACM Conference on Recommender Systems (RecSys '15). ACM, New York, NY, USA, 91--98.
[5]
Iman Barjasteh, Rana Forsati, Dennis Ross, Abdol-Hossein Esfahanian, and Hayder Radha. 2016. Cold-Start Recommendation with Provable Guarantees: A Decoupled Approach. IEEE Trans. on Knowl. and Data Eng. 28, 6 (June 2016), 1462--1474.
[6]
Daniel Billsus and Michael J. Pazzani. 2000. User Modeling for Adaptive News Access. User Modeling and User-Adapted Interaction 10, 2-3 (Feb. 2000), 147--180.
[7]
Djallel Bouneffouf, Amel Bouzeghoub, and Alda Lopes Gançarski. 2012. A Contextual-Bandit Algorithm for Mobile Context-Aware Recommender System. In Proceedings of the 19th International Conference Neural Information Processing, Doha, Qatar, November 12-15, Part III (ICONIP '12). Springer Berlin Heidelberg, Berlin, Heidelberg, 324--331.
[8]
Matthias Braunhofer, Victor Codina, and Francesco Ricci. 2014. Switching Hybrid for Cold-starting Context-aware Recommender Systems. In Proceedings of the 8th ACM Conference on Recommender Systems (RecSys '14). ACM, New York, NY, USA, 349--352.
[9]
Robin Burke. 2002. Hybrid Recommender Systems: Survey and Experiments. User Modeling and User-Adapted Interaction 12, 4 (Nov. 2002), 331--370.
[10]
Stéphane Caron and Smriti Bhagat. 2013. Mixing Bandits: A Recipe for Improved Cold-start Recommendations in a Social Network. In Proceedings of the 7th Workshop on Social Network Mining and Analysis (SNAKDD '13). ACM, New York, NY, USA, Article 11, 9 pages.
[11]
Shuo Chang, F. Maxwell Harper, and Loren Terveen. 2015. Using Groups of Items for Preference Elicitation in Recommender Systems. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 1258--1269.
[12]
Chen Cheng, Haiqin Yang, Irwin King, and Michael R. Lyu. 2012. Fused Ma- trix Factorization with Geographical and Social Influence in Location-based Social Networks. In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence (AAAI'12). AAAI Press, 17--23.
[13]
Julien Delporte, Alexandros Karatzoglou, Tomasz Matuszczyk, and Stéphane Canu. 2013. Socially Enabled Preference Learning from Implicit Feedback Data. In Machine Learning and Knowledge Discovery in Databases: European Conference, Prague, Czech Republic, Proceedings, Part II, Hendrik Blockeel, Kristian Kersting, Siegfried Nijssen, and Filip Železný (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 145--160.
[14]
Michael Ekstrand and John Riedl. 2012. When Recommenders Fail: Predicting Recommender Failure for Algorithm Selection and Combination. In Proceedings of the Sixth ACM Conference on Recommender Systems (RecSys '12). ACM, New York, NY, USA, 233--236.
[15]
Mehdi Elahi, Francesco Ricci, and Neil Rubens. 2014. Active Learning Strategies for Rating Elicitation in Collaborative Filtering: A System-wide Perspective. ACM Trans. Intell. Syst. Technol. 5, 1, Article 13 (Jan. 2014), 33 pages.
[16]
Crícia Z. Felício, Claudianne M. M. de Almeida, Guilherme Alves, Fabíola S. F. Pereira, Klérisson V. R. Paixão, and Sandra de Amo. 2016. Visual Perception Similarities to Improve the Quality of User Cold Start Recommendations. In Advances in Artificial Intelligence: 29th Canadian Conference on Artificial Intelligence, Proceedings, Richard Khoury and Christopher Drummond (Eds.). Springer International Publishing, Cham, 96--101.
[17]
Crícia Z. Felício, Claudianne M. M. de Almeida, Guilherme Alves, Fabíola S. F. Pereira, Klérisson V. R. Paixão, Sandra de Amo, and Celia A. Z. Barcelos. 2016. VP-Rec: A Hybrid Image Recommender Using Visual Perception Network. In IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI'16). 70--77.
[18]
Crícia Z. Felício, Klérisson V. R. Paixão, Celia A. Z. Barcelos, and Philippe Preux. 2016. Multi-Armed Bandits to Recommend for Cold-Start User. In Proceedings of the 4rd Symposium on Knowledge Discovery, Mining and Learning. 182--185.
[19]
Crícia Zilda Felício, Klérisson Vinícius Ribeiro Paixão, Guilherme Alves, Sandra de Amo, and Philippe Preux. 2016. Exploiting social information in pairwise preference recommender system. Journal of Information and Data Management (JIDM) 7, 2 (2016), 99--115.
[20]
Crícia Zilda Felício, Klérisson Vinícius Ribeiro Paixão, Celia Aparecida Zorzo Barcelos, and Philippe Preux. 2016. Preference-Like Score to Cope with Cold- Start User in Recommender Systems. In IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI'16). 62--69.
[21]
Sertan Girgin, Jérmie Mary, Philippe Preux, and Olivier Nicol. 2012. Manag- ing advertising campaigns -- an approximate planning approach. Frontiers of Computer Science 6, 2 (2012), 209--229.
[22]
Nadav Golbandi, Yehuda Koren, and Ronny Lempel. 2010. On Bootstrapping Recommender Systems. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management (CIKM '10). ACM, New York, NY, USA, 1805--1808.
[23]
Carlos A. Gomez-Uribe and Neil Hunt. 2015. The Netflix Recommender System: Algorithms, Business Value, and Innovation. ACM Trans. Manage. Inf. Syst. 6, 4, Article 13 (Dec. 2015), 19 pages.
[24]
Guibing Guo, Jie Zhang, Zhu Sun, and Neil Yorke-Smith. 2015. LibRec: A Java Library for Recommender Systems. In Posters, Demos, Late-breaking Results and Workshop Proceedings of the 23rd Conference on User Modeling, Adaptation, and Personalization (UMAP 2015), Dublin, Ireland, June 29-July 3, 2015.
[25]
Guibing Guo, Jie Zhang, and Daniel Thalmann. 2012. A Simple but Effective Method to Incorporate Trusted Neighbors in Recommender Systems. In Pro- ceedings of the 20th International Conference on User Modeling, Adaptation, and Personalization (UMAP'12). Springer-Verlag, Berlin, Heidelberg, 114--125.
[26]
Guibing Guo, Jie Zhang, and Neil Yorke-Smith. 2013. A Novel Bayesian Similarity Measure for Recommender Systems. In Proceedings of the Twenty-third International Joint Conference on Artificial Intelligence (IJCAI '13). AAAI Press, 2619--2625.
[27]
Guibing Guo, Jie Zhang, and Neil Yorke-Smith. 2016. A Novel Evidence-Based Bayesian Similarity Measure for Recommender Systems. ACM Trans. Web 10, 2, Article 8 (May 2016), 30 pages.
[28]
F. Maxwell Harper and Joseph A. Konstan. 2015. The MovieLens Datasets: History and Context. ACM Trans. Interact. Intell. Syst. 5, 4, Article 19 (Dec. 2015), 19 pages.
[29]
Mohsen Jamali and Martin Ester. 2010. A Matrix Factorization Technique with Trust Propagation for Recommendation in Social Networks. In Proceedings of the Fourth ACM Conference on Recommender Systems (RecSys '10). ACM, New York, NY, USA, 135--142.
[30]
Dietmar Jannach, Paul Resnick, Alexander Tuzhilin, and Markus Zanker. 2016. Recommender Systems -- Beyond Matrix Completion. Commun. ACM 59, 11 (Oct. 2016), 94--102.
[31]
Daniel Kluver and Joseph A. Konstan. 2014. Evaluating Recommender Behavior for New Users. In Proceedings of the 8th ACM Conference on Recommender Systems (RecSys '14). ACM, New York, NY, USA, 121--128.
[32]
Yehuda Koren. 2008. Factorization Meets the Neighborhood: A Multifaceted Collaborative Filtering Model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '08). ACM, New York, NY, USA, 426--434.
[33]
Anisio Lacerda, Rodrygo L. Santos, Adriano Veloso, and Nivio Ziviani. 2015. Improving Daily Deals Recommendation Using Explore-then-exploit Strategies. Inf. Retr. 18, 2 (April 2015), 95--122.
[34]
Anisio Lacerda, Adriano Veloso, and Nivio Ziviani. 2013. Exploratory and Inter- active Daily Deals Recommendation. In Proceedings of the 7th ACM Conference on Recommender Systems (RecSys '13). ACM, New York, NY, USA, 439--442.
[35]
Lihong Li, Wei Chu, John Langford, and Robert E. Schapire. 2010. A Contextual- bandit Approach to Personalized News Article Recommendation. In Proceedings of the 19th International Conference on World Wide Web (WWW '10). ACM, New York, NY, USA, 661--670.
[36]
Shuai Li, Alexandros Karatzoglou, and Claudio Gentile. 2016. Collaborative Filtering Bandits. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '16). ACM, New York, NY, USA, 539--548.
[37]
Jiahui Liu, Peter Dolan, and Elin Rønby Pedersen. 2010. Personalized News Recommendation Based on Click Behavior. In Proceedings of the 15th International Conference on Intelligent User Interfaces (IUI '10). ACM, New York, NY, USA, 31--40.
[38]
Benedikt Loepp, Tim Hussein, and Jüergen Ziegler. 2014. Choice-based Prefe- rence Elicitation for Collaborative Filtering Recommender Systems. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3085--3094.
[39]
Meilian Lu, Zhen Qin, Yiming Cao, Zhichao Liu, and Mengxing Wang. 2014. Scalable News Recommendation Using Multi-dimensional Similarity and Jaccard-Kmeans Clustering. J. Syst. Softw. 95 (Sept. 2014), 242--251.
[40]
Hao Ma, Tom Chao Zhou, Michael R. Lyu, and Irwin King. 2011. Improving Recommender Systems by Incorporating Social Contextual Information. ACM Trans. Inf. Syst. 29, 2, Article 9 (April 2011), 23 pages.
[41]
Augusto Q. Macedo, Leandro B. Marinho, and Rodrygo L.T. Santos. 2015. Context- Aware Event Recommendation in Event-based Social Networks. In Proceedings of the 9th ACM Conference on Recommender Systems (RecSys '15). ACM, New York, NY, USA, 123--130.
[42]
Jérémie Mary, Romaric Gaudel, and Philippe Preux. 2015. Bandits and Recom- mender Systems. In Revised Selected Papers of the First International Workshop on Machine Learning, Optimization, and Big Data. Vol. 9432. Springer-Verlag, Inc., New York, NY, USA, 325--336.
[43]
Pasquale De Meo, Katarzyna Musial-Gabrys, Domenico Rosaci, Giuseppe M. L. Sarnè, and Lora Aroyo. 2017. Using Centrality Measures to Predict Helpfulness-Based Reputation in Trust Networks. ACM Trans. Internet Technol. 17, 1, Article 8 (Feb. 2017), 20 pages.
[44]
Alan Mislove, Bimal Viswanath, Krishna P. Gummadi, and Peter Druschel. 2010. You Are Who You Know: Inferring User Profiles in Online Social Networks. In Proceedings of the Third ACM International Conference on Web Search and Data Mining (WSDM '10). ACM, New York, NY, USA, 251--260.
[45]
Seung-Taek Park and Wei Chu. 2009. Pairwise Preference Regression for Cold-start Recommendation. In Proceedings of the Third ACM Conference on Recommender Systems (RecSys '09). ACM, New York, NY, USA, 21--28.
[46]
Furong Peng, Xuan Lu, Chao Ma, Yuhua Qian, Jianfeng Lu, and Jingyu Yang. 2017. Multi-level preference regression for cold-start recommendations. International Journal of Machine Learning and Cybernetics (2017), 1--14.
[47]
Andre Luiz Vizine Pereira and Eduardo Raul Hruschka. 2015. Simultaneous co-clustering and learning to address the cold start problem in recommender systems. Knowledge-Based Systems 82 (2015), 11--19.
[48]
Huseyin Polat and Wenliang Du. 2005. SVD-based Collaborative Filtering with Privacy. In Proceedings of the 2005 ACM Symposium on Applied Computing (SAC '05). ACM, New York, NY, USA, 791--795.
[49]
Al Mamunur Rashid, George Karypis, and John Riedl. 2008. Learning Preferences of New Users in Recommender Systems: An Information Theoretic Approach. SIGKDD Explor. Newsl. 10, 2 (Dec. 2008), 90--100.
[50]
Al Mamunur Rashid, George Karypis, and John Riedl. 2008. Learning Preferences of New Users in Recommender Systems: An Information Theoretic Approach. SIGKDD Explor. Newsl. 10, 2 (Dec. 2008), 90--100.
[51]
Alan Said and Alejandro Bellogín. 2014. Comparative Recommender System Evaluation: Benchmarking Recommendation Frameworks. In Proceedings of the 8th ACM Conference on Recommender Systems (RecSys '14). ACM, New York, NY, USA, 129--136.
[52]
Claude Sammut and Geoffrey I. Webb (Eds.). 2010. Leave-One-Out Cross-Validation. Springer US, Boston, MA, 600--601.
[53]
L. Song, C. Tekin, and M. van der Schaar. 2016. Online Learning in Large-Scale Contextual Recommender Systems. IEEE Transactions on Services Computing 9, 3 (May 2016), 433--445.
[54]
Richard S Sutton and Andrew G Barto. 1998. Reinforcement learning: An introduction. MIT press Cambridge.
[55]
Liang Tang, Yexi Jiang, Lei Li, and Tao Li. 2014. Ensemble Contextual Bandits for Personalized Recommendation. In Proceedings of the 8th ACM Conference on Recommender Systems (RecSys '14). ACM, New York, NY, USA, 73--80.
[56]
Chirayu Wongchokprasitti, Jaakko Peltonen, Tuukka Ruotsalo, Payel Bandy-opadhyay, Giulio Jacucci, and Peter Brusilovsky. 2015. User Model in a Box: Cross-System User Model Transfer for Resolving Cold Start Problems. In Proceedings of the 23rd International Conference on User Modeling, Adaptation and Personalization (UMAP'15). Springer International Publishing, Cham, 289--301.
[57]
Z. Zhao, H. Lu, D. Cai, X. He, and Y. Zhuang. 2016. User Preference Learning for Online Social Recommendation. IEEE Transactions on Knowledge and Data Engineering 28, 9 (Sept 2016), 2522--2534

Cited By

View all
  • (2024)Reinforcement Learning in Bug TriagingAdvancing Software Engineering Through AI, Federated Learning, and Large Language Models10.4018/979-8-3693-3502-4.ch011(162-182)Online publication date: 21-Jun-2024
  • (2024)User Cold-Start Learning in Recommender Systems using Monte Carlo Tree SearchACM Transactions on Recommender Systems10.1145/36180023:1(1-23)Online publication date: 2-Aug-2024
  • (2024)A systematic literature review of solutions for cold start problemInternational Journal of System Assurance Engineering and Management10.1007/s13198-024-02359-y15:7(2818-2852)Online publication date: 14-May-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
UMAP '17: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization
July 2017
420 pages
ISBN:9781450346351
DOI:10.1145/3079628
  • General Chairs:
  • Maria Bielikova,
  • Eelco Herder,
  • Program Chairs:
  • Federica Cena,
  • Michel Desmarais
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 July 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cold-start problem
  2. model selection
  3. multi-armed bandits
  4. recommender system

Qualifiers

  • Research-article

Funding Sources

  • CAPES
  • FAPEMIG
  • CNPq
  • CNRS

Conference

UMAP '17
Sponsor:

Acceptance Rates

UMAP '17 Paper Acceptance Rate 29 of 80 submissions, 36%;
Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)45
  • Downloads (Last 6 weeks)2
Reflects downloads up to 27 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Reinforcement Learning in Bug TriagingAdvancing Software Engineering Through AI, Federated Learning, and Large Language Models10.4018/979-8-3693-3502-4.ch011(162-182)Online publication date: 21-Jun-2024
  • (2024)User Cold-Start Learning in Recommender Systems using Monte Carlo Tree SearchACM Transactions on Recommender Systems10.1145/36180023:1(1-23)Online publication date: 2-Aug-2024
  • (2024)A systematic literature review of solutions for cold start problemInternational Journal of System Assurance Engineering and Management10.1007/s13198-024-02359-y15:7(2818-2852)Online publication date: 14-May-2024
  • (2023)An Empirical Assessment of the Performance of Multi-Armed Bandits and Contextual Multi-Armed Bandits in Handling Cold-Start BugsProceedings of the 2023 Fifteenth International Conference on Contemporary Computing10.1145/3607947.3608094(750-758)Online publication date: 3-Aug-2023
  • (2023)User Cold-start Problem in Multi-armed Bandits: When the First Recommendations Guide the User’s ExperienceACM Transactions on Recommender Systems10.1145/35548191:1(1-24)Online publication date: 27-Jan-2023
  • (2023)Exploring Scenarios of Uncertainty about the Users' Preferences in Interactive Recommendation SystemsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591684(1178-1187)Online publication date: 19-Jul-2023
  • (2023)Green Edge Intelligence Scheme for Mobile Keyboard Emoji PredictionIEEE Transactions on Mobile Computing10.1109/TMC.2023.3243955(1-13)Online publication date: 2023
  • (2023)Contextual and Nonstationary Multi-armed Bandits Using the Linear Gaussian State Space Model for the Meta-Recommender System2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53992.2023.10394517(3138-3145)Online publication date: 1-Oct-2023
  • (2023)Challenges and Solutions in Large-Scale News RecommendersHighlights in Practical Applications of Agents, Multi-Agent Systems, and Cognitive Mimetics. The PAAMS Collection10.1007/978-3-031-37593-4_14(170-181)Online publication date: 8-Jul-2023
  • (2022)Fast and Accurate User Cold-Start Learning Using Monte Carlo Tree SearchProceedings of the 16th ACM Conference on Recommender Systems10.1145/3523227.3546786(350-359)Online publication date: 12-Sep-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media