Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3292500.3330940acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article
Public Access

Coupled Variational Recurrent Collaborative Filtering

Published: 25 July 2019 Publication History

Abstract

We focus on the problem of streaming recommender system and explore novel collaborative filtering algorithms to handle the data dynamicity and complexity in a streaming manner. Although deep neural networks have demonstrated the effectiveness of recommendation tasks, it is lack of explorations on integrating probabilistic models and deep architectures under streaming recommendation settings. Conjoining the complementary advantages of probabilistic models and deep neural networks could enhance both model effectiveness and the understanding of inference uncertainties. To bridge the gap, in this paper, we propose a Coupled Variational Recurrent Collaborative Filtering (CVRCF) framework based on the idea of Deep Bayesian Learning to handle the streaming recommendation problem. The framework jointly combines stochastic processes and deep factorization models under a Bayesian paradigm to model the generation and evolution of users' preferences and items' popularities. To ensure efficient optimization and streaming update, we further propose a sequential variational inference algorithm based on a cross variational recurrent neural network structure. Experimental results on three benchmark datasets demonstrate that the proposed framework performs favorably against the state-of-the-art methods in terms of both temporal dependency modeling and predictive accuracy. The learned latent variables also provide visualized interpretations for the evolution of temporal dynamics.

References

[1]
Deepak Agarwal, Bee-Chung Chen, and Pradheep Elango. 2010. Fast online learning through offline initialization for time-sensitive recommendation. In KDD.
[2]
Alex Beutel, Paul Covington, Sagar Jain, Can Xu, Jia Li, Vince Gatto, and Ed H Chi. 2018. Latent Cross: Making Use of Context in Recurrent Recommender Systems. In WSDM.
[3]
Tamara Broderick, Nicholas Boyd, Andre Wibisono, Ashia C Wilson, and Michael I Jordan. 2013. Streaming variational bayes. In NIPS.
[4]
Badrish Chandramouli, Justin J Levandoski, Ahmed Eldawy, and Mohamed F Mokbel. 2011. StreamRec: a real-time recommender system. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of data.
[5]
Shiyu Chang, Yang Zhang, Jiliang Tang, Dawei Yin, Yi Chang, Mark A Hasegawa-Johnson, and Thomas S Huang. 2017. Streaming recommender systems. In WWW.
[6]
Chen Chen, Hongzhi Yin, Junjie Yao, and Bin Cui. 2013. Terec: A temporal recommender system over tweet stream. Proceedings of the VLDB Endowment (2013).
[7]
Abhinandan S Das, Mayur Datar, Ashutosh Garg, and Shyam Rajaram. 2007. Google news personalization: scalable online collaborative filtering. In WWW.
[8]
Robin Devooght, Nicolas Kourtellis, and Amin Mantrach. 2015. Dynamic matrix factorization with priors on unknown values. In SIGKDD.
[9]
Ernesto Diaz-Aviles, Lucas Drumond, Lars Schmidt-Thieme, and Wolfgang Nejdl. 2012. Real-time top-n recommendation in social streams. In Proceedings of the sixth ACM conference on Recommender systems.
[10]
Simon Dooms. 2018. https://github.com/sidooms/MovieTweetings. Github (2018).
[11]
Arnaud Doucet, Nando De Freitas, and Neil Gordon. 2001. An introduction to sequential Monte Carlo methods. In Sequential Monte Carlo methods in practice. Springer.
[12]
Nan Du, Yichen Wang, Niao He, Jimeng Sun, and Le Song. 2015. Time-sensitive recommendation from recurrent user activities. In NIPS.
[13]
Yuyun Gong and Qi Zhang. 2016. Hashtag Recommendation Using Attention-Based Convolutional Neural Network. In IJCAI.
[14]
GroupLens. 2018. http://movielens.umn.edu. (2018).
[15]
Shixiang Gu, Zoubin Ghahramani, and Richard E Turner. 2015. Neural adaptive sequential monte carlo. In NIPS.
[16]
Kilol Gupta, Mukund Yelahanka Raghuprasad, and Pankhuri Kumar. 2018. A Hybrid Variational Autoencoder for Collaborative Filtering. arXiv preprint arXiv:1808.01006 (2018).
[17]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW.
[18]
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2015. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).
[19]
Seyed Abbas Hosseini, Keivan Alizadeh, Ali Khodadadi, Ali Arabzadeh, Mehrdad Farajtabar, Hongyuan Zha, and Hamid R Rabiee. 2017. Recurrent poisson factorization for temporal recommendation. In KDD.
[20]
Komal Kapoor, Karthik Subbian, Jaideep Srivastava, and Paul Schrater. 2015. Just in time recommendations: Modeling the dynamics of boredom in activity streams. In WSDM.
[21]
Diederik P Kingma and Max Welling. 2014. Auto-encoding variational bayes. In ICLR.
[22]
Yehuda Koren. 2010. Collaborative filtering with temporal dynamics. Commun. ACM (2010).
[23]
Aapo Kyrola, Guy E Blelloch, and Carlos Guestrin. 2012. Graphchi: Large-scale graph computation on just a pc. In USENIX.
[24]
Xiaopeng Li and James She. 2017. Collaborative variational autoencoder for recommender systems. In KDD.
[25]
Andriy Mnih and Ruslan R Salakhutdinov. 2008. Probabilistic matrix factorization. In NIPS.
[26]
Michael C Mozer, Denis Kazakov, and Robert V Lindsey. 2017. Discrete Event, Continuous Time RNNs. arXiv preprint arXiv:1710.04110 (2017).
[27]
Christian A Naesseth, Scott W Linderman, Rajesh Ranganath, and David M Blei. 2017. Variational Sequential Monte Carlo. In AISTATS.
[28]
Netflix. 2009. https://kaggle.com/netflix-inc/netflix-prize-data/data. Kaggle (2009).
[29]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In UAI.
[30]
Steffen Rendle and Lars Schmidt-Thieme. 2008. Online-updating regularized kernel matrix factorization models for large-scale recommender systems. In Proceedings of the 2008 ACM conference on Recommender systems.
[31]
Paul Resnick and Hal R Varian. 1997. Recommender systems. Commun. ACM (1997).
[32]
Francesco Ricci, Lior Rokach, and Bracha Shapira. 2011. Introduction to recommender systems handbook. In Recommender systems handbook. Springer.
[33]
Noveen Sachdeva, Giuseppe Manco, Ettore Ritacco, and Vikram Pudi. 2019. Variational Sequential Autoencoders for Collaborative Filtering. In WSDM.
[34]
Ardavan Saeedi, Tejas D Kulkarni, Vikash K Mansinghka, and Samuel J Gershman. 2017. Variational particle approximations. JMLR (2017).
[35]
Jiaxin Shi, Jianfei Chen, Jun Zhu, Shengyang Sun, Yucen Luo, Yihong Gu, and Yuhao Zhou. 2017. ZhuSuan: A Library for Bayesian Deep Learning. arXiv preprint arXiv:1709.05870 (2017).
[36]
Qingquan Song, Xiao Huang, Hancheng Ge, James Caverlee, and Xia Hu. 2017. Multi-aspect streaming tensor completion. In KDD.
[37]
Yang Song, Ali Mamdouh Elkahky, and Xiaodong He. 2016. Multi-rate deep learning for temporal recommendation. In SIGIR.
[38]
Yang Song, Ziming Zhuang, Huajing Li, Qiankun Zhao, Jia Li, Wang-Chien Lee, and C Lee Giles. 2008. Real-time automatic tag recommendation. In SIGIR.
[39]
Statista. 2018a. http://www.zephoria.com/top-15-valuable-facebook-statistics/. Top 20 valuable Facebook statistics (2018).
[40]
Statista. 2018b. wordstream.com/blog/ws/2017/01/05/social-media-marketing-statistics. 40 Essential Social Media Marketing Statistics for 2018 (2018).
[41]
Karthik Subbian, Charu Aggarwal, and Kshiteesh Hegde. 2016. Recommendations for streaming data. In CIKM.
[42]
Richard E Turner and Maneesh Sahani. 2011. Two problems with variational expectation maximisation for time-series models. Bayesian Time series models (2011).
[43]
Aaron Van den Oord, Sander Dieleman, and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In NIPS.
[44]
Hao Wang, SHI Xingjian, and Dit-Yan Yeung. 2016b. Collaborative recurrent autoencoder: recommend while learning to fill in the blanks. In NIPS.
[45]
Suhang Wang, Yilin Wang, Jiliang Tang, Kai Shu, Suhas Ranganath, and Huan Liu. 2017a. What your images reveal: Exploiting visual contents for point-of-interest recommendation. In WWW.
[46]
Weiqing Wang, Hongzhi Yin, Zi Huang, Qinyong Wang, Xingzhong Du, and Quoc Viet Hung Nguyen. 2018. Streaming Ranking Based Recommender Systems. In SIGIR.
[47]
Xuejian Wang, Lantao Yu, Kan Ren, Guanyu Tao, Weinan Zhang, Yong Yu, and Jun Wang. 2017. Dynamic attention deep model for article recommendation by learning human editors' demonstration. In SIGKDD.
[48]
Yichen Wang, Nan Du, Rakshit Trivedi, and Le Song. 2016. Coevolutionary latent feature processes for continuous-time user-item interactions. In NIPS.
[49]
Andrew Gordon Wilson, Zhiting Hu, Ruslan Salakhutdinov, and Eric P Xing. 2016. Deep kernel learning. In Artificial Intelligence and Statistics.
[50]
Chao-Yuan Wu, Amr Ahmed, Alex Beutel, Alexander J Smola, and How Jing. 2017. Recurrent recommender networks. In WSDM.
[51]
Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei-Ying Ma. 2016. Collaborative knowledge base embedding for recommender systems. In KDD.
[52]
Shuai Zhang, Lina Yao, and Aixin Sun. 2017. Deep learning based recommender system: A survey and new perspectives. arXiv preprint arXiv:1707.07435 (2017).

Cited By

View all
  • (2024)A Survey on Variational Autoencoders in Recommender SystemsACM Computing Surveys10.1145/366336456:10(1-40)Online publication date: 24-Jun-2024
  • (2022)TopicVAE: Topic-aware Disentanglement Representation Learning for Enhanced RecommendationProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548294(511-520)Online publication date: 10-Oct-2022
  • (2021)Semi-deterministic and Contrastive Variational Graph Autoencoder for RecommendationProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482390(382-391)Online publication date: 26-Oct-2021
  • Show More Cited By

Index Terms

  1. Coupled Variational Recurrent Collaborative Filtering

                                  Recommendations

                                  Comments

                                  Please enable JavaScript to view thecomments powered by Disqus.

                                  Information & Contributors

                                  Information

                                  Published In

                                  cover image ACM Conferences
                                  KDD '19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
                                  July 2019
                                  3305 pages
                                  ISBN:9781450362016
                                  DOI:10.1145/3292500
                                  Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                                  Sponsors

                                  Publisher

                                  Association for Computing Machinery

                                  New York, NY, United States

                                  Publication History

                                  Published: 25 July 2019

                                  Permissions

                                  Request permissions for this article.

                                  Check for updates

                                  Author Tags

                                  1. collaborative filtering
                                  2. deep Bayesian learning
                                  3. matrix factorization
                                  4. streaming recommender system

                                  Qualifiers

                                  • Research-article

                                  Funding Sources

                                  Conference

                                  KDD '19
                                  Sponsor:

                                  Acceptance Rates

                                  KDD '19 Paper Acceptance Rate 110 of 1,200 submissions, 9%;
                                  Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

                                  Upcoming Conference

                                  KDD '25

                                  Contributors

                                  Other Metrics

                                  Bibliometrics & Citations

                                  Bibliometrics

                                  Article Metrics

                                  • Downloads (Last 12 months)164
                                  • Downloads (Last 6 weeks)9
                                  Reflects downloads up to 14 Dec 2024

                                  Other Metrics

                                  Citations

                                  Cited By

                                  View all
                                  • (2024)A Survey on Variational Autoencoders in Recommender SystemsACM Computing Surveys10.1145/366336456:10(1-40)Online publication date: 24-Jun-2024
                                  • (2022)TopicVAE: Topic-aware Disentanglement Representation Learning for Enhanced RecommendationProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548294(511-520)Online publication date: 10-Oct-2022
                                  • (2021)Semi-deterministic and Contrastive Variational Graph Autoencoder for RecommendationProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482390(382-391)Online publication date: 26-Oct-2021
                                  • (2021)A Survey on Stream-Based Recommender SystemsACM Computing Surveys10.1145/345344354:5(1-36)Online publication date: 25-May-2021
                                  • (2021)Adversarial and Contrastive Variational Autoencoder for Sequential RecommendationProceedings of the Web Conference 202110.1145/3442381.3449873(449-459)Online publication date: 19-Apr-2021
                                  • (2020)Content-Collaborative Disentanglement Representation Learning for Enhanced RecommendationProceedings of the 14th ACM Conference on Recommender Systems10.1145/3383313.3412239(43-52)Online publication date: 22-Sep-2020
                                  • (2020)Deep learning techniques for recommender systems based on collaborative filteringExpert Systems10.1111/exsy.1264737:6Online publication date: 14-Nov-2020

                                  View Options

                                  View options

                                  PDF

                                  View or Download as a PDF file.

                                  PDF

                                  eReader

                                  View online with eReader.

                                  eReader

                                  Login options

                                  Media

                                  Figures

                                  Other

                                  Tables

                                  Share

                                  Share

                                  Share this Publication link

                                  Share on social media