Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3331184.3331192acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

An Efficient Adaptive Transfer Neural Network for Social-aware Recommendation

Published: 18 July 2019 Publication History

Abstract

Many previous studies attempt to utilize information from other domains to achieve better performance of recommendation. Recently, social information has been shown effective in improving recommendation results with transfer learning frameworks, and the transfer part helps to learn users' preferences from both item domain and social domain. However, two vital issues have not been well-considered in existing methods: 1) Usually, a static transfer scheme is adopted to share a user's common preference between item and social domains, which is not robust in real life where the degrees of sharing and information richness are varied for different users. Hence a non-personalized transfer scheme may be insufficient and unsuccessful. 2) Most previous neural recommendation methods rely on negative sampling in training to increase computational efficiency, which makes them highly sensitive to sampling strategies and hence difficult to achieve optimal results in practical applications.
To address the above problems, we propose an Efficient Adaptive Transfer Neural Network (EATNN). By introducing attention mechanisms, the proposed model automatically assign a personalized transfer scheme for each user. Moreover, we devise an efficient optimization method to learn from the whole training set without negative sampling, and further extend it to support multi-task learning. Extensive experiments on three real-world public datasets indicate that our EATNN method consistently outperforms the state-of-the-art methods on Top-K recommendation task, especially for cold-start users who have few item interactions. Remarkably, EATNN shows significant advantages in training efficiency, which makes it more practical to be applied in real E-commerce scenarios. The code is available at (https://github.com/chenchongthu/EATNN).

Supplementary Material

MP4 File (cite2-16h40-d1.mp4)

References

[1]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014).
[2]
Bin Cao, Sinno Jialin Pan, Yu Zhang, Dit-Yan Yeung, and Qiang Yang. 2010. Adaptive Transfer Learning. In Proceedings of AAAI, Vol. 2. 7.
[3]
Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Neural Attentional Rating Regression with Review-level Explanations. In Proceedings of WWW. 1583--1592.
[4]
Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2019. Social Attentional Memory Network: Modeling Aspect-and Friend-level Differences in Recommendation. In Proceedings of WSDM.
[5]
Long Chen, Hanwang Zhang, Jun Xiao, Liqiang Nie, Jian Shao, Wei Liu, and Tat-Seng Chua. 2016. Sca-cnn: Spatial and channel-wise attention in convolutional networks for image captioning. arXiv preprint arXiv:1611.05594 (2016).
[6]
Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for youtube recommendations. In Proceedings of Recsys. 191--198.
[7]
Robin Devooght, Nicolas Kourtellis, and Amin Mantrach. 2015. Dynamic matrix factorization with priors on unknown values. In Proceedings of SIGKDD. 189--198.
[8]
John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, Vol. 12, Jul (2011), 2121--2159.
[9]
Eric Eaton and Marie desJardins. 2011. Selective Transfer Between Learning Tasks Using Task-Based Boosting. In Proceedings of AAAI.
[10]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of WWW. 173--182.
[11]
Xiangnan He, Hanwang Zhang, Min-Yen Kan, and Tat-Seng Chua. 2016. Fast matrix factorization for online recommendation with implicit feedback. In Proceedings of SIGIR. 549--558.
[12]
Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In Proceedings of ICDM. 263--272.
[13]
Yehuda Koren. 2008. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In Proceedings of SIGKDD. 426--434.
[14]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 8 (2009), 30--37.
[15]
Artus Krohn-Grimberghe, Lucas Drumond, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2012. Multi-relational matrix factorization using bayesian personalized ranking for social network data. In Proceedings of WSDM. 173--182.
[16]
Bin Li, Qiang Yang, and Xiangyang Xue. 2009. Transfer learning for collaborative filtering via a rating-matrix generative model. In Proceedings of the 26th annual international conference on machine learning. 617--624.
[17]
Dawen Liang, Laurent Charlin, James McInerney, and David M. Blei. 2016. Modeling user exposure in recommendation. In Proceedings of WWW. 951--961.
[18]
Xiao Lin, Zhang Min, Zhang Yongfeng, Liu Yiqun, and Ma Shaoping. 2017. Learning and transferring social and item visibilities for personalized recommendation. In Proceedings of CIKM. 337--346.
[19]
Zhongqi Lu, Erheng Zhong, Lili Zhao, Evan Wei Xiang, Weike Pan, and Qiang Yang. 2013. Selective transfer learning for cross domain recommendation. In Proceedings of ICDM. 641--649.
[20]
Hao Ma. 2014. On measuring social friend interest similarities in recommender systems. In Proceedings of SIGIR. 465--474.
[21]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Proceedings of NIPS. 3111--3119.
[22]
Seungwhan Moon and Jaime G. Carbonell. 2017. Completely Heterogeneous Transfer Learning with Attention-What And What Not To Transfer. In Proceedings of IJCAI.
[23]
Vinod Nair and Geoffrey E. Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In Proceedings of ICML. 807--814.
[24]
Hyeonseob Nam and Bohyung Han. 2016. Learning multi-domain convolutional neural networks for visual tracking. In Proceedings of CVPR. 4293--4302.
[25]
Weike Pan, Evan Wei Xiang, Nathan Nan Liu, and Qiang Yang. 2010. Transfer Learning in Collaborative Filtering for Sparsity Reduction. In AAAI, Vol. 10. 230--235.
[26]
István Pilászy, Dávid Zibriczky, and Domonkos Tikk. 2010. Fast als-based matrix factorization for explicit and implicit feedback datasets. In Proceedings of Recsys. 71--78.
[27]
Zhaochun Ren, Shangsong Liang, Piji Li, Shuaiqiang Wang, and Maarten de Rijke. 2017. Social collaborative viewpoint regression with explainable recommendations. In Proceedings of WSDM. 485--494.
[28]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of UAI. 452--461.
[29]
Suman Deb Roy, Tao Mei, Wenjun Zeng, and Shipeng Li. 2013. Towards cross-domain learning for social video popularity prediction. IEEE Transactions on multimedia, Vol. 15, 6 (2013), 1255--1267.
[30]
Yu Shi, Qi Zhu, Fang Guo, Chao Zhang, and Jiawei Han. 2018. Easing Embedding Learning by Comprehensive Transcription of Heterogeneous Information Networks. In Proceedings of SIGKDD. 2190--2199.
[31]
Ajit P. Singh and Geoffrey J. Gordon. 2008. Relational learning via collective matrix factorization. In Proceedings of SIGKDD. 650--658.
[32]
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, Vol. 15, 1 (2014), 1929--1958.
[33]
Peijie Sun, Le Wu, and Meng Wang. 2018. Attentive Recurrent Social Recommendation. In Proceedings of SIGIR. 185--194.
[34]
Yi Tay, Anh Tuan Luu, and Siu Cheung Hui. 2018. Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking. In Proceedings of WWW. 729--739.
[35]
Grigorios Tsoumakas and Ioannis Katakis. 2007. Multi-Label Classification: An Overview. International Journal of Data Warehousing and Mining, Vol. 3, 3 (2007), 1--13.
[36]
Maksims Volkovs and Guang Wei Yu. 2015. Effective latent models for binary feedback in recommender systems. In Proceedings of SIGIR. ACM, 313--322.
[37]
Xiang Wang, Xiangnan He, Liqiang Nie, and Tat-Seng Chua. 2017. Item silk road: Recommending items from information domains to social users. In Proceedings of SIGIR. 185--194.
[38]
Jun Xiao, Hao Ye, Xiangnan He, Hanwang Zhang, Fei Wu, and Tat-Seng Chua. 2017. Attentional factorization machines: Learning the weight of feature interactions via attention networks. arXiv preprint arXiv:1708.04617 (2017).
[39]
Xin Xin, Fajie Yuan, Xiangnan He, and Joemon M. Jose. 2018. Batch IS NOT Heavy: LearningWord Representations From All Samples. (2018).
[40]
Wenhui Yu, Huidi Zhang, Xiangnan He, Xu Chen, Li Xiong, and Zheng Qin. 2018. Aesthetic-based clothing recommendation. In Proceedings of WWW. 649--658.
[41]
Fajie Yuan, Xin Xin, Xiangnan He, Guibing Guo, Weinan Zhang, Chua Tat-Seng, and Joemon M. Jose. 2018. fbgd: Learning embeddings from positive unlabeled data with bgd. (2018).
[42]
Kun Zhang, Bernhard Schölkopf, Krikamol Muandet, and Zhikun Wang. 2013. Domain adaptation under target and conditional shift. In Proceedings of ICML. 819--827.
[43]
Tong Zhao, Julian McAuley, and Irwin King. 2014. Leveraging social connections to improve personalized ranking for collaborative filtering. In Proceedings of CIKM. 261--270.
[44]
Erheng Zhong, Wei Fan, and Qiang Yang. 2014. User behavior learning and transfer in composite social networks. ACM Transactions on Knowledge Discovery from Data (TKDD), Vol. 8, 1 (2014), 6.
[45]
Yin Zhu, Yuqiang Chen, Zhongqi Lu, Sinno Jialin Pan, Gui-Rong Xue, Yong Yu, and Qiang Yang. 2011. Heterogeneous Transfer Learning for Image Classification. In Proceedings of AAAI.

Cited By

View all
  • (2024)Un modelo híbrido para la recomendación de libros utilizando reconocimiento facial, filtrado colaborativo y por contenidoRevista General de Información y Documentación10.5209/rgid.9423434:1(45-54)Online publication date: 18-Jul-2024
  • (2024)Soft Contrastive Sequential RecommendationACM Transactions on Information Systems10.1145/366532542:6(1-28)Online publication date: 19-Aug-2024
  • (2024)Mitigating Recommendation Biases via Group-Alignment and Global-Uniformity in Representation LearningACM Transactions on Intelligent Systems and Technology10.1145/366493115:5(1-27)Online publication date: 14-May-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2019
1512 pages
ISBN:9781450361729
DOI:10.1145/3331184
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 July 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. adaptive transfer learning
  2. implicit feedback
  3. recommender systems
  4. social connections
  5. whole-data based learning

Qualifiers

  • Research-article

Funding Sources

  • National Key Research and Development Program of China
  • Natural Science Foundation of China

Conference

SIGIR '19
Sponsor:

Acceptance Rates

SIGIR'19 Paper Acceptance Rate 84 of 426 submissions, 20%;
Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)68
  • Downloads (Last 6 weeks)5
Reflects downloads up to 07 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Un modelo híbrido para la recomendación de libros utilizando reconocimiento facial, filtrado colaborativo y por contenidoRevista General de Información y Documentación10.5209/rgid.9423434:1(45-54)Online publication date: 18-Jul-2024
  • (2024)Soft Contrastive Sequential RecommendationACM Transactions on Information Systems10.1145/366532542:6(1-28)Online publication date: 19-Aug-2024
  • (2024)Mitigating Recommendation Biases via Group-Alignment and Global-Uniformity in Representation LearningACM Transactions on Intelligent Systems and Technology10.1145/366493115:5(1-27)Online publication date: 14-May-2024
  • (2024)Utilizing Non-click Samples via Semi-supervised Learning for Conversion Rate PredictionProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688151(350-359)Online publication date: 8-Oct-2024
  • (2024)Unlocking the Hidden Treasures: Enhancing Recommendations with Unlabeled DataProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688149(247-256)Online publication date: 8-Oct-2024
  • (2024)RecDiff: Diffusion Model for Social RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679630(1346-1355)Online publication date: 21-Oct-2024
  • (2024)MADM: A Model-agnostic Denoising Module for Graph-based Social RecommendationProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635784(501-509)Online publication date: 4-Mar-2024
  • (2024)Sentiment-Time Heterogeneous Residual Graph Attention Transformer for Session-Based RecommendationInternational Journal of Software Engineering and Knowledge Engineering10.1142/S021819402450003734:05(793-820)Online publication date: 19-Mar-2024
  • (2024)Does Negative Sampling Matter? a Review With Insights Into its Theory and ApplicationsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.337147346:8(5692-5711)Online publication date: Aug-2024
  • (2024)Robust Preference-Guided Based Disentangled Graph Social RecommendationIEEE Transactions on Network Science and Engineering10.1109/TNSE.2024.340147611:5(4898-4910)Online publication date: Sep-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media