Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3477495.3531927acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

A Review-aware Graph Contrastive Learning Framework for Recommendation

Published: 07 July 2022 Publication History

Abstract

Most modern recommender systems predict users' preferences with two components: user and item embedding learning, followed by the user-item interaction modeling. By utilizing the auxiliary review information accompanied with user ratings, many of the existing review-based recommendation models enriched user/item embedding learning ability with historical reviews or better modeled user-item interactions with the help of available user-item target reviews. Though significant progress has been made, we argue that current solutions for review-based recommendation suffer from two drawbacks. First, as review-based recommendation can be naturally formed as a user-item bipartite graph with edge features from corresponding user-item reviews, how to better exploit this unique graph structure for recommendation? Second, while most current models suffer from limited user behaviors, can we exploit the unique self-supervised signals in the review-aware graph to guide two recommendation components better? To this end, in this paper, we propose a novel Review-aware Graph Contrastive Learning (RGCL) framework for review-based recommendation. Specifically, we first construct a review-aware user-item graph with feature-enhanced edges from reviews, where each edge feature is composed of both the user-item rating and the corresponding review semantics. This graph with feature-enhanced edges can help attentively learn each neighbor node weight for user and item representation learning. After that, we design two additional contrastive learning tasks (i.e., Node Discrimination and Edge Discrimination) to provide self-supervised signals for the two components in recommendation process. Finally, extensive experiments over five benchmark datasets demonstrate the superiority of our proposed RGCL compared to the state-of-the-art baselines.

Supplementary Material

MP4 File (SIGIR22-fp0219.mp4)
Presentation video

References

[1]
Georgios Alexandridis, Thanos Tagaris, Giorgos Siolas, and Andreas Stafylopatis. 2019. From Free -Text User Reviews to Product Recommendation Using Paragraph Vectors and Matrix Factorization. In WWW. 335--343.
[2]
Mohamed Ishmael Belghazi, Aristide Baratin, Sai Rajeshwar, Sherjil Ozair, Yoshua Bengio, Aaron Courville, and Devon Hjelm. 2018. Mutual Information Neural Estimation. In ICML, Vol. 80. 531--540.
[3]
David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. JMLR (2003), 993--1022.
[4]
Jiangxia Cao, Xixun Lin, Shu Guo, Luchen Liu, Tingwen Liu, and Bin Wang. 2021. Bipartite Graph Embedding via Mutual Information Maximization. In WSDM. 635--643.
[5]
Rose Catherine and William Cohen. 2017. TransNets: Learning to Transform for Recommendation. In RecSys. 288--296.
[6]
Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Neural Attentional Rating Regression with Review -Level Explanations. In WWW. 1583--1592.
[7]
Lei Chen, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2019 a. Revisiting Graph Based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach. In AAAI. 27--34.
[8]
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. In ICML. 1597--1607.
[9]
Xu Chen, Yongfeng Zhang, Hongteng Xu, Zheng Qin, and Hongyuan Zha. 2019 b. Adversarial Distillation for Efficient Recommendation with External Knowledge. TOIS, Vol. 37, 1 (2019), 1--28.
[10]
Xin Dong, Jingchao Ni, Wei Cheng, Zhengzhang Chen, Bo Zong, Dongjin Song, Yanchi Liu, Haifeng Chen, and Gerard de Melo. 2020. Asymmetrical Hierarchical Networks with Attentive Interactions for Interpretable Review-based Recommendation. In AAAI. 7667--7674.
[11]
Jingyue Gao, Yang Lin, Yasha Wang, Xiting Wang, Zhao Yang, Yuanduo He, and Xu Chu. 2020. Set-Sequence -Graph: A Multi-View Approach Towards Exploiting Reviews for Recommendation. In CIKM. 395--404.
[12]
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In NeurIPS. 2672--2680.
[13]
Kaveh Hassani and Amir Hosein Khasahmadi. 2020. Contrastive Multi-View Representation Learning on Graphs. In ICML, Vol. 119. 4116--4126.
[14]
Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, YongDong Zhang, and Meng Wang. 2020. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. In SIGIR. 639--648.
[15]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural Collaborative Filtering. In WWW. 173--182.
[16]
R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Phil Bachman, Adam Trischler, and Yoshua Bengio. 2019. Learning deep representations by mutual information estimation and maximization. In ICLR.
[17]
Dongmin Hyun, Chanyoung Park, Min-Chul Yang, Ilhyeon Song, Jung-Tae Lee, and Hwanjo Yu. 2018. Review Sentiment-Guided Scalable Deep Recommender System. In SIGIR. 965--968.
[18]
Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In EMNLP. 1746--1751.
[19]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR.
[20]
Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In ICLR.
[21]
Y. Koren, R. Bell, and C. Volinsky. 2009. Matrix Factorization Techniques for Recommender Systems. Computer, Vol. 42, 8 (2009), 30--37.
[22]
Quoc Le and Tomas Mikolov. 2014. Distributed Representations of Sentences and Documents. In ICML. 1188--1196.
[23]
Zeyu Li, Wei Cheng, Reema Kshetramade, John Houser, Haifeng Chen, and Wei Wang. 2021. Recommend for a Reason: Unlocking the Power of Unsupervised Aspect-Sentiment Co-Extraction. In EMNLP. 763--778.
[24]
Donghua Liu, Jing Li, Bo Du, Jun Chang, and Rong Gao. 2019. DAML: Dual Attention Mutual Learning between Ratings and Reviews for Item Recommendation. In SIGKDD. 344--352.
[25]
Julian McAuley and Jure Leskovec. 2013. Hidden Factors and Hidden Topics: Understanding Rating Dimensions with Review Text. In RecSys. 165--172.
[26]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013. Distributed Representations of Words and Phrases and Their Compositionality. In NerulPS, Vol. 2. 3111--3119.
[27]
Jianmo Ni, Jiacheng Li, and Julian McAuley. 2019. Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects. In EMNLP-IJCNLP. 188--197.
[28]
Francisco J. Pe na, Diarmuid O'Reilly-Morgan, Elias Z. Tragos, Neil Hurley, Erika Duriakova, Barry Smyth, and Aonghus Lawlor. 2020. Combining Rating and Review Data by Initializing Latent Factor Models with Topic Models for Top -N Recommendation. In RecSys. 438--443.
[29]
Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic Matrix Factorization. In NeurIPS. 1257--1264.
[30]
Michael Sejr Schlichtkrull, Thomas N. Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling. 2018. Modeling relational data with graph convolutional networks. In ESWC, Vol. 10843. 593--607.
[31]
Sungyong Seo, Jing Huang, Hao Yang, and Yan Liu. 2017. Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction. In RecSys. 297--305.
[32]
Chuan Shi, Xiaotian Han, Li Song, Xiao Wang, Senzhang Wang, Junping Du, and Philip S. Yu. 2021. Deep Collaborative Filtering with Multi-Aspect Information in Heterogeneous Networks. TKDE, Vol. 33, 4 (2021), 1413--1425.
[33]
Jianlin Su, Jiarun Cao, Weijie Liu, and Yangyiwen Ou. 2021. Whitening sentence representations for better semantics and faster retrieval. arXiv preprint arXiv:2103.15316 (2021).
[34]
Peijie Sun, Le Wu, Kun Zhang, Yanjie Fu, Richang Hong, and Meng Wang. 2020. Dual Learning for Explainable Recommendation: Towards Unifying User Preference Prediction and Review Generation. In WWW. 837--847.
[35]
Peijie Sun, Le Wu, Kun Zhang, Yu Su, and Meng Wang. 2021. An Unsupervised Aspect-Aware Recommendation Model with Explanation Text Generation. ACM TOIS, Vol. 40, 3, Article 63 (nov 2021).
[36]
Yi Tay, Anh Tuan Luu, and Siu Cheung Hui. 2018. Multi-Pointer Co-Attention Networks for Recommendation. In SIGKDD. 2309--2318.
[37]
Rianne van den Berg, Thomas N. Kipf, and Max Welling. 2017. Graph Convolutional Matrix Completion. KDD Deep Learning Day (2017).
[38]
Aäron van den Oord, Yazhe Li, and Oriol Vinyals. 2018. Representation Learning with Contrastive Predictive Coding. CoRR, Vol. abs/1807.03748 (2018).
[39]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In NeurIPS. 5998--6008.
[40]
Petar Veličković, William Fedus, William L. Hamilton, Pietro Liò, Yoshua Bengio, and R Devon Hjelm. 2019. Deep Graph Infomax. In ICLR.
[41]
Chong Wang and David M. Blei. 2011. Collaborative Topic Modeling for Recommending Scientific Articles. In SIGKDD. 448--456.
[42]
Chuhan Wu, Fangzhao Wu, Junxin Liu, and Yongfeng Huang. 2019 b. Hierarchical User and Item Representation with Three -Tier Attention for Recommendation. In NAACL. 1818--1826.
[43]
Chuhan Wu, Fangzhao Wu, Tao Qi, Suyu Ge, Yongfeng Huang, and Xing Xie. 2019 c. Reviews Meet Graphs: Enhancing User and Item Representations for Recommendation with Hierarchical Attentive Graph Neural Network. In EMNLP-IJCNLP. 4884--4893.
[44]
Jiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He, Liang Chen, Jianxun Lian, and Xing Xie. 2021 b. Self-Supervised Graph Learning for Recommendation. In SIGIR. 726--735.
[45]
Le Wu, Lei Chen, Pengyang Shao, Richang Hong, Xiting Wang, and Meng Wang. 2021 a. Learning Fair Representations for Recommendation: A Graph-based Perspective. In WWW. 2198--2208.
[46]
Le Wu, Xiangnan He, Xiang Wang, Kun Zhang, and Meng Wang. 2022. A Survey on Accuracy-oriented Neural Recommendation: From Collaborative Filtering to Information-rich Recommendation. TKDE (2022), 1--1.
[47]
Libing Wu, Cong Quan, Chenliang Li, Qian Wang, Bolong Zheng, and Xiangyang Luo. 2019 a. A Context -Aware User -Item Representation Learning for Item Recommendation. TOIS, Vol. 37, 2 (2019), 22:1--22:29.
[48]
Wudong Xi, Ling Huang, Changdong Wang, Yinyu Zheng, and Jianhuang Lai. 2021. Deep Rating and Review Neural Network for Item Recommendation. TNNLS (2021), 1--11.
[49]
Yonghui Yang, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2021. Enhanced Graph Learning for Collaborative Filtering via Mutual Information Maximization. In SIGIR. 71--80.
[50]
Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, and Yang Shen. 2020. Graph Contrastive Learning with Augmentations. In NerulPS, Vol. 33. 5812--5823.
[51]
Junliang Yu, Hongzhi Yin, Min Gao, Xin Xia, Xiangliang Zhang, and Nguyen Quoc Viet Hung. 2021. Socially-Aware Self-Supervised Tri-Training for Recommendation. In SIGKDD. 2084--2092.
[52]
Chaoyang Li Zeyu Liang, Junping Du. 2020. Abstractive social media text summarization using selective reinforced Seq2Seq attention model. Neurocomputing, Vol. 410 (2020), 432--440.
[53]
Kun Zhang, Guangyi Lv, Linyuan Wang, Le Wu, Enhong Chen, Fangzhao Wu, and Xing Xie. 2019. Drr-net: Dynamic re-read network for sentence semantic matching. In AAAI. 7442--7449.
[54]
Lei Zheng, Vahid Noroozi, and Philip S. Yu. 2017. Joint Deep Modeling of Users and Items Using Reviews for Recommendation. In WSDM. 425--434.
[55]
Yanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu, Shu Wu, and Liang Wang. 2020. Deep Graph Contrastive Representation Learning. In ICML Workshop.

Cited By

View all
  • (2024)ASKAT: Aspect Sentiment Knowledge Graph Attention Network for RecommendationElectronics10.3390/electronics1301021613:1(216)Online publication date: 3-Jan-2024
  • (2024)Deep graph contrastive learning model for drug-drug interaction predictionPLOS ONE10.1371/journal.pone.030479819:6(e0304798)Online publication date: 17-Jun-2024
  • (2024)Multimodal Pre-training for Sequential Recommendation via Contrastive LearningACM Transactions on Recommender Systems10.1145/36820753:1(1-23)Online publication date: 29-Jul-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2022
3569 pages
ISBN:9781450387323
DOI:10.1145/3477495
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. graph contrastive learning
  2. recommender systems
  3. review-based recommendation

Qualifiers

  • Research-article

Funding Sources

  • CCF-AFSG Research Fund
  • the National Natural Science Foundation of China
  • the Open Project Program of the National Laboratory of Pattern Recognition (NLPR)
  • the Co-operative Innovation Project of Colleges in Anhui
  • the Young Elite Scientists Sponsorship Program by CAST and ISZ

Conference

SIGIR '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)543
  • Downloads (Last 6 weeks)51
Reflects downloads up to 13 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)ASKAT: Aspect Sentiment Knowledge Graph Attention Network for RecommendationElectronics10.3390/electronics1301021613:1(216)Online publication date: 3-Jan-2024
  • (2024)Deep graph contrastive learning model for drug-drug interaction predictionPLOS ONE10.1371/journal.pone.030479819:6(e0304798)Online publication date: 17-Jun-2024
  • (2024)Multimodal Pre-training for Sequential Recommendation via Contrastive LearningACM Transactions on Recommender Systems10.1145/36820753:1(1-23)Online publication date: 29-Jul-2024
  • (2024)Aspect-enhanced Explainable Recommendation with Multi-modal Contrastive LearningACM Transactions on Intelligent Systems and Technology10.1145/3673234Online publication date: 19-Jun-2024
  • (2024)ANAGL: A Noise-Resistant and Anti-Sparse Graph Learning for Micro-Video RecommendationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/367040720:9(1-15)Online publication date: 3-Jun-2024
  • (2024)DIRECT: Dual Interpretable Recommendation with Multi-aspect Word AttributionACM Transactions on Intelligent Systems and Technology10.1145/366348315:5(1-21)Online publication date: 6-May-2024
  • (2024)Beyond Relevance: Factor-level Causal Explanation for User Travel Decisions with Counterfactual Data AugmentationACM Transactions on Information Systems10.1145/365367342:5(1-31)Online publication date: 29-Apr-2024
  • (2024)Unveiling Vulnerabilities of Contrastive Recommender Systems to Poisoning AttacksProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671795(3311-3322)Online publication date: 25-Aug-2024
  • (2024)Enhancing Content-based Recommendation via Large Language ModelProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679913(4153-4157)Online publication date: 21-Oct-2024
  • (2024)Social Influence Learning for Recommendation SystemsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679598(312-322)Online publication date: 21-Oct-2024
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media