Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3539597.3570422acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article
Public Access

SGCCL: Siamese Graph Contrastive Consensus Learning for Personalized Recommendation

Published: 27 February 2023 Publication History

Abstract

Contrastive-learning-based neural networks have recently been introduced to recommender systems, due to their unique advantage of injecting collaborative signals to model deep representations, and the self-supervision nature in the learning process. Existing contrastive learning methods for recommendations are mainly proposed through introducing augmentations to the user-item (U-I) bipartite graphs. Such a contrastive learning process, however, is susceptible to bias towards popular items and users, because higher-degree users/items are subject to more augmentations and their correlations are more captured. In this paper, we advocate a <u>S</u>iamese <u>G</u>raph <u>C</u>ontrastive <u>C</u>onsensus <u>L</u>earning (SGCCL) framework, to explore intrinsic correlations and alleviate the bias effects for personalized recommendation. Instead of augmenting original U-I networks, we introduce siamese graphs, which are homogeneous relations of user-user (U-U) similarity and item-item (I-I) correlations. A contrastive consensus optimization process is also adopted to learn effective features for user-item ratings, user-user similarity, and item-item correlation. Finally, we employ the self-supervised learning coupled with the siamese item-item/user-user graph relationships, which ensures unpopular users/items are well preserved in the embedding space. Different from existing studies, SGCCL performs well on both overall and debiasing recommendation tasks resulting in a balanced recommender. Experiments on four benchmark datasets demonstrate that SGCCL outperforms state-of-the-art methods with higher accuracy and greater long-tail item/user exposure.

Supplementary Material

MP4 File (WSDM23-fp0374.mp4)
Presentation video.

References

[1]
Himan Abdollahpouri, Masoud Mansoury, Robin Burke, and Bamshad Mobasher. 2019. The unfairness of popularity bias in recommendation. arXiv preprint arXiv:1907.13286 (2019).
[2]
Rianne van den Berg, Thomas N Kipf, and Max Welling. 2017. Graph convolutional matrix completion. arXiv preprint arXiv:1706.02263 (2017).
[3]
Stephen Bonner and Flavian Vasile. 2018. Causal embeddings for recommendation. In Proceedings of the 12th ACM conference on recommender systems. 104--112.
[4]
Hsinchun Chen, Xin Li, and Zan Huang. 2005. Link prediction approach to collaborative filtering. In Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL'05). IEEE, 141--142.
[5]
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. In International conference on machine learning. PMLR, 1597--1607.
[6]
Pierre Comon, Xavier Luciani, and André LF De Almeida. 2009. Tensor decompositions, alternating least squares and other tales. Journal of Chemometrics: A Journal of the Chemometrics Society, Vol. 23, 7--8 (2009), 393--405.
[7]
Chris Ding and Tao Li. 2010. Convex and semi-nonnegative matrix factorizations. IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 32, 1 (2010), 45--55.
[8]
GH Golub and CF Van Loan (Eds.). 2013. Matrix computations 4th edition. Vol. 3. Johns Hopkins University Press, Baltimore Maryland.
[9]
Michael Gutmann and Aapo Hyv"arinen. 2010. Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In Proceedings of the thirteenth international conference on artificial intelligence and statistics. JMLR Workshop and Conference Proceedings, 297--304.
[10]
F Maxwell Harper and Joseph A Konstan. 2015. The movielens datasets: History and context. Acm Trans. on Interactive Intelligent Systems, Vol. 5, 4 (2015), 1--19.
[11]
Ruining He and Julian McAuley. 2016a. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In proceedings of the 25th international conference on world wide web. 507--517.
[12]
Ruining He and Julian McAuley. 2016b. VBPR: visual bayesian personalized ranking from implicit feedback. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 30.
[13]
Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yongdong Zhang, and Meng Wang. 2020. Lightgcn: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 639--648.
[14]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web. 173--182.
[15]
Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013).
[16]
Thomas N Kipf and Max Welling. 2016. Variational graph auto-encoders. arXiv preprint arXiv:1611.07308 (2016).
[17]
Dawen Liang, Laurent Charlin, and David M Blei. 2016a. Causal inference for recommendation. In Causation: Foundation to Application, Wksp at UAI. AUAI.
[18]
Dawen Liang, Laurent Charlin, James McInerney, and David M Blei. 2016b. Modeling user exposure in recommendation. In Proceedings of the 25th international conference on World Wide Web. 951--961.
[19]
Shikun Liu, Edward Johns, and Andrew J Davison. 2019. End-to-end multi-task learning with attention. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 1871--1880.
[20]
Zhuang Liu, Yunpu Ma, Yuanxin Ouyang, and Zhang Xiong. 2021. Contrastive Learning for Recommender System. arXiv preprint arXiv:2101.01317 (2021).
[21]
Xin Luo, Mengchu Zhou, Yunni Xia, and Q. Zhu. 2014. An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans. on Industrial Informatics, Vol. 10, 2 (2014), 1273--1284.
[22]
Yuqi Qin, Pengfei Wang, and Chenliang Li. 2021. The world is binary: Contrastive learning for denoising next basket recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 859--868.
[23]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2012. BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618 (2012).
[24]
Masahiro Sato, Janmajay Singh, Sho Takemori, Takashi Sonoda, Qian Zhang, and Tomoko Ohkuma. 2020. Modeling user exposure with recommendation influence. In Proc. of the 35th ACM Symposium on Applied Computing. 1461--1464.
[25]
Lalita Sharma and Anju Gera. 2013. A survey of recommendation system: Research challenges. International Journal of Engineering Trends and Technology (IJETT), Vol. 4, 5 (2013), 1989--1992.
[26]
Jianing Sun, Yingxue Zhang, Wei Guo, Huifeng Guo, Ruiming Tang, Xiuqiang He, Chen Ma, and Mark Coates. 2020. Neighbor interaction aware graph convolution networks for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1289--1298.
[27]
Jianing Sun, Yingxue Zhang, Chen Ma, Mark Coates, Huifeng Guo, Ruiming Tang, and Xiuqiang He. 2019. Multi-graph convolution collaborative filtering. In 2019 IEEE International Conference on Data Mining (ICDM). IEEE, 1306--1311.
[28]
Laurens van der Maaten. 2014. Accelerating t-SNE using tree-based algorithms. The Journal of Machine Learning Research, Vol. 15, 1 (2014), 3221--3245.
[29]
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019. Neural graph collaborative filtering. In Proc. of the 42nd Intl. ACM SIGIR Conf. on Information Retrieval. 165--174.
[30]
Felix Wu, Amauri Souza, Tianyi Zhang, Christopher Fifty, Tao Yu, and Kilian Weinberger. 2019. Simplifying graph convolutional networks. In International conference on machine learning. PMLR, 6861--6871.
[31]
Jiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He, Liang Chen, Jianxun Lian, and Xing Xie. 2021. Self-supervised graph learning for recommendation. In Proc. of the 44th ACM SIGIR Conf. 726--735.
[32]
Zhe Xie, Chengxuan Liu, Yichi Zhang, Hongtao Lu, Dong Wang, and Yue Ding. 2021. Adversarial and contrastive variational autoencoder for sequential recommendation. In Proceedings of the Web Conference 2021. 449--459.
[33]
Jixing Xu, Zhenlong Zhu, Jianxin Zhao, Xuanye Liu, Minghui Shan, and Jiecheng Guo. 2020. Gemini: A Novel and Universal Heterogeneous Graph Information Fusing Framework for Online Recommendations. In Proc. of the 26th ACM SIGKDD Intl. Conf. on Knowledge Discovery & Data Mining. 3356--3365.
[34]
Jheng-Hong Yang, Chih-Ming Chen, Chuan-Ju Wang, and Ming-Feng Tsai. 2018. HOP-rec: high-order proximity for implicit recommendation. In Proceedings of the 12th ACM Conference on Recommender Systems. 140--144.
[35]
Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L Hamilton, and Jure Leskovec. 2018. Graph convolutional neural networks for web-scale recommender systems. In Proc. of the 24th ACM SIGKDD Conf. 974--983.
[36]
Muhan Zhang and Yixin Chen. 2018. Link prediction based on graph neural networks. Advances in Neural Info. Proc. Systems, Vol. 31 (2018), 5165--5175.
[37]
Yu Zheng, Chen Gao, Xiang Li, Xiangnan He, Yong Li, and Depeng Jin. 2021. Disentangling User Interest and Conformity for Recommendation with Causal Embedding. In Proceedings of the Web Conference 2021. 2980--2991.
[38]
Yu Zheng, Ruiqi Hu, Sai-fu Fung, Celina Yu, Guodong Long, Ting Guo, and Shirui Pan. 2020. Clustering social audiences in business information networks. Pattern Recognition, Vol. 100 (2020), 107126.
[39]
Yanqiao Zhu, Yichen Xu, Qiang Liu, and Shu Wu. 2021. An empirical study of graph contrastive learning. arXiv preprint arXiv:2109.01116 (2021).
[40]
Ziwei Zhu, Jianling Wang, and James Caverlee. 2020. Measuring and mitigating item under-recommendation bias in personalized ranking systems. In Proc. of the 43rd Intl. ACM SIGIR Conf. on Information Retrieval. 449--458.

Cited By

View all
  • (2024)Rethinking Graph Contrastive Learning: An Efficient Single-View Approach via Instance DiscriminationIEEE Transactions on Multimedia10.1109/TMM.2023.331326726(3616-3625)Online publication date: 1-Jan-2024
  • (2024)Revolutionizing Personal Recommendations via Federated Contrastive Transformer Learning2024 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)10.1109/IPDPSW63119.2024.00152(853-856)Online publication date: 27-May-2024
  • (2024)Cross-Grained Neural Collaborative Filtering for RecommendationIEEE Access10.1109/ACCESS.2024.338437612(48853-48864)Online publication date: 2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
WSDM '23: Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining
February 2023
1345 pages
ISBN:9781450394079
DOI:10.1145/3539597
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 February 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. consensus learning
  2. graph contrastive learning
  3. popularity bias
  4. recommender system

Qualifiers

  • Research-article

Funding Sources

  • U.S. National Science Foundation

Conference

WSDM '23

Acceptance Rates

Overall Acceptance Rate 498 of 2,863 submissions, 17%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)529
  • Downloads (Last 6 weeks)52
Reflects downloads up to 14 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Rethinking Graph Contrastive Learning: An Efficient Single-View Approach via Instance DiscriminationIEEE Transactions on Multimedia10.1109/TMM.2023.331326726(3616-3625)Online publication date: 1-Jan-2024
  • (2024)Revolutionizing Personal Recommendations via Federated Contrastive Transformer Learning2024 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)10.1109/IPDPSW63119.2024.00152(853-856)Online publication date: 27-May-2024
  • (2024)Cross-Grained Neural Collaborative Filtering for RecommendationIEEE Access10.1109/ACCESS.2024.338437612(48853-48864)Online publication date: 2024
  • (2024)Contrastive message passing for robust graph neural networks with sparse labelsNeural Networks10.1016/j.neunet.2024.106912(106912)Online publication date: Nov-2024
  • (2024)Deep Contrastive Clustering via Hard positive sample DebiasedNeurocomputing10.1016/j.neucom.2023.127147570:COnline publication date: 12-Apr-2024
  • (2024)Bottom-up propagation of hierarchical dependency for multi-behavior recommendationEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.109364138(109364)Online publication date: Dec-2024
  • (2024)Providing prediction reliability through deep neural networks for recommender systemsComputers and Industrial Engineering10.1016/j.cie.2023.109627185:COnline publication date: 27-Feb-2024
  • (2024)Federated Constrastive Learning and Visual Transformers for Personal RecommendationCognitive Computation10.1007/s12559-024-10286-016:5(2551-2565)Online publication date: 8-May-2024
  • (2024)Higher-Order Graph Contrastive Learning for RecommendationDatabase Systems for Advanced Applications10.1007/978-981-97-5572-1_3(35-51)Online publication date: 31-Aug-2024
  • (2023)Graph-based Text Classification by Contrastive Learning with Text-level Graph AugmentationACM Transactions on Knowledge Discovery from Data10.1145/363835318:4(1-21)Online publication date: 22-Dec-2023
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media