Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3534678.3539473acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Self-Supervised Hypergraph Transformer for Recommender Systems

Published: 14 August 2022 Publication History

Abstract

Graph Neural Networks (GNNs) have been shown as promising solutions for collaborative filtering (CF) with the modeling of user-item interaction graphs. The key idea of existing GNN-based recommender systems is to recursively perform the message passing along the user-item interaction edge for refining the encoded embeddings. Despite their effectiveness, however, most of the current recommendation models rely on sufficient and high-quality training data, such that the learned representations can well capture accurate user preference. User behavior data in many practical recommendation scenarios is often noisy and exhibits skewed distribution, which may result in suboptimal representation performance in GNN-based models. In this paper, we propose SHT, a novel Self-Supervised Hypergraph Transformer framework (SHT) which augments user representations by exploring the global collaborative relationships in an explicit way. Specifically, we first empower the graph neural CF paradigm to maintain global collaborative effects among users and items with a hypergraph transformer network. With the distilled global context, a cross-view generative self-supervised learning component is proposed for data augmentation over the user-item interaction graph, so as to enhance the robustness of recommender systems. Extensive experiments demonstrate that SHT can significantly improve the performance over various state-of-the-art baselines. Further ablation studies show the superior representation ability of our SHT recommendation framework in alleviating the data sparsity and noise issues. The source code and evaluation datasets are available at: https://github.com/akaxlh/SHT.

References

[1]
Rianne van den Berg, Thomas N Kipf, and Max Welling. 2017. Graph convolutional matrix completion. In KDD.
[2]
Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua. 2017. Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In SIGIR. 335--344.
[3]
Lei Chen, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2020. Revisiting Graph Based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach. In AAAI, Vol. 34. 27--34.
[4]
Yudong Chen, Xin Wang, Miao Fan, Jizhou Huang, Shengwen Yang, et al. 2021. Curriculum meta-learning for next POI recommendation. In KDD. 2692--2702.
[5]
Ruocheng Guo, Xiaoting Zhao, Adam Henderson, Liangjie Hong, and Huan Liu. 2020. Debiasing grid-based product search in e-commerce. In KDD. 2852--2860.
[6]
Xiangnan He, Kuan Deng, Xiang Wang, et almbox. 2020. Lightgcn: Simplifying and powering graph convolution network for recommendation. In SIGIR. 639--648.
[7]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW. 173--182.
[8]
Chao Huang. 2021. Recent advances in heterogeneous relation learning for recommendation. arXiv preprint arXiv:2110.03455 (2021).
[9]
Chao Huang, Huance Xu, Yong Xu, Peng Dai, Lianghao Xiao, Mengyin Lu, Liefeng Bo, Hao Xing, Xiaoping Lai, and Yanfang Ye. 2021. Knowledge-aware coupled graph neural network for social recommendation. In AAAI.
[10]
Dasol Hwang, Jinyoung Park, Sunyoung Kwon, KyungMin Kim, Jung-Woo Ha, and Hyunwoo J Kim. 2020. Self-supervised auxiliary learning with meta-paths for heterogeneous graphs. NIPS, Vol. 33 (2020), 10294--10305.
[11]
Shuyi Ji, Yifan Feng, Rongrong Ji, Xibin Zhao, Wanwan Tang, and Yue Gao. 2020. Dual channel hypergraph collaborative filtering. In KDD. 2020--2029.
[12]
Minguk Kang and Jaesik Park. 2020. Contragan: Contrastive learning for conditional image generation. NIPS, Vol. 33 (2020), 21357--21369.
[13]
Yehuda Koren, Robert Bell, et almbox. 2009. Matrix factorization techniques for recommender systems. Computer 8 (2009), 30--37.
[14]
Adit Krishnan, Ashish Sharma, et al. 2018. An adversarial approach to improve long-tail performance in neural collaborative filtering. In CIKM. 1491--1494.
[15]
Dawen Liang, Rahul G Krishnan, Matthew D Hoffman, and Tony Jebara. 2018. Variational autoencoders for collaborative filtering. In WWW. 689--698.
[16]
Xiao Liu, Fanjin Zhang, Zhenyu Hou, Li Mian, Zhaoyu Wang, Jing Zhang, and Jie Tang. 2021 b. Self-supervised learning: Generative or contrastive. TKDE (2021).
[17]
Yiyu Liu, Qian Liu, Yu Tian, et al. 2021 a. Concept-Aware Denoising Graph Neural Network for Micro-Video Recommendation. In CIKM. 1099--1108.
[18]
Zhen Peng, Wenbing Huang, Minnan Luo, et al. 2020. Graph representation learning via graphical mutual information maximization. In WWW. 259--270.
[19]
Ruiyang Ren, Zhaoyang Liu, Yaliang Li, Wayne Xin Zhao, Hui Wang, Bolin Ding, and Ji-Rong Wen. 2020. Sequential recommendation with self-attentive multi-adversarial network. In SIGIR. 89--98.
[20]
Steffen Rendle, Walid Krichene, Li Zhang, and John Anderson. 2020. Neural collaborative filtering vs. matrix factorization revisited. In Recsys. 240--248.
[21]
Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. 2015. Autorec: Autoencoders meet collaborative filtering. In WWW. 111--112.
[22]
Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019. BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer. In CIKM. 1441--1450.
[23]
Petar Velickovic, William Fedus, William L Hamilton, Pietro Liò, Yoshua Bengio, and R Devon Hjelm. 2019. Deep Graph Infomax. In ICLR.
[24]
Ivan Vulić, Edoardo Maria Ponti, Anna Korhonen, and Goran Glavavs. 2021. LexFit: Lexical fine-tuning of pretrained language models. In ACL. 5269--5283.
[25]
Jianling Wang, Kaize Ding, Liangjie Hong, Huan Liu, and James Caverlee. 2020 a. Next-item recommendation with sequential hypergraphs. In SIGIR. 1101--1110.
[26]
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019 a. Neural Graph Collaborative Filtering. In SIGIR.
[27]
Xiao Wang, Houye Ji, Chuan Shi, Bai Wang, Yanfang Ye, Peng Cui, and Philip S Yu. 2019 b. Heterogeneous graph attention network. In WWW. 2022--2032.
[28]
Xiang Wang, Hongye Jin, An Zhang, Xiangnan He, Tong Xu, and Tat-Seng Chua. 2020 b. Disentangled graph collaborative filtering. In SIGIR. 1001--1010.
[29]
Yifan Wang, Suyao Tang, et al. 2020 c. Disenhan: Disentangled heterogeneous graph attention network for recommendation. In CIKM. 1605--1614.
[30]
Felix Wu, Amauri Souza, Tianyi Zhang, Christopher Fifty, Tao Yu, et almbox. 2019. Simplifying graph convolutional networks. In ICML. PMLR, 6861--6871.
[31]
Jiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He, Liang Chen, Jianxun Lian, et al. 2021. Self-supervised graph learning for recommendation. In SIGIR. 726--735.
[32]
Lianghao Xia, Chao Huang, Yong Xu, Peng Dai, Xiyue Zhang, Hongsheng Yang, Jian Pei, and Liefeng Bo. 2021 a. Knowledge-enhanced hierarchical graph transformer network for multi-behavior recommendation. In AAAI, Vol. 35. 4486--4493.
[33]
Lianghao Xia, Chao Huang, Yong Xu, Jiashu Zhao, Dawei Yin, and Jimmy Xiangji Huang. 2022. Hypergraph Contrastive Collaborative Filtering. arXiv preprint arXiv:2204.12200 (2022).
[34]
Lianghao Xia, Yong Xu, Chao Huang, Peng Dai, and Liefeng Bo. 2021 b. Graph meta network for multi-behavior recommendation. In SIGIR. 757--766.
[35]
Haoran Yang, Hongxu Chen, Lin Li, et almbox. 2021. Hyper Meta-Path Contrastive Learning for Multi-Behavior Recommendation. In ICDM. IEEE, 787--796.
[36]
Yuhao Yang, Chao Huang, Lianghao Xia, and Chenliang Li. 2022. Knowledge Graph Contrastive Learning for Recommendation. arXiv preprint arXiv:2205.00976 (2022).
[37]
Tiansheng Yao, Xinyang Yi, Derek Zhiyuan Cheng, et al. 2021. Self-supervised Learning for Large-scale Item Recommendations. In CIKM. 4321--4330.
[38]
Rex Ying, Ruining He, Kaifeng Chen, et al. 2018. Graph convolutional neural networks for web-scale recommender systems. In KDD. 974--983.
[39]
Junliang Yu, Hongzhi Yin, Jundong Li, Qinyong Wang, Nguyen Quoc Viet Hung, and Xiangliang Zhang. 2021. Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendation. In WWW. 413--424.
[40]
Jiani Zhang, Xingjian Shi, Shenglin Zhao, et al. 2019. Star-gcn: Stacked and reconstructed graph convolutional networks for recommender systems. In IJCAI.
[41]
Yin Zhang, Derek Zhiyuan Cheng, Tiansheng Yao, Xinyang Yi, Lichan Hong, and Ed H Chi. 2021 a. A model of two tales: Dual transfer learning framework for improved long-tail item recommendation. In WWW. 2220--2231.
[42]
Yang Zhang, Fuli Feng, Xiangnan He, Tianxin Wei, et al. 2021 b. Causal intervention for leveraging popularity bias in recommendation. In SIGIR. 11--20.

Cited By

View all
  • (2025)Global and local hypergraph learning method with semantic enhancement for POI recommendationInformation Processing & Management10.1016/j.ipm.2024.10386862:1(103868)Online publication date: Jan-2025
  • (2024)Self-Supervised Hypergraph Learning for Knowledge-Aware Social RecommendationElectronics10.3390/electronics1307130613:7(1306)Online publication date: 31-Mar-2024
  • (2024)Multi-Channel Hypergraph Collaborative Filtering with Attribute InferenceElectronics10.3390/electronics1305090313:5(903)Online publication date: 27-Feb-2024
  • Show More Cited By

Index Terms

  1. Self-Supervised Hypergraph Transformer for Recommender Systems

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '22: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
    August 2022
    5033 pages
    ISBN:9781450393850
    DOI:10.1145/3534678
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 August 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. graph neural networks
    2. hypergraph representation
    3. recommender system
    4. self-supervised learning

    Qualifiers

    • Research-article

    Conference

    KDD '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)457
    • Downloads (Last 6 weeks)32
    Reflects downloads up to 22 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Global and local hypergraph learning method with semantic enhancement for POI recommendationInformation Processing & Management10.1016/j.ipm.2024.10386862:1(103868)Online publication date: Jan-2025
    • (2024)Self-Supervised Hypergraph Learning for Knowledge-Aware Social RecommendationElectronics10.3390/electronics1307130613:7(1306)Online publication date: 31-Mar-2024
    • (2024)Multi-Channel Hypergraph Collaborative Filtering with Attribute InferenceElectronics10.3390/electronics1305090313:5(903)Online publication date: 27-Feb-2024
    • (2024)RevGNN: Negative Sampling Enhanced Contrastive Graph Learning for Academic Reviewer RecommendationACM Transactions on Information Systems10.1145/3679200Online publication date: 22-Jul-2024
    • (2024)ANAGL: A Noise-Resistant and Anti-Sparse Graph Learning for Micro-Video RecommendationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/367040720:9(1-15)Online publication date: 3-Jun-2024
    • (2024)LMACL: Improving Graph Collaborative Filtering with Learnable Model Augmentation Contrastive LearningACM Transactions on Knowledge Discovery from Data10.1145/365730218:7(1-24)Online publication date: 19-Jun-2024
    • (2024)Counterfactual Graph Convolutional Learning for Personalized RecommendationACM Transactions on Intelligent Systems and Technology10.1145/365563215:4(1-20)Online publication date: 18-Jun-2024
    • (2024)Swarm Self-supervised Hypergraph Embedding for RecommendationACM Transactions on Knowledge Discovery from Data10.1145/363805818:4(1-19)Online publication date: 13-Feb-2024
    • (2024)NFARec: A Negative Feedback-Aware Recommender ModelProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657809(935-945)Online publication date: 10-Jul-2024
    • (2024)CaDRec: Contextualized and Debiased Recommender ModelProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657799(405-415)Online publication date: 10-Jul-2024
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media