Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Self-training on graph neural networks for recommendation with implicit feedback

Published: 27 September 2023 Publication History

Abstract

Graph Convolutional Networks (GCNs) gain success for recommendation, but still face great challenges of data sparseness and negative sampling in implicit feedback-based recommendation. In particular, they ignore the unique graph structure for information propagation and thus fail to fully explore the potentials of GCN.
To tackle the problem, we propose a GCN-based self-training approach, called STL, which exploits the learning results in the training procedure, and the potential relations in the embedding space of GCN. First, to handle the data sparsity, we modify the interaction graph structure by adding edges linking a selected part of users and their potential positive items. Second, we adaptively expand the set of positive samples that are used in the pairwise loss function, which not only supplements the dataset but also avoids sampling noises. Further, similarity of structural neighbors on graph is used to mine hard negative sample for improving the sample quality. Experiments on three representative GCN-based recommenders and four widely used public datasets show that STL alleviates the problem of data sparsity, thereby improving recommendation performance compared to normal training.

References

[1]
Bell Robert M, Koren Yehuda, Lessons from the netflix prize challenge, Acm Sigkdd Explorations Newsletter 9 (2) (2007) 75–79.
[2]
Fan Liu, Zhiyong Cheng, Changchang Sun, Yinglong Wang, Liqiang Nie, Mohan Kankanhalli, User diverse preference modeling by multimodal attentive metric learning, in: Proceedings of the 27th ACM international conference on multimedia, 2019, pp. 1526–1534.
[3]
Yao Wu, Christopher DuBois, Alice X Zheng, Martin Ester, Collaborative denoising auto-encoders for top-n recommender systems, in: Proceedings of the ninth ACM international conference on web search and data mining, 2016, pp. 153–162.
[4]
Xue Hong-Jian, Dai Xinyu, Zhang Jianbing, Huang Shujian, Chen Jiajun, Deep matrix factorization models for recommender systems., IJCAI, Melbourne, Australia, 2017, pp. 3203–3209.
[5]
Koren Yehuda, Bell Robert, Volinsky Chris, Matrix factorization techniques for recommender systems, Computer 42 (8) (2009) 30–37.
[6]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, Tat-Seng Chua, Neural collaborative filtering, in: Proceedings of the 26th international conference on world wide web, 2017, pp. 173–182.
[7]
Guorui Zhou, Xiaoqiang Zhu, Chenru Song, Ying Fan, Han Zhu, Xiao Ma, Yanghui Yan, Junqi Jin, Han Li, Kun Gai, Deep interest network for click-through rate prediction, in: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, 2018, pp. 1059–1068.
[8]
Immanuel Bayer, Xiangnan He, Bhargav Kanagal, Steffen Rendle, A generic coordinate descent framework for learning from implicit feedback, in: Proceedings of the 26th International Conference on World Wide Web, 2017, pp. 1341–1350.
[9]
Ruining He, Julian McAuley, Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering, in: proceedings of the 25th international conference on world wide web, 2016, pp. 507–517.
[10]
Yang Han, Yan Xiao, Dai Xinyan, Chen Yongqiang, Cheng James, Self-enhanced gnn: Improving graph neural networks using model outputs, in: International Joint Conference on Neural Networks, IJCNN, IEEE, 2021, pp. 1–8.
[11]
Jiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He, Liang Chen, Jianxun Lian, Xing Xie, Self-supervised graph learning for recommendation, in: Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, 2021, pp. 726–735.
[12]
Zihan Lin, Changxin Tian, Yupeng Hou, Wayne Xin Zhao, Improving graph collaborative filtering with neighborhood-enriched contrastive learning, in: Proceedings of the ACM Web Conference 2022, 2022, pp. 2320–2329.
[13]
Le Wu, Yonghui Yang, Kun Zhang, Richang Hong, Yanjie Fu, Meng Wang, Joint item recommendation and attribute inference: An adaptive graph convolutional network approach, in: Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020, pp. 679–688.
[14]
Steffen Rendle, Christoph Freudenthaler, Improving pairwise learning for item recommendation from implicit feedback, in: Proceedings of the 7th ACM international conference on Web search and data mining, 2014, pp. 273–282.
[15]
Weinan Zhang, Tianqi Chen, Jun Wang, Yong Yu, Optimizing top-n collaborative filtering via dynamic negative item sampling, in: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval, 2013, pp. 785–788.
[16]
Ding Jingtao, Quan Yuhan, Yao Quanming, Li Yong, Jin Depeng, Simplify and robustify negative sampling for implicit collaborative filtering, Advances in Neural Information Processing Systems 33 (2020) 1094–1105.
[17]
Qiannan Zhu, Haobo Zhang, Qing He, Zhicheng Dou, A Gain-Tuning Dynamic Negative Sampler for Recommendation, in: Proceedings of the ACM Web Conference, 2022, pp. 277–285.
[18]
Guo Huifeng, Tang Ruiming, Ye Yunming, Li Zhenguo, He Xiuqiang, Deepfm: a factorization-machine based neural network for ctr prediction, arXiv preprint arXiv:1703.04247 (2017).
[19]
Xiangnan He, Tat-Seng Chua, Neural factorization machines for sparse predictive analytics, in: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017, pp. 355–364.
[20]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, Tat-Seng Chua, Neural collaborative filtering, in: Proceedings of the 26th International Conference on World Wide Web, 2017, pp. 173–182.
[21]
He Xiangnan, Deng Kuan, Wang Xiang, Li Yan, Zhang Yongdong, Wang Meng, Lightgcn: Simplifying and powering graph convolution network for recommendation, in: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2020, pp. 639–648.
[22]
Fan Liu, Zhiyong Cheng, Lei Zhu, Zan Gao, Liqiang Nie, Interest-aware message-passing gcn for recommendation, in: Proceedings of the Web Conference, 2021, pp. 1296–1305.
[23]
Yang Zuoxi, Dong Shoubin, HAGERec: Hierarchical attention graph convolutional network incorporating knowledge graph for explainable recommendation, Knowl.-Based Syst. 204 (2020).
[24]
Yin Ruiping, Li Kan, Zhang Guangquan, Lu Jie, A deeper graph neural network for recommender systems, Knowl.-Based Syst. 185 (2019).
[25]
Huiyuan Chen, Lan Wang, Yusan Lin, Chin-Chia Michael Yeh, Fei Wang, Hao Yang, Structured graph convolutional networks with stochastic masks for recommender systems, in: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021, pp. 614–623.
[26]
Scudder Henry, Probability of error of some adaptive pattern-recognition machines, IEEE Transactions on Information Theory 11 (3) (1965) 363–371.
[27]
He Junxian, Gu Jiatao, Shen Jiajun, Ranzato Marc’Aurelio, Revisiting self-training for neural sequence generation, in: International Conference on Learning Representations, 2020.
[28]
Dong-Hyun Lee, et al., Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks, in: Workshop on challenges in representation learning, ICML, 3, (2) 2013, p. 896.
[29]
Mukherjee Subhabrata, Awadallah Ahmed, Uncertainty-aware self-training for few-shot text classification, Adv. Neural Inf. Process. Syst. 32 (2020) 21199–21212.
[30]
Hongrui Liu, Binbin Hu, Xiao Wang, Chuan Shi, Zhiqiang Zhang, Jun Zhou, Confidence may cheat: Self-training on graph neural networks under distribution shift, in: Proceedings of the ACM Web Conference, 2022, pp. 1248–1258.
[31]
Pise Nitin Namdeo, Kulkarni Parag, A survey of semi-supervised learning methods, in: 2008 International Conference on Computational Intelligence and Security, vol. 2, IEEE, 2008, pp. 30–34.
[32]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, Lars Schmidt-Thieme, BPR: Bayesian personalized ranking from implicit feedback, in: The Conference on Uncertainty in Artificial Intelligence, 2009, pp. 452–461.
[33]
Dongsheng Luo, Wei Cheng, Wenchao Yu, Bo Zong, Jingchao Ni, Haifeng Chen, Xiang Zhang, Learning to drop: Robust graph neural network via topological denoising, in: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, 2021, pp. 779–787.
[34]
Wu Felix, Souza Amauri, Zhang Tianyi, Fifty Christopher, Yu Tao, Weinberger Kilian, Simplifying graph convolutional networks, International conference on machine learning, PMLR, 2019, pp. 6861–6871.
[35]
Harper F Maxwell, Konstan Joseph A, The movielens datasets: history and context, Acm transactions on interactive intelligent systems (tiis) 5 (4) (2015) 1–19.
[36]
Chen Ting, Sun Yizhou, Shi Yue, Hong Liangjie, On sampling strategies for neural network-based collaborative filtering, in: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2017, pp. 767–776.
[37]
Forouzandeh Saman, Aghdam Atae Rezaei, Forouzandeh Soran, Xu Shuxiang, Addressing the cold-start problem using data mining techniques and improving recommender systems by cuckoo algorithm: a case study of facebook, Computing in Science & Engineering 22 (4) (2018) 62–73.
[38]
Dong Wei, Woźniak Marcin, Wu Junsheng, Li Weigang, Bai Zongwen, Denoising aggregation of graph neural networks by using principal component analysis, IEEE Transactions on Industrial Informatics 19 (3) (2022) 2385–2394.
[39]
Dong Wei, Wu Junsheng, Zhang Xinwan, Bai Zongwen, Wang Peng, Woźniak Marcin, Improving performance and efficiency of graph neural networks by injective aggregation, Knowl.-Based Syst. 254 (2022).
[40]
Chen Penghe, Lu Yu, Zheng Vincent W, Chen Xiyang, Yang Boda, Knowedu: A system to construct knowledge graph for education, IEEE Access 6 (2018) 31553–31563.
[41]
Tran Quan M, Nguyen Hien D, Huynh Tai, Nguyen Kha V, Hoang Suong N, Pham Vuong T, Measuring the influence and amplification of users on social network with unsupervised behaviors learning and efficient interaction-based knowledge graph, J. Combinat. Optim. 44 (4) (2022) 2919–2945.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Knowledge-Based Systems
Knowledge-Based Systems  Volume 276, Issue C
Sep 2023
664 pages

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 27 September 2023

Author Tags

  1. Recommender system
  2. Collaborative filtering
  3. Self-training
  4. Graph neural network

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Nov 2024

Other Metrics

Citations

View Options

View options

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media