Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1007/978-981-97-2421-5_25guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Wasserstein Adversarial Variational Autoencoder for Sequential Recommendation

Published: 12 May 2024 Publication History

Abstract

Variational autoencoders (VAEs) have shown unique advantages as a generative model for sequence recommendation. The core of VAEs is the reconstruction of error targets through similarity metrics to provide a supervised signal for training. However, VAE reconstruction tends to generate non-realistic outputs, which severely affects the accuracy of sequential recommendation. To solve the above problem, in this paper, we propose a new framework called Wasserstein Adversarial Variational Autoencoder (WAVAE) for Sequential Recommendation. In WAVAE, the VAE first combines with the Generative Adversarial Network (GAN) network to differentiate the true and false samples by introducing an adversarially trained discriminative network, and then the learning feature representation in the discriminative network is used as the basis for the VAE reconstruction target so that the VAE tends to generate true samples. We further used Wasserstein loss to optimise the training process, with the aim of avoiding the gradient disappearance problem that occurs when the above-mentioned adversarial network is trained on discrete data, ensuring that the VAE can obtain accurate reconstruction targets through adversarial learning. In addition, we concatenate the original samples with their labels as input to control the generated content and thus control the generated sample tendency. Finally, we conduct experiments on several real datasets to evaluate the model, and the experiment results show that our model outperforms the state-of-the-art baselines significantly.

References

[1]
Adler, J., Lunz, S.: Banach wasserstein gan. Adv. Neural Inf. Process. Syst. (2018)
[2]
Chae, D.K., Kang, J.S., Kim, S.W.: CFGAN: a generic collaborative filtering framework based on generative adversarial networks. In: CIKM, pp. 137–146 (2018)
[3]
Chen, X., et al.: Sequential recommendation with user memory networks. In: WSDM, pp. 108–116 (2018)
[4]
Chen, Z., Liu, P.: Towards better data augmentation using wasserstein distance in variational auto-encoder. arXiv preprint arXiv:2109.14795 (2021)
[5]
Ezukwoke, K., Hoayek, A., Batton-Hubert, M., Boucher, X.: GCVAE: generalized-controllable variational autoencoder (2022)
[6]
Hidasi, B., Karatzoglou, A., Baltrunas, L., Tikk, D.: Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015)
[7]
Higgins, I., et al.: Beta-vae: learning basic visual concepts with a constrained variational framework (2016)
[8]
Kang, W.C., McAuley, J.: Self-attentive sequential recommendation. In: ICDM, pp. 197–206. IEEE (2018)
[9]
Liang, D., Krishnan, R.G., Hoffman, M.D., Jebara, T.: Variational autoencoders for collaborative filtering. In: Proceedings of the 2018 World Wide Web Conference, pp. 689–698 (2018)
[10]
Mescheder, L., Nowozin, S., Geiger, A.: Adversarial variational bayes: unifying variational autoencoders and generative adversarial networks. In: ICML, pp. 2391–2400. PMLR (2017)
[11]
Miladinović, D., Shridhar, K., Jain, K., Paulus, M.B., Buhmann, J.M., Allen, C.: Learning to drop out: an adversarial approach to training sequence VAEs (2022)
[12]
Sachdeva, N., Manco, G., Ritacco, E., Pudi, V.: Sequential variational autoencoders for collaborative filtering. In: WSDM, pp. 600–608 (2019)
[13]
Sohn, K., Lee, H.: Learning structured output representation using deep conditional generative models. Adv. Neural Inf. Process. Syst. (2015)
[14]
Sun, F., et al.: Bert4rec: sequential recommendation with bidirectional encoder representations from transformer. In: CIKM, pp. 1441–1450 (2019)
[15]
Tang, J., Wang, K.: Personalized top-n sequential recommendation via convolutional sequence embedding. In: WSDM, pp. 565–573 (2018)
[16]
Van Den Oord, A., Kalchbrenner, N.: Pixel recurrent neural networks. In: International Conference on Machine Learning, pp. 1747–1756. PMLR (2016)
[17]
Wang, J., et al.: A minimax game for unifying generative and discriminative information retrieval models. In: SIGIR Proceedings (2018)
[18]
Wang, S., Hu, L., Wang, Y., Cao, L., Sheng, Q.Z., Orgun, M.A.: Sequential Recommender Systems - Challenges, Progress and Prospects, pp. 6332–6338 (2019)
[19]
Wang, X., et al.: Normative modeling via conditional variational autoencoder and adversarial learning to identify brain dysfunction in Alzheimer’s disease (2022)
[20]
Xie, Z., Liu, C., Zhang, Y., Lu, H., Wang, D., Ding, Y.: Adversarial and contrastive variational autoencoder for sequential recommendation. In: Proceedings of the Web Conference 2021, pp. 449–459 (2021)
[21]
Yu, X., Zhang, X., Cao, Y., Xia, M.: Vaegan: a collaborative filtering framework based on adversarial variational autoencoders. In: Twenty-Eighth International Joint Conference on Artificial Intelligence IJCAI-19 (2019)
[22]
Zhao, S., Song, J., Ermon, S.: Infovae: Balancing learning and inference in variational autoencoders, pp. 5885–5892 (2019)

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings
Web and Big Data: 7th International Joint Conference, APWeb-WAIM 2023, Wuhan, China, October 6–8, 2023, Proceedings, Part IV
Oct 2023
538 pages
ISBN:978-981-97-2420-8
DOI:10.1007/978-981-97-2421-5
  • Editors:
  • Xiangyu Song,
  • Ruyi Feng,
  • Yunliang Chen,
  • Jianxin Li,
  • Geyong Min

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 12 May 2024

Author Tags

  1. Sequential Recommendation
  2. Variational Autoencoder
  3. Adversarial Learning
  4. Wasserstein Loss

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Dec 2024

Other Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media