Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Attenuated sentiment-aware sequential recommendation

  • Regular Paper
  • Published:
International Journal of Data Science and Analytics Aims and scope Submit manuscript

Abstract

Sequential recommendation(SR) focuses on modeling the historical relationship of a user’s behavior. The attention-based models such as Transformer and BERT have been introduced in SR and acquired excellent performance. However, these models mostly only utilize the user-item interaction sequential data but ignore the additional information. We argue that the complicated human subjective sentiment plays an essential influence on their consuming behavior. In this paper, we introduced attenuated sentiment information into sequential recommender to capture user potential preference. Specially, we propose an attenuated sentiment memory network (ASM-Net) to simulate the real decay of human sentiment according to the time interval relationship. We construct a two channels recommender architecture called attenuated sentiment sequential recommendation (ASSR) to generate user sentiment preference and item preference. Specifically, the first channel models the general item attention-aware sequential relationship and the secondary channel utilizes multi-attenuated sentiment-aware attention to capture sequential preference. We collect two industrial Chinese datasets and two open English datasets to verify the model’s performance. We design ablation study and sentiment sensitivity to investigate the influence of attenuated sentiment on user preference. Comprehensive experimental results demonstrate that our sentiment decay modeling approach is effective to capture users’ subjective preferences, and our method outperforms several state-of-the-art recommenders.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. The dataset is available at https://github.com/donglinzhou/Attenuated-sentiment-aware-sequential-recommendation.

  2. https://github.com/hidasib/GRU4Rec.

  3. https://github.com/pmixer/SASRec.pytorch.

  4. https://github.com/FeiSun/BERT4Rec.

  5. https://github.com/CRIPAC-DIG/SR-GNN.

  6. https://github.com/johnny12150/GC-SAN.

References

  1. deWet, S., Ou, J.: Finding users who act alike: Transfer learning for expanding advertiser audiences, 2019. Paper presented at the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage AK, USA, 4–8 August (2019)

  2. Le, D.-T., Lauw, H., Fang, Y.: Correlation-sensitive next-basket recommendation, 2019. Paper Presented at the 28th International Joint Conference on Artificial Intelligence, Macao, China, 10–16 Auguest (2019)

  3. Mittapally Swamy and Polepalli Krishna Reddy: A model of concept hierarchy-based diverse patterns with applications to recommender system. Int. J. Data Sci. Anal. 10, 177–191 (2020)

    Article  Google Scholar 

  4. Ritika and Sunil Gupta: Hufti-spm: high-utility and frequent time-interval sequential pattern mining from transactional databases. Int. J. Data Sci. Anal. 13, 1–12 (2022)

    Google Scholar 

  5. Zheng, L., Zhu, F., Alshahrani, M.: Attribute and global boosting: a rating prediction method in context-aware recommendation. Comput. J. 60, 957–968 (2017)

    MathSciNet  Google Scholar 

  6. Zheng, L., Zhu, F., Huang, S., Xie, J.: Context neighbor recommender: integrating contexts via neighbors for recommendations. Inf. Sci. 414, 1–18 (2017)

    Article  Google Scholar 

  7. Wang, S., Hu, L., Wang, Y., Cao, L., Sheng, Q., Orgun, M.: Sequential recommender systems: challenges, progress and prospects, 2019. Paper Presented at the 28th International Joint Conference on Artificial Intelligence, Macao, China, 10–16 Auguest (2019)

  8. Wang, S., Zhang, Q., Hu, L., Zhang, X., Wang, Y., Aggarwal, C.: Sequential/session-based recommendations: Challenges, approaches, applications and opportunities, 2022. Paper presented at the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, 11–15 July (2022)

  9. Hidasi, B., Karatzoglou, A., Baltrunas, L., Tikk, D.: Session-based recommendations with recurrent neural networks. 2016. Paper presented at the 4th International Conference on Learning Representations, San Juan, Puerto Rico, 2–4 May (2016)

  10. Sun, F., Liu, J., Wu, J., Pei, C., Lin, X., Ou, W., Jiang, P.: Bert4rec: Sequential recommendation with bidirectional encoder representations from transformer, 2019. Paper Presented at the 28th ACM International Conference on Information and Knowledge Management, Beijing, China, 3–7 November (2019)

  11. Kang, W.-C., McAuley, J.: Self-attentive sequential recommendation, 2018. Paper presented at the 18th IEEE International Conference on Data Mining, Singapore, Singpore, 17–20 November (2018)

  12. Li, J., Wang, Y., McAuley, J.: Time interval aware self-attention for sequential recommendation, 2020. Paper Presented at the 13th ACM International Conference on Web Search and Data Mining, Houston TX, USA, 3–7 February (2020)

  13. Wang, S., Hu, L., Wang, Y., Sheng, Q., Orgun, M., Cao, L.: Modeling multi-purpose sessions for next-item recommendations via mixture-channel purpose routing networks, 2019. Paper presented at the 28th International Joint Conference on Artificial Intelligence, Macao, China, 10–16 August (2019)

  14. Wang, S., Cao, L., Liang, H., Berkovsky, S., Huang, X., Xiao, L., Wenpeng, L.: Hierarchical attentive transaction embedding with intra- and inter-transaction dependencies for next-item recommendation. IEEE Intell. Syst. 36, 56–64 (2021)

    Article  Google Scholar 

  15. Qiu, R., Huang, Z., Chen, T., Yin, H.: Exploiting positional information for session-based recommendation. ACM Trans. Inf. Syst. 40, 24 (2021)

    Google Scholar 

  16. Qiu, R., Zi, H., Jingjing, L., Hongzhi, Y.: Exploiting cross-session information for session-based recommendation with graph neural networks. ACM Trans. Inf. Sys. 38, 23 (2021)

    Google Scholar 

  17. Wang, S., Liang, H., Wang, Y., Sheng, Q., Orgun, M., Cao, L.: Intention nets: psychology-inspired user choice behavior modeling for next-basket prediction. Proc. AAAI Conf. Artif. Intell. 34, 6259–6266 (2020)

    Google Scholar 

  18. Wang, L., Liu, J., Ma, A.: Personalization sorting algorithm based on interest attenuation. Comput. Eng. 43(9), 214–219 (2017)

    Google Scholar 

  19. Zhang, T., Zhao, P., Liu, Y., Sheng, V., Xu, J., Wang, D., Liu, G., Zhou, X.: Feature-level deeper self-attention network for sequential recommendation, 2019. Paper presented at the 28th International Joint Conference on Artificial Intelligence, Macao, China, 10–16 August (2019)

  20. Zheng, L., Guo, N., Chen, W., Yu, J., Jiang, D.: Sentiment-guided sequential recommendation, 2020. Paper presented at the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, China, 25–30 July (2020)

  21. Rendle, S., Freudenthaler, C., Schmidt-Thieme, L: Factorizing personalized markov chains for next-basket recommendation, 2010. Paper presented at the 19th International Conference on World Wide Web, New York, USA, 26–30 April (2010)

  22. He, R., Kang, W.-C., McAuley, J.: Translation-based recommendation, 2017. Paper presented at the 11th ACM Conference on Recommender Systems, Como, Italy, 27–31 August (2017)

  23. He, R., Fang, C., Wang, Z., McAuley, J.: Vista: a visually, socially, and temporally-aware model for artistic recommendation, 2016. Paper presented at the 10th ACM Conference on Recommender Systems, Boston, USA, 15–19 September (2016)

  24. He, R., McAuley, J.: Fusing similarity models with markov chains for sparse sequential recommendation, 2016. Paper presented at the 2016 IEEE 16th International Conference on Data Mining, Barcelona, Spain, 12–15 December (2016)

  25. Tang, J., Wang, K: Personalized top-n sequential recommendation via convolutional sequence embedding, 2018. Paper Presented at the 11th ACM International Conference on Web Search and Data Mining, Los Angeles, USA, 5–9 February (2018)

  26. Tuan, T., Phuong, T.: 3d convolutional networks for session-based recommendation with content features, 2017. Paper Presented at the 11th ACM Conference on Recommender Systems, Como, Italy, 27–31 August (2017)

  27. Hidasi, B., Karatzoglou, A.: Recurrent neural networks with top-k gains for session-based recommendations, 2018. Paper Presented at the 27th ACM International Conference on Information and Knowledge Management, Torino, Italy, 22–26 October (2018)

  28. Wu, S., Tang, Y., Zhu, Y., Wang, L., Tan, T., Xie, X.: Session-based recommendation with graph neural networks, 2019. Paper Presented at the 31st AAAI Conference on Artificial Intelligence, Honolulu Hawaii, USA, 27 January–1 February (2019)

  29. Chang, J., Gao, C., Zheng, Y., Hui, Y., Niu, Y., Song, Y., Jin, D., Li, Y.: Sequential recommendation with graph neural networks, 2021. Paper presented at the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, 11–15 July (2021)

  30. Xu, C., Zhao, P., Liu, Y., Sheng, V., Xu, J., Zhuang, F., Fang, J., Zhou, X.: Graph contextualized self-attention network for session-based recommendation, 2019. Paper Presented at the 28th International Joint Conference on Artificial Intelligence, Macao, China, 10–16 Auguest (2019)

  31. Yu, F., Zhu, Y., Liu, Q., Wu, S., Wang, L., Tan, T.: Tagnn: Target attentive graph neural networks for session-based recommendation, 2020. Paper presented at the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, New York, USA, 25–30 July (2020)

  32. Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate, 2014. Paper presented at the 2nd International Conference on Learning Representations, Banff, Canada, 14–16 April (2014)

  33. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need, 2017. Paper presented at the 31st Conference on Neural Information Processing Systems, Long Beach, USA, 4–9 December (2017)

  34. Cao, W., Zhang, K., Han, W., Tong, X., Chen, E., Lv, G., He, M.: Video emotion analysis enhanced by recognizing emotion in video comments. Int. J. Data Sci. Anal. 14, 1–15 (2022)

  35. Baytas, I.M., Xiao, C., Zhang, X., Wang, F., Jain, A.K., Zhou, J.: Patient subtyping via time-aware lstm networks, 2017. Paper Presented at the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, Canada, 13–17 August (2017)

  36. Pham, T., Tran, T., Phung, D., Venkatesh, S.: Deepcare: A deep dynamic memory model for predictive medicine. Adv. Knowl. Discov. Data Min. 9625, 30–41 (2016)

    Google Scholar 

  37. Murugaiyan, S., Srinivasulu Reddy, U.: Aspect-based sentiment analysis of mobile phone reviews using lstm and fuzzy logic. Int. J. Data Sci. Anal., 12:355–367 (2021)

  38. Dai, A., Xiaohui, H., Nie, J., Chen, J.: Learning from word semantics to sentence syntax by graph convolutional networks for aspect-based sentiment analysis. Int. J. Data Sci. Anal. 14, 17–26 (2022)

    Article  Google Scholar 

  39. Wang, S., Wang, Y., Sheng, Q., Orgun, M., Cao, L., Lian, D.: A survey on session-based recommender systems. ACM Comput. Surv. 54, 39 (2021)

    Google Scholar 

  40. Wang, D., Dengwei, X., Dongjin, Yu., Guandong, X.: Time-aware sequence model for next-item recommendation. Appl. Intell. 51, 906–920 (2021)

    Article  Google Scholar 

Download references

Acknowledgements

The work was supported by the Special Funds for the Cultivation of Guangdong College Students’ Scientific and Technological Innovation (“Climbing Program” Special Funds PDJH2022B0192), National Natural Science Foundation of China (61902231), Guangdong Basic and Applied Basic Research Foundation (2020A1515010531) and Higher Education Special Project of Guangdong Education Science Planning (2021GXJK241).

Author information

Authors and Affiliations

  1. Department of Computer Science, College of Engineering, Shantou University, Shantou, 515063, Guangdong, China

    Donglin Zhou, Zhihong Zhang, Yangxin Zheng, Zhenting Zou & Lin Zheng

Authors
  1. Donglin Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhihong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yangxin Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhenting Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lin Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

DZ did preliminary experiments and wrote the main manuscript. ZZ, YZ, and ZZ further supplemented the experiments and revised the manuscript. LZ designed the experiments, made overall revisions to the manuscript, and provided funding support. All authors reviewed the manuscript.

Corresponding author

Correspondence to Lin Zheng.

Ethics declarations

Conflicts of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, D., Zhang, Z., Zheng, Y. et al. Attenuated sentiment-aware sequential recommendation. Int J Data Sci Anal 16, 271–283 (2023). https://doi.org/10.1007/s41060-022-00374-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41060-022-00374-5

Keywords

Search

Navigation