Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

A Joint Neural Model for User Behavior Prediction on Social Networking Platforms

Published: 25 September 2020 Publication History

Abstract

Social networking services provide platforms for users to perform two kinds of behaviors: consumption behavior (e.g., recommending items of interest) and social link behavior (e.g., recommending potential social links). Accurately modeling and predicting users’ two kinds of behaviors are two core tasks in these platforms with various applications. Recently, with the advance of neural networks, many neural-based models have been designed to predict a single users’ behavior, i.e., social link behavior or consumption behavior. Compared to the classical shallow models, these neural-based models show better performance to drive a user’s behavior by modeling the complex patterns. However, there are few works exploiting whether it is possible to design a neural-based model to jointly predict users’ two kinds of behaviors to further enhance the prediction performance. In fact, social scientists have already shown that users’ two kinds of behaviors are not isolated; people trend to the consumption recommendation of friends on social platforms and would like to make new friends with like-minded users. While some previous works jointly model users’ two kinds of behaviors with shallow models, we argue that the correlation between users’ two kinds of behaviors are complex, which could not be well-designed with shallow linear models. To this end, in this article, we propose a neural joint behavior prediction model named Neural Joint Behavior Prediction Model (NJBP) to mutually enhance the prediction performance of these two tasks on social networking platforms. Specifically, there are two key characteristics of our proposed model: First, to model the correlation of users’ two kinds of behaviors, we design a fusion layer in the neural network to model the positive correlation of users’ two kinds of behaviors. Second, as the observed links in the social network are often very sparse, we design a new link-based loss function that could preserve the social network topology. After that, we design a joint optimization function to allow the two behaviors modeling tasks to be trained to mutually enhance each other. Finally, extensive experimental results on two real-world datasets show that our proposed method is on average 7.14% better than the best baseline on social link behavior while 6.21% on consumption behavior prediction. Compared with the pair-wise loss function on two datasets, our proposed link-based loss function improves at least 4.69% on the social link behavior prediction and 4.72% on the consumption behavior prediction.

References

[1]
Gediminas Adomavicius and Alexander Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge 8 Data Engineering 6 (2005), 734--749.
[2]
Charu Aggarwal and Karthik Subbian. 2014. Evolutionary network analysis: A survey. ACM Computing Surveys (CSUR) 47, 1 (2014), 10.
[3]
Sinan Aral, Lev Muchnik, and Arun Sundararajan. 2009. Distinguishing influence-based contagion from homophily-driven diffusion in dynamic networks. Proceedings of the National Academy of Sciences 106, 51 (2009), 21544--21549.
[4]
Ting Bai, Ji-Rong Wen, Jun Zhang, and Wayne Xin Zhao. 2017. A neural collaborative filtering model with interaction-based neighborhood. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. ACM, 1979--1982.
[5]
Ghazaleh Beigi, Jiliang Tang, Suhang Wang, and Huan Liu. 2016. Exploiting emotional information for trust/distrust prediction. In Proceedings of the 2016 SIAM International Conference on Data Mining. SIAM, 81--89.
[6]
Rianne van den Berg, Thomas N. Kipf, and Max Welling. 2018. Graph convolutional matrix completion. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
[7]
Xuezhi Cao, Haokun Chen, Xuejian Wang, Weinan Zhang, and Yong Yu. 2018. Neural link prediction over aligned networks. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 249--256.
[8]
Shiyu Chang, Wei Han, Jiliang Tang, Guo-Jun Qi, Charu C. Aggarwal, and Thomas S. Huang. 2015. Heterogeneous network embedding via deep architectures. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 119--128.
[9]
Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. 2016. Wide 8 deep learning for recommender systems. In Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. ACM, 7--10.
[10]
Peng Cui, Xiao Wang, Jian Pei, and Wenwu Zhu. 2018. A survey on network embedding. IEEE Transactions on Knowledge and Data Engineering (2018), 833--852.
[11]
Mukund Deshpande and George Karypis. 2004. Item-based top-N recommendation algorithms. ACM Transactions on Information Systems 22, 1 (2004), 143--177.
[12]
Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 855--864.
[13]
Huifeng Guo, Ruiming Tang, Yunming Ye, Zhenguo Li, and Xiuqiang He. 2017. DeepFM: A factorization-machine based neural network for CTR prediction. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 1725--1731.
[14]
Xiangnan He, Tao Chen, Min-Yen Kan, and Xiao Chen. 2015. Trirank: Review-aware explainable recommendation by modeling aspects. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. ACM, 1661--1670.
[15]
Xiangnan He and Tat-Seng Chua. 2017. Neural factorization machines for sparse predictive analytics. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 355--364.
[16]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173--182.
[17]
Dirk Helbing, Dirk Brockmann, Thomas Chadefaux, Karsten Donnay, Ulf Blanke, Olivia Woolley-Meza, Mehdi Moussaid, Anders Johansson, Jens Krause, Sebastian Schutte, et al. 2015. Saving human lives: What complexity science and information systems can contribute. Journal of Statistical Physics 158, 3 (2015), 735--781.
[18]
Kurt Hornik, Maxwell Stinchcombe, and Halbert White. 1989. Multilayer feedforward networks are universal approximators. Neural Networks 2, 5 (1989), 359--366.
[19]
Mark J. Huiskes and Michael S. Lew. 2008. The MIR Flickr retrieval evaluation. In Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval. ACM, 39--43.
[20]
Mohsen Jamali and Martin Ester. 2010. A matrix factorization technique with trust propagation for recommendation in social networks. In Proceedings of the 4th ACM Conference on Recommender Systems. ACM, 135--142.
[21]
Glen Jeh and Jennifer Widom. 2002. SimRank: A measure of structural-context similarity. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 538--543.
[22]
Meng Jiang, Peng Cui, Fei Wang, Wenwu Zhu, and Shiqiang Yang. 2014. Scalable recommendation with social contextual information. IEEE Transactions on Knowledge and Data Engineering 26, 11 (2014), 2789--2802.
[23]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25, F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger (Eds.). Curran Associates, Inc., 1097--1105. http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf.
[24]
Xuan Nhat Lam, Thuc Vu, Trong Duc Le, and Anh Duc Duong. 2008. Addressing cold-start problem in recommendation systems. In Proceedings of the 2nd International Conference on Ubiquitous Information Management and Communication. ACM, 208--211.
[25]
Elizabeth A. Leicht, Petter Holme, and Mark E. J. Newman. 2006. Vertex similarity in networks. Physical Review E 73, 2 (2006), 026120.
[26]
Xiaoyi Li, Nan Du, Hui Li, Kang Li, Jing Gao, and Aidong Zhang. 2014. A deep learning approach to link prediction in dynamic networks. In Proceedings of the 2014 SIAM International Conference on Data Mining. SIAM, 289--297.
[27]
Defu Lian, Yuyang Ye, Wenya Zhu, Qi Liu, Xing Xie, and Hui Xiong. 2016. Mutual reinforcement of academic performance prediction and library book recommendation. In 2016 IEEE 16th International Conference on Data Mining (ICDM). IEEE, 1023--1028.
[28]
Jianxun Lian, Xiaohuan Zhou, Fuzheng Zhang, Zhongxia Chen, Xing Xie, and Guangzhong Sun. 2018. xdeepfm: Combining explicit and implicit feature interactions for recommender systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery 8 Data Mining. ACM, 1754--1763.
[29]
Lizi Liao, Xiangnan He, Hanwang Zhang, and Tat-Seng Chua. 2018. Attributed social network embedding. IEEE Transactions on Knowledge and Data Engineering 30, 12 (2018), 2257--2270.
[30]
David Liben-Nowell and Jon Kleinberg. 2007. The link-prediction problem for social networks. Journal of the American Society for Information Science and Technology 58, 7 (2007), 1019--1031.
[31]
Dekang Lin et al. 1998. An information-theoretic definition of similarity. In Proceedings of the 15th International Conference on Machine Learning, Vol. 98. Citeseer, 296--304.
[32]
Qi Liu, Han Wu, Yuyang Ye, Hongke Zhao, Chuanren Liu, and Dongfang Du. 2018. Patent litigation prediction: A convolutional tensor factorization approach. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. 5052--5059.
[33]
Sanda Martinčić-Ipšić, Edvin Močibob, and Matjaž Perc. 2017. Link prediction on Twitter. PloS One 12, 7 (2017), e0181079.
[34]
Miller McPherson, Lynn Smith-Lovin, and James M. Cook. 2001. Birds of a feather: Homophily in social networks. Annual Review of Sociology 27, 1 (2001), 415--444.
[35]
Aditya Krishna Menon and Charles Elkan. 2011. Link prediction via matrix factorization. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 437--452.
[36]
Tomáš Mikolov, Martin Karafiát, Lukáš Burget, Jan Černockỳ, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In Proceedings of the 11th Annual Conference of the International Speech Communication Association. 1045--1048.
[37]
Andriy Mnih and Ruslan R. Salakhutdinov. 2008. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems. 1257--1264.
[38]
Matjaž Perc, Mahmut Ozer, and Janja Hojnik. 2019. Social and juristic challenges of artificial intelligence. Palgrave Communications 5, 1 (2019), 1--7.
[39]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 701--710.
[40]
Steffen Rendle. 2010. Factorization machines. In 2010 IEEE International Conference on Data Mining. IEEE, 995--1000.
[41]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. AUAI Press, 452--461.
[42]
Matthew Richardson, Rakesh Agrawal, and Pedro Domingos. 2003. Trust management for the semantic web. In International Semantic Web Conference. Springer, 351--368.
[43]
Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web. ACM, 285--295.
[44]
Richard Socher, Danqi Chen, Christopher D. Manning, and Andrew Ng. 2013. Reasoning with neural tensor networks for knowledge base completion. In Advances in Neural Information Processing Systems 26, C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger (Eds.). Curran Associates, Inc., 926--934. http://papers.nips.cc/paper/5028-reasoning-with-neural-tensor-networks-for-knowledge-base-completion.pdf.
[45]
Peijie Sun, Le Wu, and Meng Wang. 2018. Attentive recurrent social recommendation. In Proceedings of the 41st International ACM SIGIR Conference on Research 8 Development in Information Retrieval. ACM, 185--194.
[46]
Jiliang Tang, Huiji Gao, Xia Hu, and Huan Liu. 2013. Exploiting homophily effect for trust prediction. In Proceedings of the 6th ACM International Conference on Web Search and Data Mining. ACM, 53--62.
[47]
Daixin Wang, Peng Cui, and Wenwu Zhu. 2016. Structural deep network embedding. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1225--1234.
[48]
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019. Neural graph collaborative filtering. (2019), 417--426.
[49]
Chao-Yuan Wu, Amr Ahmed, Alex Beutel, Alexander J. Smola, and How Jing. 2017. Recurrent recommender networks. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining. ACM, 495--503.
[50]
Le Wu, Lei Chen, Richang Hong, Yanjie Fu, Xing Xie, and Meng Wang. 2019. A hierarchical attention model for social contextual image recommendation. IEEE Transactions on Knowledge and Data Engineering (2019).
[51]
Le Wu, Yong Ge, Qi Liu, Enhong Chen, Richang Hong, Junping Du, and Meng Wang. 2017. Modeling the evolution of users’ preferences and social links in social networking services. IEEE Transactions on Knowledge and Data Engineering 29, 6 (2017), 1240--1253.
[52]
Le Wu, Yong Ge, Qi Liu, Enhong Chen, Bai Long, and Zhenya Huang. 2016. Modeling users’ preferences and social links in social networking services: A joint-evolving perspective. In Proceedings of the 30th AAAI Conference on Artificial Intelligence. 279--286.
[53]
Le Wu, Qi Liu, Enhong Chen, Nicholas Jing Yuan, Guangming Guo, and Xing Xie. 2016. Relevance meets coverage: A unified framework to generate diversified recommendations. ACM Transactions on Intelligent Systems and Technology (TIST) 7, 3 (2016), 39.
[54]
Le Wu, Peijie Sun, Yanjie Fu, Richang Hong, Xiting Wang, and Meng Wang. 2019. A neural influence diffusion model for social recommendation. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM.
[55]
Le Wu, Peijie Sun, Richang Hong, Yong Ge, and Meng Wang. 2018. Collaborative neural social recommendation. IEEE Transactions on Systems, Man, and Cybernetics: Systems (2018).
[56]
Le Wu, Yonghui Yang, Kun Zhang, Richang Hong, Yanjie Fu, and Meng Wang. 2020. Joint item recommendation and attribute inference: An adaptive graph convolutional network approach. arXiv preprint arXiv:2005.12021 (2020).
[57]
Peizhi Wu, Yi Tu, Xiaojie Yuan, Adam Jatowt, and Zhenglu Yang. 2018. Neural framework for joint evolution modeling of user feedback and social links in dynamic social networks. In Proceedings of the 27th International Joint Conference of Artificial Intelligence. 1632--1638.
[58]
Hong-Jian Xue, Xinyu Dai, Jianbing Zhang, Shujian Huang, and Jiajun Chen. 2017. Deep matrix factorization models for recommender systems. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 3203--3209.
[59]
Shuang-Hong Yang, Bo Long, Alex Smola, Narayanan Sadagopan, Zhaohui Zheng, and Hongyuan Zha. 2011. Like like alike: Joint friendship and interest propagation in social networks. In Proceedings of the 20th International Conference on World Wide Web. ACM, 537--546.
[60]
Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, and Jure Leskovec. 2018. Graph convolutional neural networks for web-scale recommender systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery 8 Data Mining. ACM, 974--983.
[61]
Shuangfei Zhai and Zhongfei Zhang. 2015. Dropout training of matrix factorization and autoencoder for link prediction in sparse graphs. In Proceedings of the 2015 SIAM International Conference on Data Mining. SIAM, 451--459.
[62]
Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep learning based recommender system: A survey and new perspectives. ACM Computing Surveys (CSUR) 52, 1 (2019), 5.

Cited By

View all
  • (2024)A Model for Predicting IoT User Behavior Based on Bayesian Learning and Neural NetworksJournal of Computer Networks and Communications10.1155/2024/60075872024Online publication date: 1-Jan-2024
  • (2024)Multi-Feature Rumor Suppression Mechanism Based on Community Division in Social NetworksIEEE Transactions on Network Science and Engineering10.1109/TNSE.2023.333664911:2(2047-2061)Online publication date: Mar-2024
  • (2024)Dual Graph Neural Networks for Dynamic Users’ Behavior Prediction on Social Networking ServicesIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.340938311:5(7020-7031)Online publication date: Oct-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 11, Issue 6
Survey Paper and Regular Paper
December 2020
237 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3424135
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 September 2020
Accepted: 01 June 2020
Revised: 01 December 2019
Received: 01 June 2019
Published in TIST Volume 11, Issue 6

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Joint neural networks
  2. behavior prediction
  3. consumption behavior
  4. social link behavior
  5. topology information

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • the Fundamental Research Funds for the Central Universities
  • the National Natural Science Foundation of China

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)36
  • Downloads (Last 6 weeks)2
Reflects downloads up to 13 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)A Model for Predicting IoT User Behavior Based on Bayesian Learning and Neural NetworksJournal of Computer Networks and Communications10.1155/2024/60075872024Online publication date: 1-Jan-2024
  • (2024)Multi-Feature Rumor Suppression Mechanism Based on Community Division in Social NetworksIEEE Transactions on Network Science and Engineering10.1109/TNSE.2023.333664911:2(2047-2061)Online publication date: Mar-2024
  • (2024)Dual Graph Neural Networks for Dynamic Users’ Behavior Prediction on Social Networking ServicesIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.340938311:5(7020-7031)Online publication date: Oct-2024
  • (2024)SBP-GCA: Social Behavior Prediction via Graph Contrastive Learning With AttentionIEEE Transactions on Artificial Intelligence10.1109/TAI.2024.33955745:9(4708-4722)Online publication date: Sep-2024
  • (2024)Joint friend and item recommendation based on multidimensional feature reciprocal interaction in social e-commerceElectronic Commerce Research and Applications10.1016/j.elerap.2024.10140665(101406)Online publication date: May-2024
  • (2023)Social-Enhanced Explainable Recommendation With Knowledge GraphIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.3292504(1-14)Online publication date: 2023
  • (2023)Cohesive Subgraph Discovery Over Uncertain Bipartite GraphsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.323456735:11(11165-11179)Online publication date: 1-Nov-2023
  • (2023)Rumors Suppression in Healthcare System: Opinion-Based Comprehensive Learning Particle Swarm OptimizationIEEE Transactions on Computational Social Systems10.1109/TCSS.2023.326354610:4(1780-1790)Online publication date: Aug-2023
  • (2023)Predictive and Contrastive: Dual-Auxiliary Learning for RecommendationIEEE Transactions on Computational Social Systems10.1109/TCSS.2022.318571410:5(2254-2265)Online publication date: Oct-2023
  • (2022)Efficient Computation of Cohesive Subgraphs in Uncertain Bipartite Graphs2022 IEEE 38th International Conference on Data Engineering (ICDE)10.1109/ICDE53745.2022.00220(2333-2345)Online publication date: May-2022
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media