research-article

Open access

BayDNN: Friend Recommendation with Bayesian Personalized Ranking Deep Neural Network

Authors:

Zhi-Hua ZhouAuthors Info & Claims

CIKM '17: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management

Pages 1479 - 1488

https://doi.org/10.1145/3132847.3132941

Published: 06 November 2017 Publication History

Abstract

Friendship is the cornerstone to build a social network. In online social networks, statistics show that the leading reason for user to create a new friendship is due to recommendation. Thus the accuracy of recommendation matters. In this paper, we propose a Bayesian Personalized Ranking Deep Neural Network (BayDNN) model for friend recommendation in social networks. With BayDNN, we achieve significant improvement on two public datasets: Epinions and Slashdot. For example, on Epinions dataset, BayDNN significantly outperforms the state-of-the-art algorithms, with a 5% improvement on NDCG over the best baseline.

The advantages of the proposed BayDNN mainly come from its underlying convolutional neural network (CNN), which offers a mechanism to extract latent deep structural feature representations of the complicated network data, and a novel Bayesian personalized ranking idea, which precisely captures the users' personal bias based on the extracted deep features. To get good parameter estimation for the neural network, we present a fine-tuned pre-training strategy for the proposed BayDNN model based on Poisson and Bernoulli probabilistic models.

References

[1]

Lada A Adamic and Eytan Adar. 2003. Friends and neighbors on the Web. Social Networks 25, 3 (2003), 211--230.

[2]

Yoshua Bengio, Nicolas Le Roux, Olivier Delalleau, Patrice Marcotte, and Pascal Vincent. 2005. Convex Neural Networks. Advances in Neural Information Processing Systems (2005), 123--130.

Digital Library

[3]

Ali Taylan Cemgil. 2009. Bayesian Inference for Nonnegative Matrix Factorisation Models. Intell. Neuroscience 2009, Article 4 (Jan. 2009), 17 pages.

Digital Library

[4]

Kyunghyun Cho, Bart Van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. Computer Science (2014).

[5]

Ronan Collobert, Jason Weston, L Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research 12, 1 (2011), 2493--2537.

Digital Library

[6]

Malcolm Gladwell. 2000. The Tipping Point - How Little things Make a Big Difference. Little, Brown and Company (2000), 177--181,185--186.

[7]

Stefan Gluge, Ronald Böck, and Andreas Wendemuth. 2013. Auto-encoder pre-training of segmented-memory recurrent neural networks. In ESANN.

[8]

Neil Zhenqiang Gong, Ameet Talwalkar, Lester Mackey, Ling Huang, Eui Chul Richard Shin, Emil Stefanov, Elaine, Shi, and Dawn Song. 2012. Jointly Predicting Links and Inferring Attributes using a Social-Attribute Network (SAN). Computer Science (2012).

[9]

Mark Granovetter. 1973. The strength of weak ties. Amer. J. Sociology 78, 6 (1973), 1360--1380.

[10]

Siyao Han and Yan Xu. 2014. Friend recommendation of microblog in classification framework: Using multiple social behavior features. In International Conference on Behavior, Economic and Social Computing. 1--6.

[11]

John Hannon, Mike Bennett, and Barry Smyth. 2010. Recommending Twitter Users to Follow Using Content and Collaborative Filtering Approaches. In Proceedings of the Fourth ACM Conference on Recommender Systems. 199--206.

Digital Library

[12]

Chaobo He, Hanchao Li, Xiang Fei, and Yong Tang. 2015. A Topic CommunityBased Method for Friend Recommendation in Online Social Networks via Joint Nonnegative Matrix Factorization. In third International Conference on Advanced Cloud and Big Data. 28--35.

[13]

L. A. Jeni, J. F. Cohn, and La Torre F De. 2012. Facing Imbalanced Data Recommendations for the Use of Performance Metrics. In Humaine Association Conference on Affective Computing and Intelligent Interaction. 245--251.

Digital Library

[14]

Leo Katz. 1953. A new status index derived from sociometric analysis. Psychometrika 18, 1 (1953), 39--43.

[15]

C. David Page Kendrick Boyd, Kevin H. Eng. 2013. Area under the Precision-Recall Curve: Point Estimates and Confidence Intervals. 451--466.

Digital Library

[16]

Yehuda Koren. 2008. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 426--434.

Digital Library

[17]

Alex Krizhevsky and etc. 2012. ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems 25, 2 (2012), 2012.

Digital Library

[18]

Artus Krohn-Grimberghe, Lucas Drumond, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2012. Multi-relational matrix factorization using bayesian personalized ranking for social network data. In International Conference on Web Search and Web Data Mining. 173--182.

Digital Library

[19]

Daniel D. Lee and H. Sebastian Seung. 2001. Algorithms for Non-negative Matrix Factorization. In Advances in Neural Information Processing Systems. 556--562.

[20]

Jure Leskovec, Kevin J. Lang, Anirban Dasgupta, and Michael W. Mahoney. 2008. Statistical properties of community structure in large social and information networks. In WWW'08. 695--704.

Digital Library

[21]

Wei Li and Sara Mcmains. 1963. Behavioral Study of obedience. Journal of Abnormal Psychology 67, 4 (1963), 371--378.

[22]

Zhepeng Li, Xiao Fang, and Olivia R. Liu Sheng. 2015. A Survey of Link Recommendation for Social Networks: Methods, theoretical Foundations, and Future Research Directions. Computer Science (2015).

[23]

David Liben-Nowell and Jon Kleinberg. 2007. The link prediction problem for social networks. Journal of the Association for Information Science and Technology 58, 7 (2007), 1019C1031.

Digital Library

[24]

Jonathan Long, Evan Shelhamer, and Trevor Darrell. 2015. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3431--3440.

[25]

Aditya Krishna Menon and Charles Elkan. 2011. Link Prediction via Matrix Factorization. In European Conference on Machine Learning and Knowledge Discovery in Databases. 437--452.

Digital Library

[26]

Alan Mislove, Massimiliano Marcon, Krishna P. Gummadi, Peter Druschel, and Bobby Bhattacharjee. 2007. Measurement and analysis of online social networks. In ACM SIGCOMM Conference on Internet Measurement 2007. 1815--1816.

Digital Library

[27]

Mark EJ Newman. 2006. Modularity and community structure in networks. PNAS 103, 23 (2006), 8577--8582.

[28]

Lene Nielsen. 2012. Personas-user focused design. Vol. 15. Springer Science & Business Media.

[29]

Joshua O'Madadhain, Jon Hutchins, and Padhraic Smyth. 2005. Prediction and ranking algorithms for event-based network data. Acm Sigkdd Explorations Newsletter 7, 2 (2005), 23--30.

Digital Library

[30]

Shuang Qiu and etc. 2014. Item Group Based Pairwise Preference Learning for Personalized Ranking. In Proceedings of the 37th International ACM SIGIR Conference on Research; Development in Information Retrieval. 1219--1222.

Digital Library

[31]

Matthew J. Rattigan and David Jensen. 2005. The case for anomalous link discovery. Acm Sigkdd Explorations Newsletter 7, 2 (2005), 41--47.

Digital Library

[32]

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in neural information processing systems. 91--99.

Digital Library

[33]

Yafeng Ren, Yue Zhang, Meishan Zhang, and Donghong Ji. 2016. ContextSensitive Twitter Sentiment Classification Using Neural Network. AAAI.

Digital Library

[34]

Stetten Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Conference on Uncertainty in Artificial Intelligence. 452--461.

Digital Library

[35]

By Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic Matrix Factorization. Advances in Neural Information Processing Systems (2007), 1257--1264.

Digital Library

[36]

Aliaksei Severyn and Alessandro Moschitti. 2015. Learning to Rank Short Text Pairs with Convolutional Deep Neural Networks. In the International ACM SIGIR Conference. 373--382.

Digital Library

[37]

Dongjin Song, David A. Meyer, and Dacheng Tao. 2015. Efficient Latent Link Recommendation in Signed Networks. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1105--1114.

Digital Library

[38]

Suraj Srinivas and R. Venkatesh Babu. 2015. Deep Learning in Neural Networks: An Overview. Computer Science (2015).

[39]

Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. Journal of Machine Learning Research 15, 1 (2014), 1929--1958.

Digital Library

[40]

Jie Tang, Tiancheng Lou, Jon Kleinberg, and Sen Wu. 2016. Transfer Learning to Infer Social Ties Across Heterogeneous Networks. ACM Trans. Inf. Syst. 34, 2 (2016), 7:1--7:43.

Digital Library

[41]

Caihua Wang, Juan Liu, Fei Luo, Yafang Tan, Zixin Deng, and Qian Nan Hu. 2014. Pairwise input neural network for target-ligand interaction prediction. In Bioinformatics and Biomedicine (BIBM), 2014 IEEE International Conference on. 67--70.

[42]

Nicolas Le Roux Yoshua Bengio, Olivier Delalleau. 2006. The Curse of Highly Variable Functions for Local Kernel Machines. 107--114.

[43]

Matthew D. Zeiler. 2012. ADADELTA: An Adaptive Learning Rate Method. Computer Science (2012).

[44]

Yu Zheng, Lizhu Zhang, Zhengxin Ma, Xing Xie, and Wei-Ying Ma. 2011. Recommending Friends and Locations Based on Individual Location History. ACM Trans. Web (2011), 5:1--5:44.

Digital Library

Cited By

Tian JHou Z(2024)Friendship Inference Based on Interest Trajectory Similarity and Co-OccurrenceChinese Journal of Electronics10.23919/cje.2022.00.36333:3(708-720)Online publication date: May-2024
https://doi.org/10.23919/cje.2022.00.363
Chen BHo CYang D(2024)AFTER: Adaptive Friend Discovery for Temporal-Spatial and Social-Aware XR2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00207(2639-2652)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00207
Hu HCao CHu QZhang Y(2024)Federated learning enabled graph convolutional autoencoder and factorization machine for potential friendship prediction in social networksInformation Fusion10.1016/j.inffus.2023.102042102(102042)Online publication date: Feb-2024
https://doi.org/10.1016/j.inffus.2023.102042
Show More Cited By

Index Terms

BayDNN: Friend Recommendation with Bayesian Personalized Ranking Deep Neural Network
1. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals
      1. Recommender systems

Recommendations

A probabilistic music recommender considering user opinions and audio features
Special issue: AIRS2005: Information retrieval research in Asia

A recommender system has an obvious appeal in an environment where the amount of on-line information vastly outstrips any individual's capability to survey. Music recommendation is considered a popular application area. In order to make personalized ...
Clustering for probabilistic model estimation for CF
WWW '05: Special interest tracks and posters of the 14th international conference on World Wide Web

Based on the type of collaborative objects, a collaborative filtering (CF) system falls into one of two categories: item-based CF and user-based CF. Clustering is the basic idea in both cases, where users or items are classified into user groups where ...
Collaborative filtering with decoupled models for preferences and ratings
CIKM '03: Proceedings of the twelfth international conference on Information and knowledge management

In this paper, we describe a new model for collaborative filtering. The motivation of this work comes from the fact that two users with very similar preferences on items may have very different rating schemes. For example, one user may tend to assign a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '17: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management

November 2017

2604 pages

ISBN:9781450349185

DOI:10.1145/3132847

General Chairs:
Ee-Peng Lim
Singapore Management University, Singapore
,
Marianne Winslett
University of Illinois at Urbana-Champaign, USA, and Advanced Digital Sciences Center, Singapore
,
Program Chairs:
Mark Sanderson
RMIT, Australia
,
Ada Fu
Chinese University of Hong Kong, Hong Kong
,
Jimeng Sun
Georgia Tech, USA
,
Shane Culpepper
RMIT, Australia
,
Eric Lo
Chinese University of Hong Kong, Hong Kong
,
Joyce Ho
Emory University, USA
,
Debora Donato
Mix Tech, Inc., USA
,
Rakesh Agrawal
Data Insights Laboratories, USA
,
Yu Zheng
Microsoft Research Asia, China
,
Carlos Castillo
Qatar Computing Research Institute, Qatar
,
Aixin Sun
Nanyang Technological University, Singapore
,
Vincent S. Tseng
National Cheng Kung University, Taiwan
,
Chenliang Li
Wuhan University, China

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Conference

CIKM '17

Sponsor:

CIKM '17: ACM Conference on Information and Knowledge Management

November 6 - 10, 2017

Singapore, Singapore

Acceptance Rates

CIKM '17 Paper Acceptance Rate 171 of 855 submissions, 20%;

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
1,318
Total Downloads

Downloads (Last 12 months)98
Downloads (Last 6 weeks)20

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tian JHou Z(2024)Friendship Inference Based on Interest Trajectory Similarity and Co-OccurrenceChinese Journal of Electronics10.23919/cje.2022.00.36333:3(708-720)Online publication date: May-2024
https://doi.org/10.23919/cje.2022.00.363
Chen BHo CYang D(2024)AFTER: Adaptive Friend Discovery for Temporal-Spatial and Social-Aware XR2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00207(2639-2652)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00207
Hu HCao CHu QZhang Y(2024)Federated learning enabled graph convolutional autoencoder and factorization machine for potential friendship prediction in social networksInformation Fusion10.1016/j.inffus.2023.102042102(102042)Online publication date: Feb-2024
https://doi.org/10.1016/j.inffus.2023.102042
Zhou WGuo FXu HWang Z(2024)Joint friend and item recommendation based on multidimensional feature reciprocal interaction in social e-commerceElectronic Commerce Research and Applications10.1016/j.elerap.2024.10140665(101406)Online publication date: May-2024
https://doi.org/10.1016/j.elerap.2024.101406
Li DEsquivel J(2024)Accuracy-enhanced E-commerce recommendation based on deep learning and locality-sensitive hashingWireless Networks10.1007/s11276-023-03593-130:9(7305-7320)Online publication date: 2-Jan-2024
https://doi.org/10.1007/s11276-023-03593-1
Wang ZXu YWang ZFan RGuo YLi W(2024)Knowledge Graph-Aware Deep Interest Extraction Network on Sequential RecommendationNeural Processing Letters10.1007/s11063-024-11665-256:4Online publication date: 28-Jun-2024
https://doi.org/10.1007/s11063-024-11665-2
Sun YSun ZSha XZhang JOng Y(2023)Disentangling Motives behind Item Consumption and Social Connection for Mutually-enhanced Joint PredictionProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608767(613-624)Online publication date: 14-Sep-2023
https://dl.acm.org/doi/10.1145/3604915.3608767
Yang MLiu ZYang LLiu XWang CPeng HYu PChua TLauw HSi LTerzi ETsaparas P(2023)Ranking-based Group Identification via Factorized Attention on Social Tripartite GraphProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3570406(769-777)Online publication date: 27-Feb-2023
https://dl.acm.org/doi/10.1145/3539597.3570406
Shafik WMatinkhah SShokoor F(2022)Recommendation System Comparative Analysis: Internet of Things aided NetworksEAI Endorsed Transactions on Internet of Things10.4108/eetiot.v8i29.11088:29(e5)Online publication date: 20-May-2022
https://doi.org/10.4108/eetiot.v8i29.1108
Chen BYang DAl Hasan MXiong L(2022)User Recommendation in Social Metaverse with VRProceedings of the 31st ACM International Conference on Information & Knowledge Management10.1145/3511808.3557487(148-158)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3511808.3557487
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents