Just Accepted
FedGST: An Efficient Federated Graph Neural Network for Spatio-temporal PoI Recommendation
Abstract
With the proliferation of sensor networks in urban areas, vast amounts of data from location-based social network platforms are now available, thus enabling the stakeholders to develop location-aware services for the end users. PoI (Point of Interests) recommendation is one of the most trending services. PoI recommendation models are developed by considering geographical information and historical records. More recently, with the demand for achieving PoI recommendations on mobile devices, embedded devices, or Internet of Things (IoT) devices, the challenges posed by the limited computational resources, malicious clients, and data silos, the model performance gets immensely affected. To address the above challenges and achieve efficient PoI recommendations, we propose an efficient federated graph learning-based model for mining complex spatiotemporal features to generate recommendations. We implement a GRU-based encoder-decoder to learn the temporal hidden state embeddings. Simultaneously, a 2-layer graph network is used to understand spatial embedding vectors. We also introduce an efficient contribution evaluation method to speed up the training process and improve the recommendation performance. Experiments on the PoI recommendation task based on real-life check-in data validate the effectiveness of our proposed model, and the results indicate that our recommendation model can achieve competitive results with lower computational costs.
References
[1]
Fadi Al-Turjman and Joel Poncha Lemayian. 2020. Intelligence, security, and vehicular sensor networks in internet of things (IoT)-enabled smart-cities: An overview. Computers & Electrical Engineering 87 (2020), 106776.
[2]
Peter W Battaglia, Jessica B Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinicius Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, et al. 2018. Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:1806.01261(2018).
[3]
Chaochao Chen, Jun Zhou, Bingzhe Wu, Wenjing Fang, Li Wang, Yuan Qi, and Xiaolin Zheng. 2020. Practical privacy preserving POI recommendation. ACM Transactions on Intelligent Systems and Technology (TIST) 11, 5(2020), 1–20.
[4]
Hang Gao, Ningxin He, and Tiegang Gao. 2023. SVeriFL: Successive verifiable federated learning with privacy-preserving. Information Sciences 622(2023), 98–114.
[5]
Suyu Ge, Chuhan Wu, Fangzhao Wu, Tao Qi, and Yongfeng Huang. 2020. Graph enhanced representation learning for news recommendation. In Proceedings of The Web Conference. 2863–2869.
[6]
Yeting Guo, Fang Liu, Zhiping Cai, Hui Zeng, Li Chen, Tongqing Zhou, and Nong Xiao. 2021. PREFER: Point-of-interest REcommendation with efficiency and privacy-preservation via Federated Edge leaRning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1–25.
[7]
Changhee Hahn, Hodong Kim, Minjae Kim, and Junbeom Hur. 2023. Versa: Verifiable secure aggregation for cross-device federated learning. IEEE Transactions on Dependable and Secure Computing 20, 01(2023), 36–52.
[8]
Jiwei Huang, Zeyu Tong, and Zihan Feng. 2022. Geographical POI recommendation for Internet of Things: A federated learning approach using matrix factorization. International Journal of Communication Systems (2022), e5161.
[9]
Liwei Huang, Yutao Ma, Shibo Wang, and Yanbo Liu. 2019. An attention-based spatiotemporal lstm network for next poi recommendation. IEEE Transactions on Services Computing 14, 6 (2019), 1585–1597.
[10]
Md Ashraful Islam, Mir Mahathir Mohammad, Sarkar Snigdha Sarathi Das, and Mohammed Eunus Ali. 2022. A survey on deep learning based Point-of-Interest (POI) recommendations. Neurocomputing 472(2022), 306–325.
[11]
Pang Wei Koh and Percy Liang. 2017. Understanding black-box predictions via influence functions. In International Conference on Machine Learning. PMLR, 1885–1894.
[12]
Xiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang, and Zhihua Zhang. 2020. On the Convergence of FedAvg on Non-IID Data. In International Conference on Learning Representations.
[13]
Guojun Liang, Kintak U, Xin Ning, Prayag Tiwari, Slawomir Nowaczyk, and Neeraj Kumar. 2023. Semantics-Aware Dynamic Graph Convolutional Network for Traffic Flow Forecasting. IEEE Transactions on Vehicular Technology 72, 6 (2023), 7796–7809. https://doi.org/10.1109/TVT.2023.3239054
[14]
Chunyang Liu, Jiping Liu, Jian Wang, Shenghua Xu, Houzeng Han, and Yang Chen. 2019. An attention-based spatiotemporal gated recurrent unit network for point-of-interest recommendation. ISPRS International Journal of Geo-Information 8, 8(2019), 355.
[15]
Zelei Liu, Yuanyuan Chen, Han Yu, Yang Liu, and Lizhen Cui. 2022. Gtg-shapley: Efficient and accurate participant contribution evaluation in federated learning. ACM Transactions on Intelligent Systems and Technology (TIST) 13, 4(2022), 1–21.
[16]
Zelei Liu, Yuanyuan Chen, Yansong Zhao, Han Yu, Yang Liu, Renyi Bao, Jinpeng Jiang, Zaiqing Nie, Qian Xu, and Qiang Yang. 2022. Contribution-aware federated learning for smart healthcare. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 12396–12404.
[17]
Jing Long, Tong Chen, Quoc Viet Hung Nguyen, and Hongzhi Yin. 2023. Decentralized collaborative learning framework for next POI recommendation. ACM Transactions on Information Systems 41, 3 (2023), 1–25.
[18]
Ismael Martinez, Sreya Francis, and Abdelhakim Senhaji Hafid. 2019. Record and reward federated learning contributions with blockchain. In 2019 International Conference on Cyber-enabled Distributed Computing and Knowledge Discovery (CyberC). IEEE, 50–57.
[19]
Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Artificial Intelligence and Statistics. PMLR, 1273–1282.
[20]
Chuizheng Meng, Sirisha Rambhatla, and Yan Liu. 2021. Cross-node federated graph neural network for spatio-temporal data modeling. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 1202–1211.
[21]
Samaneh Miri Rostami, Saeed Samet, and Ziad Kobti. 2022. A Study of Blockchain-Based Federated Learning. Federated and Transfer Learning(2022), 139–165.
[22]
Dinh C. Nguyen, Quoc-Viet Pham, Pubudu N. Pathirana, Ming Ding, Aruna Seneviratne, Zihuai Lin, Octavia Dobre, and Won-Joo Hwang. 2022. Federated Learning for Smart Healthcare: A Survey. ACM Transactions on Sensor Networks 55, 3, Article 60(feb 2022), 37 pages.
[23]
Jiahao Qi, Feilong Lin, Zhongyu Chen, Changbing Tang, Riheng Jia, and Minglu Li. 2022. High-quality model aggregation for blockchain-based federated learning via reputation-motivated task participation. IEEE Internet of Things Journal 9, 19 (2022), 18378–18391.
[24]
Yifang Qin, Yifan Wang, Fang Sun, Wei Ju, Xuyang Hou, Zhe Wang, Jia Cheng, Jun Lei, and Ming Zhang. 2023. DisenPOI: Disentangling Sequential and Geographical Influence for Point-of-Interest Recommendation. In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining. 508–516.
[25]
Sung Kuk Shyn, Donghee Kim, and Kwangsu Kim. 2021. Fedccea: A practical approach of client contribution evaluation for federated learning. arXiv preprint arXiv:2106.02310(2021).
[26]
En Wang, Yuanbo Xu, Yongjian Yang, Yiheng Jiang, Fukang Yang, and Jie Wu. 2023. Zone-Enhanced Spatio-Temporal Representation Learning for Urban POI Recommendation. IEEE Transactions on Knowledge and Data Engineering (2023), 1–14.
[27]
Li-e Wang, Yihui Wang, Yan Bai, Peng Liu, and Xianxian Li. 2021. POI recommendation with federated learning and privacy preserving in cross domain recommendation. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE, 1–6.
[28]
Shoujin Wang, Liang Hu, Yan Wang, Xiangnan He, Quan Z Sheng, Mehmet A Orgun, Longbing Cao, Francesco Ricci, and S Yu Philip. 2021. Graph learning based recommender systems: a review. In 30th International Joint Conference on Artificial Intelligence (IJCAI). 4644–4652.
[29]
Xiaoyang Wang, Yao Ma, Yiqi Wang, Wei Jin, Xin Wang, Jiliang Tang, Caiyan Jia, and Jian Yu. 2020. Traffic Flow Prediction via Spatial Temporal Graph Neural Network. In Proceedings of The Web Conference. 1082–1092. https://doi.org/10.1145/3366423.3380186
[30]
Zhaobo Wang, Yanmin Zhu, Qiaomei Zhang, Haobing Liu, Chunyang Wang, and Tong Liu. 2022. Graph-Enhanced Spatial-Temporal Network for Next POI Recommendation. ACM Transactions on Knowledge Discovery from Data (TKDD) 16, 6(2022), 1–21.
[31]
Heitor Werneck, Nícollas Silva, Matheus Viana, Adriano CM Pereira, Fernando Mourão, and Leonardo Rocha. 2021. Points of interest recommendations: methods, evaluation, and future directions. Information Systems 101(2021), 101789.
[32]
Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S Yu Philip. 2020. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems 32, 1(2020), 4–24.
[33]
Feng Xia, Ke Sun, Shuo Yu, Abdul Aziz, Liangtian Wan, Shirui Pan, and Huan Liu. 2021. Graph learning: A survey. IEEE Transactions on Artificial Intelligence 2, 2(2021), 109–127.
[34]
Dingqi Yang, Daqing Zhang, Vincent W Zheng, and Zhiyong Yu. 2014. Modeling user activity preference by leveraging user spatial temporal characteristics in LBSNs. IEEE Transactions on Systems, Man, and Cybernetics: Systems 45, 1(2014), 129–142.
[35]
Song Yang, Jiamou Liu, and Kaiqi Zhao. 2022. GETNext: trajectory flow map enhanced transformer for next POI recommendation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 1144–1153.
[36]
Cheuk-Wang Yau, Sukanya Jewsakul, Man-Ho Luk, Angela P. Y. Lee, Yun-Hin Chan, Edith C. H. Ngai, Philip W. T. Pong, King-Shan Lui, and Jiangchuan Liu. 2022. NB-IoT Coverage and Sensor Node Connectivity in Dense Urban Environments: An Empirical Study. ACM Transactions on Sensor Networks 18, 3, Article 49(sep 2022), 36 pages.
[37]
Quan Yuan, Gao Cong, Zongyang Ma, Aixin Sun, and Nadia Magnenat Thalmann. 2013. Time-aware point-of-interest recommendation. In Proceedings of the 36th international ACM SIGIR Conference on Research and Development in Information Retrieval. 363–372.
[38]
Yanci Zhang and Han Yu. 2022. Towards Verifiable Federated Learning. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence. 5686–5693. https://doi.org/10.24963/ijcai.2022/792
[39]
Pengpeng Zhao, Anjing Luo, Yanchi Liu, Fuzhen Zhuang, Jiajie Xu, Zhixu Li, Victor S Sheng, and Xiaofang Zhou. 2020. Where to go next: A spatio-temporal gated network for next poi recommendation. IEEE Transactions on Knowledge and Data Engineering 34, 5(2020), 2512–2524.
[40]
Xiaokang Zhou, Wang Huang, Wei Liang, Zheng Yan, Jianhua Ma, Yi Pan, I Kevin, and Kai Wang. 2024. Federated distillation and blockchain empowered secure knowledge sharing for Internet of medical Things. Information Sciences 662(2024), 120217.
[41]
Xiaokang Zhou, Wei Liang, Akira Kawai, Kaoru Fueda, Jinhua She, and Kevin I-Kai Wang. 2024. Adaptive Segmentation Enhanced Asynchronous Federated Learning for Sustainable Intelligent Transportation Systems. IEEE Transactions on Intelligent Transportation Systems (2024), 1–9. https://doi.org/10.1109/TITS.2024.3362058
[42]
Xiaokang Zhou, Wei Liang, Kevin I-Kai Wang, and Laurence T. Yang. 2021. Deep Correlation Mining Based on Hierarchical Hybrid Networks for Heterogeneous Big Data Recommendations. IEEE Transactions on Computational Social Systems 8, 1 (2021), 171–178. https://doi.org/10.1109/TCSS.2020.2987846
[43]
Xiaokang Zhou, Jiayi Wu, Wei Liang, Kevin I-Kai Wang, Zheng Yan, Laurence T. Yang, and Qun Jin. 2024. Reconstructed Graph Neural Network With Knowledge Distillation for Lightweight Anomaly Detection. IEEE Transactions on Neural Networks and Learning Systems (2024), 1–12. https://doi.org/10.1109/TNNLS.2024.3389714
[44]
Xiaokang Zhou, Qiuyue Yang, Qiang Liu, Wei Liang, Kevin Wang, Zhi Liu, Jianhua Ma, and Qun Jin. 2024. Spatial–Temporal Federated Transfer Learning with multi-sensor data fusion for cooperative positioning. Information Fusion 105(2024), 102182.
[45]
Xiaokang Zhou, Qiuyue Yang, Xuzhe Zheng, Wei Liang, Kevin I-Kai Wang, Jianhua Ma, Yi Pan, and Qun Jin. 2024. Personalized Federated Learning With Model-Contrastive Learning for Multi-Modal User Modeling in Human-Centric Metaverse. IEEE Journal on Selected Areas in Communications 42, 4(2024), 817–831. https://doi.org/10.1109/JSAC.2023.3345431
[46]
Xiaokang Zhou, Xiaozhou Ye, Kevin I-Kai Wang, Wei Liang, Nirmal Kumar C. Nair, Shohei Shimizu, Zheng Yan, and Qun Jin. 2023. Hierarchical Federated Learning With Social Context Clustering-Based Participant Selection for Internet of Medical Things Applications. IEEE Transactions on Computational Social Systems 10, 4 (2023), 1742–1751. https://doi.org/10.1109/TCSS.2023.3259431
[47]
Xiaokang Zhou, Xuzhe Zheng, Xuesong Cui, Jiashuai Shi, Wei Liang, Zheng Yan, Laurence T. Yang, Shohei Shimizu, and Kevin I-Kai Wang. 2023. Digital Twin Enhanced Federated Reinforcement Learning With Lightweight Knowledge Distillation in Mobile Networks. IEEE Journal on Selected Areas in Communications 41, 10(2023), 3191–3211. https://doi.org/10.1109/JSAC.2023.3310046
[48]
Xiaokang Zhou, Xuzhe Zheng, Tian Shu, Wei Liang, Kevin I-Kai Wang, Lianyong Qi, Shohei Shimizu, and Qun Jin. 2023. Information Theoretic Learning-Enhanced Dual-Generative Adversarial Networks With Causal Representation for Robust OOD Generalization. IEEE Transactions on Neural Networks and Learning Systems (2023), 1–14. https://doi.org/10.1109/TNNLS.2023.3330864
Index Terms
- FedGST: An Efficient Federated Graph Neural Network for Spatio-temporal PoI Recommendation
Recommendations
Federated Social Recommendation with Graph Neural Network
Recommender systems have become prosperous nowadays, designed to predict users’ potential interests in items by learning embeddings. Recent developments of the Graph Neural Networks (GNNs) also provide recommender systems (RSs) with powerful backbones to ...
Attentive sequential model based on graph neural network for next poi recommendation
AbstractWith the rapid development of Information Technology, there exist massive amounts of data available on the Internet, which result in a severe information overload problem. Especially, it becomes more and more challenging but necessary to help ...
Next POI Recommendation with Neighbor and Location Popularity
Neural Information ProcessingAbstractNext point-of-interest (POI) recommendation aims to predict the next destination for users. In the past, most POI recommendation models were based on the user’s historical check-in trajectory to achieve recommendations. However, when these models ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
EISSN:1550-4867
Table of ContentsCopyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Journal Family
Publication History
Online AM: 03 September 2024
Accepted: 29 August 2024
Revised: 11 July 2024
Received: 15 March 2023
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 366Total Downloads
- Downloads (Last 12 months)366
- Downloads (Last 6 weeks)140
Reflects downloads up to 14 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in