Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3460231.3474262acmconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
research-article

Stronger Privacy for Federated Collaborative Filtering With Implicit Feedback

Published: 13 September 2021 Publication History

Abstract

Recommender systems are commonly trained on centrally-collected user interaction data like views or clicks. This practice however raises serious privacy concerns regarding the recommender’s collection and handling of potentially sensitive data. Several privacy-aware recommender systems have been proposed in recent literature, but comparatively little attention has been given to systems at the intersection of implicit feedback and privacy. To address this shortcoming, we propose a practical federated recommender system for implicit data under user-level local differential privacy (LDP). The privacy-utility trade-off is controlled by parameters ϵ and k, regulating the per-update privacy budget and the number of ϵ-LDP gradient updates sent by each user, respectively. To further protect the user’s privacy, we introduce a proxy network to reduce the fingerprinting surface by anonymizing and shuffling the reports before forwarding them to the recommender. We empirically demonstrate the effectiveness of our framework on the MovieLens dataset, achieving up to Hit Ratio with K=10 (HR@10) 0.68 on 50,000 users with 5,000 items. Even on the full dataset, we show that it is possible to achieve reasonable utility with HR@10>0.5 without compromising user privacy.

Supplementary Material

MP4 File (recsys21.mp4)
RecSys '21 - Stronger Privacy for Federated Collaborative Filtering With Implicit Feedback Presentation video

References

[1]
Muhammad Ammad-ud din, Elena Ivannikova, Suleiman A. Khan, Were Oyomno, Qiang Fu, Kuan Eeik Tan, and Adrian Flanagan. 2019. Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation System. Technical Report. arxiv:1901.09888
[2]
Abhishek Bhowmick, John Duchi, Julien Freudiger, Gaurav Kapoor, and Ryan Rogers. 2018. Protection Against Reconstruction and Its Applications in Private Federated Learning. Technical Report. arxiv:1812.00984
[3]
Joseph A. Calandrino, Ann Kilzer, Arvind Narayanan, Edward W. Felten, and Vitaly Shmatikov. 2011. ”You Might Also Like:” Privacy Risks of Collaborative Filtering. Proceedings - IEEE Symposium on Security and Privacy (2011). https://doi.org/10.1109/SP.2011.40
[4]
John C. Duchi, Michael I. Jordan, and Martin J. Wainwright. 2013. Local Privacy and Statistical Minimax Rates. 2013 51st Annual Allerton Conference on Communication, Control, and Computing, Allerton 2013(2013). https://doi.org/10.1109/Allerton.2013.6736718
[5]
Erika Duriakova, Elias Z. Tragos, Barry Smyth, Neil Hurley, Francisco J. Peña, Panagiotis Symeonidis, James Geraci, and Aonghus Lawlor. 2019. PDMFRec: A Decentralised Matrix Factorisation with Tunable User-Centric Privacy. Proceedings of the 13th ACM Conference on Recommender Systems (2019). https://doi.org/10.1145/3298689.3347035
[6]
Cynthia Dwork. 2006. Differential Privacy. Automata, Languages and Programming(2006).
[7]
Cynthia Dwork and Aaron Roth. 2013. The Algorithmic Foundations of Differential Privacy. Foundations and Trends in Theoretical Computer Science (2013).
[8]
Úlfar Erlingsson, Vasyl Pihur, and Aleksandra Korolova. 2014. RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Response. Proceedings of the ACM Conference on Computer and Communications Security. https://doi.org/10.1145/2660267.2660348 arxiv:1407.6981
[9]
Chen Gao, Chao Huang, Dongsheng Lin, Depeng Jin, and Yong Li. 2020. DPLCF: Differentially Private Local Collaborative Filtering. SIGIR 2020 - Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (2020). https://doi.org/10.1145/3397271.3401053
[10]
F. Maxwell Harper and Joseph A. Konstan. 2015. The MovieLens Datasets: History and Context. ACM Transactions on Interactive Intelligent Systems (TiiS) (2015). https://doi.org/10.1145/2827872
[11]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat Seng Chua. 2017. Neural Collaborative Filtering. 26th International World Wide Web Conference, WWW 2017 (2017). https://doi.org/10.1145/3038912.3052569 arxiv:1708.05031
[12]
Briland Hitaj, Giuseppe Ateniese, and Fernando Perez-Cruz. 2017. Deep Models under the GAN: Information Leakage from Collaborative Deep Learning. Proceedings of the ACM Conference on Computer and Communications Security (2017). https://doi.org/10.1145/3133956.3134012 arxiv:1702.07464
[13]
Yifan Hu, Chris Volinsky, and Yehuda Koren. 2008. Collaborative Filtering for Implicit Feedback Datasets. Proceedings - IEEE International Conference on Data Mining, ICDM (2008). https://doi.org/10.1109/ICDM.2008.22
[14]
Jingyu Hua, Chang Xia, and Sheng Zhong. 2015. Differentially Private Matrix Factorization. IJCAI International Joint Conference on Artificial Intelligence (2015).
[15]
Jakub Konecný, H. Brendan McMahan, Felix X. Yu, Peter Richtárik, Ananda Theertha Suresh, and Dave Bacon. 2016. Federated Learning: Strategies for Improving Communication Efficiency. CoRR abs/1610.05492(2016). arxiv:1610.05492http://arxiv.org/abs/1610.05492
[16]
Shyong K. Lam, Dan Frankowski, and John Riedl. 2006. Do You Trust Your Recommendations? An Exploration of Security and Privacy Issues in Recommender Systems. Emerging Trends in Information and Communication Security (2006).
[17]
C. Li, B. Palanisamy, and J. Joshi. 2017. Differentially Private Trajectory Analysis for Points-of-Interest Recommendation. 2017 IEEE International Congress on Big Data (BigData Congress) (2017). https://doi.org/10.1109/BigDataCongress.2017.16
[18]
Guanyu Lin, Feng Liang, Weike Pan, and Zhong Ming. 2020. FedRec: Federated Recommendation with Explicit Feedback. IEEE Intelligent Systems(2020). https://doi.org/10.1109/MIS.2020.3017205
[19]
Ruixuan Liu, Yang Cao, Masatoshi Yoshikawa, and Hong Chen. 2020. FedSel: Federated SGD Under Local Differential Privacy with Top-k Dimension Selection. (2020). arxiv:2003.10637
[20]
Pól Mac Aonghusa and Douglas J. Leith. 2016. Don’t Let Google Know I’m Lonely. ACM Transactions on Privacy and Security(2016). https://doi.org/10.1145/2937754 arxiv:1504.08043
[21]
H. Brendan McMahan, Eider Moore, Daniel Ramage, and Blaise Agüera y Arcas. 2016. Federated Learning of Deep Networks using Model Averaging. CoRR (2016). arxiv:1602.05629http://arxiv.org/abs/1602.05629
[22]
Frank McSherry and Ilya Mironov. 2009. Differentially Private Recommender Systems: Building Privacy into the Netflix Prize Contenders. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2009). https://doi.org/10.1145/1557019.1557090
[23]
Arvind Narayanan and Vitaly Shmatikov. 2008. Robust De-anonymization of Large Sparse Datasets. Proceedings - IEEE Symposium on Security and Privacy (2008). https://doi.org/10.1109/SP.2008.33
[24]
Thông T. Nguyên, Xiaokui Xiao, Yin Yang, Siu Cheung Hui, Hyejin Shin, and Junbum Shin. 2016. Collecting and Analyzing Data from Smart Device Users with Local Differential Privacy. Technical Report. arxiv:1606.05053http://arxiv.org/abs/1606.05053
[25]
Huseyin Polat and Wenliang Du. 2005. SVD-based Collaborative Filtering with Privacy. Proceedings of the ACM Symposium on Applied Computing (2005). https://doi.org/10.1145/1066677.1066860
[26]
Y. Shen and H. Jin. 2014. Privacy-Preserving Personalized Recommendation: An Instance-Based Approach via Differential Privacy. 2014 IEEE International Conference on Data Mining (2014). https://doi.org/10.1109/ICDM.2014.140
[27]
Yilin Shen and Hongxia Jin. 2016. EpicRec: Towards Practical Differentially Private Framework for Personalized Recommendation. Proceedings of the ACM Conference on Computer and Communications Security (2016). https://doi.org/10.1145/2976749.2978316
[28]
Hyejin Shin, Sungwook Kim, Junbum Shin, and Xiaokui Xiao. 2018. Privacy Enhanced Matrix Factorization for Recommendation with Local Differential Privacy. IEEE Transactions on Knowledge and Data Engineering (2018). https://doi.org/10.1109/TKDE.2018.2805356
[29]
Lichao Sun, Xun Chen, Jianwei Qian, and Philip S. Yu. 2020. LDP-FL: Practical Private Aggregation in Federated Learning with Local Differential Privacy. arXiv:2007.15789
[30]
Differential Privacy Team. 2017. Learning with Privacy at Scale. Technical Report. https://machinelearning.apple.com/2017/08/02/inverse-text-normal.html
[31]
Stacey Truex, Ling Liu, Ka Ho Chow, Mehmet Emre Gursoy, and Wenqi Wei. 2020. LDP-Fed: Federated Learning with Local Differential Privacy. EdgeSys 2020 - Proceedings of the 3rd ACM International Workshop on Edge Systems, Analytics and Networking, Part of EuroSys 2020 (2020). https://doi.org/10.1145/3378679.3394533 arxiv:2006.03637v1
[32]
Ning Wang, Xiaokui Xiao, Yin Yang, Jun Zhao, Siu Cheung Hui, Hyejin Shin, Junbum Shin, and Ge Yu. 2019. Collecting and Analyzing Multidimensional Data with Local Differential Privacy. (2019). arxiv:1907.00782v1
[33]
Zhibo Wang, Mengkai Song, Zhifei Zhang, Yang Song, Qian Wang, and Hairong Qi. 2018. Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning. CoRR (2018). arxiv:1812.00535http://arxiv.org/abs/1812.00535
[34]
Udi Weinsberg, Smriti Bhagat, Stratis Ioannidis, and Nina Taft. 2012. BlurMe: Inferring and Obfuscating User Gender Based on Ratings. RecSys’12 - Proceedings of the 6th ACM Conference on Recommender Systems (2012). https://doi.org/10.1145/2365952.2365989
[35]
Wennan Zhu, Peter Kairouz, Brendan Mcmahan, Haicheng Sun, Wei Li, Rpi Google, and Google Google Google. 2020. Federated Heavy Hitters Discovery with Differential Privacy. (2020).
[36]
Úlfar Erlingsson, Vitaly Feldman, Ilya Mironov, Ananth Raghunathan, Kunal Talwar, and Abhradeep Thakurta. 2020. Amplification by Shuffling: From Local to Central Differential Privacy via Anonymity. arxiv:1811.12469 [cs.LG]

Cited By

View all
  • (2025)FCER: A Federated Cloud-Edge Recommendation Framework With Cluster-Based Edge SelectionIEEE Transactions on Mobile Computing10.1109/TMC.2024.348449324:3(1731-1743)Online publication date: Mar-2025
  • (2025)Distributed Differentially Private Matrix Factorization for Implicit Data via Secure AggregationIEEE Transactions on Computers10.1109/TC.2024.350038374:2(705-716)Online publication date: Feb-2025
  • (2025)Enhancing federated learning-based social recommendations with graph attention networksNeurocomputing10.1016/j.neucom.2024.129045617(129045)Online publication date: Feb-2025
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
RecSys '21: Proceedings of the 15th ACM Conference on Recommender Systems
September 2021
883 pages
ISBN:9781450384582
DOI:10.1145/3460231
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. federated learning
  2. local differential privacy
  3. recommender systems

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

RecSys '21: Fifteenth ACM Conference on Recommender Systems
September 27 - October 1, 2021
Amsterdam, Netherlands

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)84
  • Downloads (Last 6 weeks)5
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)FCER: A Federated Cloud-Edge Recommendation Framework With Cluster-Based Edge SelectionIEEE Transactions on Mobile Computing10.1109/TMC.2024.348449324:3(1731-1743)Online publication date: Mar-2025
  • (2025)Distributed Differentially Private Matrix Factorization for Implicit Data via Secure AggregationIEEE Transactions on Computers10.1109/TC.2024.350038374:2(705-716)Online publication date: Feb-2025
  • (2025)Enhancing federated learning-based social recommendations with graph attention networksNeurocomputing10.1016/j.neucom.2024.129045617(129045)Online publication date: Feb-2025
  • (2024)RecBERT: Semantic Recommendation Engine with Large Language Model Enhanced Query Segmentation for k-Nearest Neighbors Ranking RetrievalIntelligent and Converged Networks10.23919/ICN.2024.00045:1(42-52)Online publication date: Mar-2024
  • (2024)PerFedRec++: Enhancing Personalized Federated Recommendation with Self-Supervised Pre-TrainingACM Transactions on Intelligent Systems and Technology10.1145/366492715:5(1-24)Online publication date: 14-May-2024
  • (2024)Horizontal Federated Recommender System: A SurveyACM Computing Surveys10.1145/365616556:9(1-42)Online publication date: 8-May-2024
  • (2024)Discrete Federated Multi-behavior Recommendation for Privacy-Preserving Heterogeneous One-Class Collaborative FilteringACM Transactions on Information Systems10.1145/365285342:5(1-50)Online publication date: 29-Apr-2024
  • (2024)Decentralized Federated Recommendation with Privacy-aware Structured Client-level GraphACM Transactions on Intelligent Systems and Technology10.1145/364128715:4(1-23)Online publication date: 22-Jan-2024
  • (2024)FedLoCA: Low-Rank Coordinated Adaptation with Knowledge Decoupling for Federated RecommendationsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688112(690-700)Online publication date: 8-Oct-2024
  • (2024)Efficient and Robust Regularized Federated RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679682(1452-1461)Online publication date: 21-Oct-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media