Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

The Crowd Wisdom for Location Privacy of Crowdsensing Photos: Spear or Shield?

Published: 14 September 2021 Publication History

Abstract

The incorporation of the mobile crowd in visual sensing provides a significant opportunity to explore and understand uncharted physical places. We investigate the gains and losses of the involvement of the crowd wisdom on users' location privacy in photo crowdsensing. For the negative effects, we design a novel crowdsensing photo location inference model, regardless of the robust location protection techniques, by jointly exploiting the visual representation, correlation, and geo-annotation capabilities extracted from the crowd. Compared with existing retrieval-based and model-based location inference techniques, our proposal poses more pernicious threats to location privacy by considering the no-reference-photos situations of crowdsensing. We conduct extensive analyses on the model with four photo datasets and crowdsourcing surveys for geo-annotation. The results indicate that being in a crowd of photos will, unfortunately, increase one's risk to be geo-identified, and highlights that the model can yield a considerable high inference accuracy (48%~70%) and serious privacy exposure (over 80% of users get privacy disclosed) with a small portion of geo-annotated samples. In view of the threats, we further propose an adaptive grouping-based signing model that hides a user's track with the camouflage of a crowd of users. Wherein, ring signature is tailored for crowdsensing to provide indistinguishable while valid identities for every user's submission. We theoretically analyze its adjustable privacy protection capability and develop a prototype to evaluate the effectiveness and performance.

Supplementary Material

zhou (zhou-1.zip)
Supplemental movie, appendix, image and software files for, The Crowd Wisdom for Location Privacy of Crowdsensing Photos: Spear or Shield?

References

[1]
Björn Barz, K. Schröter, Moritz Münch, B. Yang, A. Unger, D. Dransch, and Joachim Denzler. 2019. Enhancing Flood Impact Analysis using Interactive Retrieval of Social Media Images. ArXiv abs/1908.03361 (2019).
[2]
Joan-Isaac Biel, Nathalie Martin, David Labbe, and Daniel Gatica-Perez. 2018. Bites'N'Bits: Inferring Eating Behavior from Contextual Mobile Data. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4 (2018). https://doi.org/10.1145/3161161
[3]
D. Boneh, C. Gentry, B. Lynn, and H. Shacham. 2003. Aggregate and Verifiably Encrypted Signatures from Bilinear Maps. In EUROCRYPT. 416--432.
[4]
Hancheng Cao, Jie Feng, Yong Li, and Vassilis Kostakos. 2018. Uniqueness in the city: Urban morphology and location privacy. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1--20.
[5]
Huihui Chen, Bin Guo, Zhiwen Yu, and Han Qi. 2016. Toward real-time and cooperative mobile visual sensing and sharing. In Proc. of IEEE Infocom. 1--9.
[6]
J. Choi, M. Larson, Xinchao Li, K. Li, G. Friedland, and A. Hanjalic. 2017. The Geo-Privacy Bonus of Popular Photo Enhancements. In Proc. of the 2017 ACM on International Conference on Multimedia Retrieval. 84--92.
[7]
A. Costanzo, Irene Amerini, R. Caldelli, and M. Barni. 2014. Forensic Analysis of SIFT Keypoint Removal and Injection. IEEE Transactions on Information Forensics and Security 9 (2014), 1450--1464.
[8]
Angelo De Caro and Vincenzo Iovino. 2011. jPBC: Java pairing based cryptography. In Proc. of the IEEE symposium on computers and communications (ISCC). IEEE, 850--855.
[9]
Quan Fang, J. Sang, and C. Xu. 2013. GIANT: geo-informative attributes for location recognition and exploration. In Proc. of the the 21st ACM International Conference on Multimedia (MM). 13--22.
[10]
Anhong Guo, Anuraag Jain, Shomiron Ghose, Gierad Laput, C. Harrison, and Jeffrey P. Bigham. 2018. Crowd-AI Camera Sensing in the Real World. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2 (2018), 1--20.
[11]
Bin Guo, Chao Chen, Daqing Zhang, Z. Yu, and Alvin Chin. 2016. Mobile crowd sensing and computing: when participatory sensing meets participatory social media. IEEE Communications Magazine 54 (2016), 131--137.
[12]
Bin Guo, H. Chen, Z. Yu, X. Xie, Shenlong Huangfu, and Daqing Zhang. 2015. FlierMeet: A Mobile Crowdsensing System for Cross-Space Public Information Reposting, Tagging, and Sharing. IEEE Transactions on Mobile Computing 14 (2015), 2020--2033.
[13]
Bin Guo, Y. Ouyang, Cheng Zhang, Jiafan Zhang, Z. Yu, Di Wu, and Yu Wang. 2017. CrowdStory: Fine-Grained Event Storyline Generation by Fusion of Multi-Modal Crowdsourced Data. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1 (2017), 55:1-55:19.
[14]
James Hays and Alexei A. Efros. 2008. IM2GPS: estimating geographic information from a single image. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition. 1--8.
[15]
Kuan Lun Huang, Salil S. Kanhere, and W. Hu. 2009. Towards privacy-sensitive participatory sensing. In Proc. of the IEEE International Conference on Pervasive Computing and Communications. 1--6.
[16]
B. Ionescu, A. Gînsca, Bogdan Boteanu, M. Lupu, Adrian Popescu, and H. Müller. 2016. Div150Multi: a social image retrieval result diversification dataset with multi-topic queries. In Proc. of the 7th International Conference on Multimedia Systems. ACM, 1--6.
[17]
Haiming Jin, Lu Su, Houping Xiao, and Klara Nahrstedt. 2018. Incentive mechanism for privacy-aware data aggregation in mobile crowd sensing systems. IEEE/ACM Transactions on Networking 26, 5 (2018), 2019--2032.
[18]
X. Jin, Rui Zhang, Y. Chen, Tao Li, and Yanchao Zhang. 2016. DPSense: Differentially Private Crowdsourced Spectrum Sensing. In Proc. of the 2016 ACM SIGSAC Conference on Computer and Communications Security. 296--307.
[19]
Thivya Kandappu, Archan Misra, Shih-Fen Cheng, Randy Tandriansyah, and Hoong Chuin Lau. 2018. Obfuscation at-source: Privacy in context-aware mobile crowd-sourcing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 1--24.
[20]
H. Kim, E. Dunn, and J. Frahm. 2017. Learned Contextual Feature Reweighting for Image Geo-Localization. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3251--3260.
[21]
Pengfei Li, Hua Lu, Nattiya Kanhabua, Sha Zhao, and Gang Pan. 2018. Location inference for non-geotagged tweets in user timelines. IEEE Transactions on Knowledge and Data Engineering 31, 6 (2018), 1150--1165.
[22]
Chi Liu, Tianqing Zhu, Jun Zhang, and Wanlei Zhou. 2020. Privacy Intelligence: A Survey on Image Sharing on Online Social Networks. arXiv preprint arXiv:2008.12199 (2020).
[23]
A. Ng, Michael I. Jordan, and Yair Weiss. 2001. On Spectral Clustering: Analysis and an algorithm. In NIPS.
[24]
Ben Niu, Yahong Chen, Zhibo Wang, Boyang Wang, and Hui Li. 2020. Eclipse: Preserving Differential Location Privacy Against Long-Term Observation Attacks. IEEE Transactions on Mobile Computing (2020).
[25]
S. Papadopoulos, Christos Zigkolis, Y. Kompatsiaris, and Athena Vakali. 2011. Cluster-Based Landmark and Event Detection for Tagged Photo Collections. IEEE MultiMedia 18 (2011), 52--63.
[26]
J. Philbin, O. Chum, M. Isard, Josef Sivic, and Andrew Zisserman. 2007. Object retrieval with large vocabularies and fast spatial matching. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition. 1--8.
[27]
Layla Pournajaf, Daniel A. Garcia-Ulloa, Li Xiong, and V. S. Sunderam. 2016. Participant Privacy in Mobile Crowd Sensing Task Management: A Survey of Methods and Challenges. SIGMOD Rec. 44 (2016), 23--34.
[28]
D. Quercia, N. O'Hare, and Henriette Cramer. 2014. Aesthetic capital: what makes london look beautiful, quiet, and happy?. In Proc. of the 17th ACM conference on Computer supported cooperative work & social computing (CSCW). 945--955.
[29]
Olga Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Zhiheng Huang, A. Karpathy, A. Khosla, Michael S. Bernstein, A. Berg, and Li Fei-Fei. 2015. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision 115 (2015), 211--252.
[30]
Philip Salesses, Katja Schechtner, and C. Hidalgo. 2013. The Collaborative Image of The City: Mapping the Inequality of Urban Perception. PLoS ONE 8 (2013).
[31]
Mark Sandler, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. 2018. Mobilenetv2: Inverted residuals and linear bottlenecks. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition. 4510--4520.
[32]
Peng Sun, Zhibo Wang, Yunhe Feng, Liantao Wu, Yanjun Li, Hairong Qi, and Zhi Wang. 2020. Towards personalized privacy-preserving incentive for truth discovery in crowdsourced binary-choice question answering. In Proc. of the IEEE Conference on Computer Communications (Infocom). IEEE, 1133--1142.
[33]
L. Sweeney. 2002. k-Anonymity: A Model for Protecting Privacy. Int. J. Uncertain. Fuzziness Knowl. Based Syst. 10 (2002), 557--570.
[34]
Yicong Tian, C. Chen, and M. Shah. 2017. Cross-View Image Matching for Geo-Localization in Urban Environments. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 1998--2006.
[35]
H. To, Gabriel Ghinita, and C. Shahabi. 2014. A Framework for Protecting Worker Location Privacy in Spatial Crowdsourcing. Proc. VLDB Endow. 7 (2014), 919--930.
[36]
Idalides J. Vergara-Laurens, D. Mendez, and M. Labrador. 2014. Privacy, quality of information, and energy consumption in Participatory Sensing systems. In Proc. of the IEEE International Conference on Pervasive Computing and Communications (PerCom). 199--207.
[37]
Boyang Wang, B. Li, and H. Li. 2014. Oruta: privacy-preserving public auditing for shared data in the cloud. IEEE Transactions on Cloud Computing 2 (2014), 43--56.
[38]
Leye Wang, Gehua Qin, D. Yang, Xiao Han, and Xiaojuan Ma. 2018. Geographic Differential Privacy for Mobile Crowd Coverage Maximization. In Proc. of the AAAI Conference on Artificial Intelligence (AAAI). 1--10.
[39]
Leye Wang, D. Yang, Xiao Han, Tianben Wang, Daqing Zhang, and Xiaojuan Ma. 2017. Location Privacy-Preserving Task Allocation for Mobile Crowdsensing with Differential Geo-Obfuscation. In Proc. of the 26th International Conference on World Wide Web. 627--636.
[40]
Leye Wang, Daqing Zhang, Yasha Wang, C. Chen, X. Han, and A. M'hamed. 2016. Sparse mobile crowdsensing: challenges and opportunities. IEEE Communications Magazine 54 (2016), 161--167.
[41]
Leye Wang, Daqing Zhang, D. Yang, Brian Y. Lim, X. Han, and Xiaojuan Ma. 2020. Sparse Mobile Crowdsensing With Differential and Distortion Location Privacy. IEEE Transactions on Information Forensics and Security 15 (2020), 2735--2749.
[42]
Xiong Wang, Lei Ding, Qi Wang, Jin Xie, Tianyi Wang, Xiaohua Tian, Yunfeng Guan, and Xinbing Wang. 2017. A Picture is Worth a Thousand Words: Share Your Real-Time View on the Road. IEEE Transactions on Vehicular Technology 66 (2017), 2902--2914.
[43]
Yufei Wang, Zhe Lin, Xiaohui Shen, Radomir Mech, Gavin Miller, and Garrison. W. Cottrell. 2016. Event-specific Image Importance. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[44]
Tobias Weyand, Ilya Kostrikov, and J. Philbin. 2016. PlaNet - Photo Geolocation with Convolutional Neural Networks. In Proc. of ECCV. 37--55.
[45]
Tobias Weyand and B. Leibe. 2015. Visual landmark recognition from Internet photo collections: A large-scale evaluation. Comput. Vis. Image Underst. 135 (2015), 1--15.
[46]
Dingqi Yang, Benjamin Fankhauser, Paolo Rosso, and Philippe Cudre-Mauroux. 2020. Location Prediction over Sparse User Mobility Traces Using RNNs: Flashback in Hidden States. In Proc. of IJCAI. 2184--2190.
[47]
Jinghan Yang, A. Chakrabarti, and Y. Vorobeychik. 2020. Protecting Geolocation Privacy of Photo Collections. In Proc. of the AAAI. 524--531.
[48]
Mengyuan Zhang, Lei Yang, Shibo He, Ming Li, and Junshan Zhang. 2021. Privacy-Preserving Data Aggregation for Mobile Crowdsensing With Externality: An Auction Approach. IEEE/ACM Transactions on Networking (2021).
[49]
Richard Zhang, Phillip Isola, Alexei A. Efros, E. Shechtman, and O. Wang. 2018. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. In Proc. of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 586--595.
[50]
Zhikun Zhang, Shibo He, Jiming Chen, and Junshan Zhang. 2018. REAP: An efficient incentive mechanism for reconciling aggregation accuracy and individual privacy in crowdsensing. IEEE Transactions on Information Forensics and Security 13, 12 (2018), 2995--3007.
[51]
Tongqing Zhou, Zhiping Cai, Bin Xiao, Leye Wang, Ming Xu, and Yueyue Chen. 2018. Location Privacy-Preserving Data Recovery for Mobile Crowdsensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2 (2018), 1--23.
[52]
Tongqing Zhou, Bin Xiao, Zhiping Cai, and Ming Xu. 2021. A Utility Model for Photo Selection in Mobile Crowdsensing. IEEE Transactions on Mobile Computing 20 (2021), 48--62.

Cited By

View all
  • (2024)Achieving Panoramic View Coverage in Visual Mobile Crowd-Sensing Networks for Emergency Monitoring ApplicationsACM Transactions on Sensor Networks10.1145/3701730Online publication date: 28-Oct-2024
  • (2024)Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity RecognitionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314157:4(1-25)Online publication date: 12-Jan-2024
  • (2023)VILL: Toward Efficient and Automatic Visual Landmark LabelingACM Transactions on Sensor Networks10.1145/358049719:4(1-25)Online publication date: 21-Apr-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 5, Issue 3
Sept 2021
1443 pages
EISSN:2474-9567
DOI:10.1145/3486621
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 September 2021
Published in IMWUT Volume 5, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. crowd wisdom
  2. crowdsourcing
  3. location privacy
  4. mobile crowdsensing

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)35
  • Downloads (Last 6 weeks)6
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Achieving Panoramic View Coverage in Visual Mobile Crowd-Sensing Networks for Emergency Monitoring ApplicationsACM Transactions on Sensor Networks10.1145/3701730Online publication date: 28-Oct-2024
  • (2024)Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity RecognitionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314157:4(1-25)Online publication date: 12-Jan-2024
  • (2023)VILL: Toward Efficient and Automatic Visual Landmark LabelingACM Transactions on Sensor Networks10.1145/358049719:4(1-25)Online publication date: 21-Apr-2023
  • (2023)In Pursuit of Beauty: Aesthetic-Aware and Context-Adaptive Photo Selection in CrowdsensingIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.323796935:9(9364-9377)Online publication date: 1-Sep-2023
  • (2023)Understanding Location Privacy of the Point-of-Interest Aggregate Data via Practical Attacks and DefensesIEEE Transactions on Dependable and Secure Computing10.1109/TDSC.2022.318427920:3(2433-2449)Online publication date: 1-May-2023
  • (2023)From Eye to Brain: A Proactive and Distributed Crowdsensing Framework for Federated LearningIEEE Internet of Things Journal10.1109/JIOT.2022.323005010:9(8202-8214)Online publication date: 1-May-2023
  • (2023)A Study on Mobile Crowd Sensing Systems for Healthcare ScenariosIEEE Access10.1109/ACCESS.2023.334215811(140325-140347)Online publication date: 2023
  • (2022)Toward privacy-aware federated analytics of cohorts for smart mobilityFrontiers in Computer Science10.3389/fcomp.2022.8912064Online publication date: 27-Jul-2022
  • (2022)Never Too Late: Tracing and Mitigating Backdoor Attacks in Federated Learning2022 41st International Symposium on Reliable Distributed Systems (SRDS)10.1109/SRDS55811.2022.00017(69-81)Online publication date: Sep-2022
  • (2022)Stepping Into the Next Decade of Ubiquitous and Pervasive Computing: UbiComp and ISWC 2021IEEE Pervasive Computing10.1109/MPRV.2022.316006321:2(87-99)Online publication date: 1-Apr-2022

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media