Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Uncovering the Local Hidden Community Structure in Social Networks

Published: 27 February 2023 Publication History

Abstract

Hidden community is a useful concept proposed recently for social network analysis. Hidden communities indicate some weak communities whose most members also belong to other stronger dominant communities. Dominant communities could form a layer that partitions all the individuals of a network, and hidden communities could form other layer(s) underneath. These layers could be natural structures in the real-world networks like students grouped by major, minor, hometown, and so on. To handle the rapid growth of network scale, in this work, we explore the detection of hidden communities from the local perspective, and propose a new method that detects and boosts each layer iteratively on a subgraph sampled from the original network. We first expand the seed set from a single seed node based on our modified local spectral method and detect an initial dominant local community. Then we temporarily remove the members of this community as well as their connections to other nodes, and detect all the neighborhood communities in the remaining subgraph, including some “broken communities” that only contain a fraction of members in the original network. The local community and neighborhood communities form a dominant layer, and by reducing the edge weights inside these communities, we weaken this layer’s structure to reveal the hidden layers. Eventually, we repeat the whole process, and all communities containing the seed node can be detected and boosted iteratively. We theoretically show that our method can avoid some situations that a broken community and the local community are regarded as one community in the subgraph, leading to the inaccuracy of detection which can be caused by global hidden community detection methods. Extensive experiments show that our method could significantly outperform the state-of-the-art baselines designed for either global hidden community detection or multiple local community detection.

References

[1]
Reid Andersen, Fan Chung, and Kevin Lang. 2006. Local graph partitioning using pagerank vectors. In Proceedings of the 2006 47th Annual IEEE Symposium on Foundations of Computer Science. 475–486.
[2]
Jialu Bao, Kun He, Xiaodong Xin, Bart Selman, and John E. Hopcroft. 2020. Hidden community detection on two-layer stochastic models: A theoretical perspective. In Proceedings of the International Conference on Theory and Applications of Models of Computation. 365–376.
[3]
Nicola Barbieri, Francesco Bonchi, Edoardo Galimberti, and Francesco Gullo. 2015. Efficient and effective community search. Data Mining and Knowledge Discovery 29, 5 (2015), 1406–1433.
[4]
Yuchen Bian, Jingchao Ni, Wei Cheng, and Xiang Zhang. 2017. Many heads are better than one: Local community detection by the multi-walker chain. In Proceedings of the IEEE International Conference on Data Mining. 21–30.
[5]
Vincent D. Blondel, Jean-Loup Guillaume, Renaud Lambiotte, and Etienne Lefebvre. 2008. Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment 2008, 10 (2008), P10008.
[6]
Deyu Bo, Xiao Wang, Chuan Shi, Meiqi Zhu, Emiao Lu, and Peng Cui. 2020. Structural deep clustering network. In Proceedings of the Web Conference. 1400–1410.
[7]
Biao Cai, Yanpeng Wang, Lina Zeng, Yanmei Hu, and Hongjun Li. 2020. Edge classification based on convolutional neural networks for community detection in complex network. Physica A: Statistical Mechanics and its Applications 556 (2020), 124826.
[8]
Zitai Chen, Chuan Chen, Zibin Zheng, and Yi Zhu. 2019. Tensor decomposition for multilayer networks clustering. In Proceedings of the AAAI Conference on Artificial Intelligence. 3371–3378.
[9]
Petr Chunaev. 2020. Community detection in node-attributed social networks: A survey. Computer Science Review 37 (2020), 100286.
[10]
Aaron Clauset. 2005. Finding local community structure in networks. Physical Review E 72, 2 (2005), 026132.
[11]
Michele Coscia, Giulio Rossetti, Fosca Giannotti, and Dino Pedreschi. 2012. Demon: A local-first discovery method for overlapping communities. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 615–623.
[12]
Ganqu Cui, Jie Zhou, Cheng Yang, and Zhiyuan Liu. 2020. Adaptive graph encoder for attributed graph embedding. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 976–985.
[13]
Daizong Ding, Mi Zhang, Hanrui Wang, Xudong Pan, Min Yang, and Xiangnan He. 2021. A deep learning framework for self-evolving hierarchical community detection. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management. 372–381.
[14]
Santo Fortunato. 2010. Community detection in graphs. Physics Reports 486, 3–5 (2010), 75–174.
[15]
Xinyu Fu, Jiani Zhang, Ziqiao Meng, and Irwin King. 2020. Magnn: Metapath aggregated graph neural network for heterogeneous graph embedding. In Proceedings of the Web Conference. 2331–2341.
[16]
Chenxu Gong, Guoyin Wang, Jun Hu, Ming Liu, Li Liu, and Zihe Yang. 2018. Finding multi-granularity community structures in social networks based on significance of community partition. In Proceedings of the IEEE International Conference on Data Mining Workshops. 415–421.
[17]
Kun He, Yingru Li, Sucheta Soundarajan, and John E. Hopcroft. 2018. Hidden community detection in social networks. Information Sciences 425 (2018), 92–106.
[18]
Kun He, Pan Shi, David Bindel, and John E. Hopcroft. 2019. Krylov subspace approximation for local community detection in large networks. ACM Transactions on Knowledge Discovery from Data 13, 5 (2019), 1–30.
[19]
Kun He, Sucheta Soundarajan, Xuezhi Cao, John Hopcroft, and Menglong Huang. 2015. Revealing multiple layers of hidden community structure in networks. arXiv:1501.05700. Retrieved from https://arxiv.org/abs/1501.05700.
[20]
Kun He, Yiwei Sun, David Bindel, John Hopcroft, and Yixuan Li. 2015. Detecting overlapping communities from local spectral subspaces. In Proceedings of the IEEE International Conference on Data Mining. 769–774.
[21]
Xinyu Huang, Dongming Chen, Tao Ren, and Dongqi Wang. 2021. A survey of community detection methods in multilayer networks. Data Mining and Knowledge Discovery 35, 1 (2021), 1–45.
[22]
Roberto Interdonato, Andrea Tagarelli, Dino Ienco, Arnaud Sallaberry, and Pascal Poncelet. 2017. Local community detection in multilayer networks. Data Mining and Knowledge Discovery 31, 5 (2017), 1444–1479.
[23]
Yuting Jia, Qinqin Zhang, Weinan Zhang, and Xinbing Wang. 2019. Communitygan: Community detection with generative adversarial nets. In Proceedings of the World Wide Web Conference. 784–794.
[24]
Di Jin, Bingyi Li, Pengfei Jiao, Dongxiao He, Hongyu Shan, and Weixiong Zhang. 2020. Modeling with node popularities for autonomous overlapping community detection. ACM Transactions on Intelligent Systems and Technology 11, 3 (2020), 1–23.
[25]
Di Jin, Hongcui Wang, Jianwu Dang, Dongxiao He, and Weixiong Zhang. 2016. Detect overlapping communities via ranking node popularities. In Proceedings of the AAAI Conference on Artificial Intelligence. 172–178.
[26]
Di Jin, Bo Yang, Carlos Baquero, Dayou Liu, Dongxiao He, and Jie Liu. 2011. A Markov random walk under constraint for discovering overlapping communities in complex networks. Journal of Statistical Mechanics: Theory and Experiment5 (2011), P05031.
[27]
Di Jin, Zhizhi Yu, Pengfei Jiao, Shirui Pan, Dongxiao He, Jia Wu, Philip Yu, and Weixiong Zhang. 2021. A survey of community detection approaches: From statistical modeling to deep learning. IEEE Transactions on Knowledge and Data Engineering (2021). DOI:
[28]
Dany Kamuhanda, Meng Wang, and Kun He. 2020. Sparse nonnegative matrix factorization for multiple-local-community detection. IEEE Transactions on Computational Social Systems 7, 5 (2020), 1220–1233.
[29]
Mikko Kivelä, Alex Arenas, Marc Barthelemy, James P. Gleeson, Yamir Moreno, and Mason A. Porter. 2014. Multilayer networks. Journal of Complex Networks 2, 3 (2014), 203–271.
[30]
Kyle Kloster and David F. Gleich. 2014. Heat kernel based community detection. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1386–1395.
[31]
Andrea Lancichinetti, Santo Fortunato, and János Kertész. 2009. Detecting the overlapping and hierarchical community structure in complex networks. New Journal of Physics 11, 3 (2009), 033015.
[32]
Andrea Lancichinetti, Santo Fortunato, and Filippo Radicchi. 2008. Benchmark graphs for testing community detection algorithms. Physical Review E 78, 4 (2008), 046110.
[33]
Andrea Lancichinetti, Filippo Radicchi, José J. Ramasco, and Santo Fortunato. 2011. Finding statistically significant communities in networks. PloS One 6, 4 (2011), e18961.
[34]
Yixuan Li, Kun He, David Bindel, and John E. Hopcroft. 2015. Uncovering the small community structure in large networks: A local spectral approach. In Proceedings of the 24th International Conference on World Wide Web. 658–668.
[35]
Qingqing Long, Yiming Wang, Lun Du, Guojie Song, Yilun Jin, and Wei Lin. 2019. Hierarchical community structure preserving network embedding: A subspace approach. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 409–418.
[36]
Wenjian Luo, Nannan Lu, Li Ni, Wenjie Zhu, and Weiping Ding. 2020. Local community detection by the nearest nodes with greater centrality. Information Sciences 517 (2020), 377–392.
[37]
Michael W. Mahoney, Lorenzo Orecchia, and Nisheeth K. Vishnoi. 2012. A local spectral method for graphs: With applications to improving graph partitions and exploring data graphs locally. The Journal of Machine Learning Research 13, 1 (2012), 2339–2365.
[38]
Alan Mislove, Bimal Viswanath, Krishna P. Gummadi, and Peter Druschel. 2010. You are who you know: Inferring user profiles in online social networks. In Proceedings of the 3rd ACM International Conference on Web Search and Data Mining. 251–260.
[39]
Mark E. J. Newman and Michelle Girvan. 2004. Finding and evaluating community structure in networks. Physical Review E 69, 2 (2004), 026113.
[40]
Li Ni, Wenjian Luo, Wenjie Zhu, and Bei Hua. 2019. Local overlapping community detection. ACM Transactions on Knowledge Discovery from Data 14, 1 (2019), 1–25.
[41]
Pascal Pons and Matthieu Latapy. 2005. Computing communities in large networks using random walks. In Proceedings of the International Symposium on Computer and Information Sciences. Springer, 284–293.
[42]
Martin Rosvall and Carl T. Bergstrom. 2008. Maps of random walks on complex networks reveal community structure. Proceedings of the National Academy of Sciences 105, 4 (2008), 1118–1123.
[43]
Huawei Shen, Xueqi Cheng, Kai Cai, and Mao-Bin Hu. 2009. Detect overlapping and hierarchical community structure in networks. Physica A: Statistical Mechanics and its Applications 388, 8 (2009), 1706–1712.
[44]
Jianbo Shi and Jitendra Malik. 2000. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 8 (2000), 888–905.
[45]
Xing Su, Shan Xue, Fanzhen Liu, Jia Wu, Jian Yang, Chuan Zhou, Wenbin Hu, Cécile Paris, Surya Nepal, Di Jin, Quan Z. Sheng, and Philip S. Yu. 2022. A comprehensive survey on community detection with deep learning. IEEE Transactions on Neural Networks and Learning Systems (2022). DOI:
[46]
Yansen Su, Kefei Zhou, Xingyi Zhang, Ran Cheng, and Chunhou Zheng. 2021. A parallel multi-objective evolutionary algorithm for community detection in large-scale complex networks. Information Sciences 576 (2021), 374–392.
[47]
Lei Tang, Xufei Wang, and Huan Liu. 2009. Uncovering groups via heterogeneous interaction analysis. In Proceedings of the 9th IEEE International Conference on Data Mining. 503–512.
[48]
Fei Tian, Bin Gao, Qing Cui, Enhong Chen, and Tie-Yan Liu. 2014. Learning deep representations for graph clustering. In Proceedings of the AAAI Conference on Artificial Intelligence. 1293–1299.
[49]
Amanda L. Traud, Peter J. Mucha, and Mason A. Porter. 2012. Social structure of Facebook networks. Physica A: Statistical Mechanics and its Applications 391, 16 (2012), 4165–4180.
[50]
Xiao Wang, Nian Liu, Hui Han, and Chuan Shi. 2021. Self-supervised heterogeneous graph neural network with co-contrastive learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1726–1736.
[51]
Xin Xin, Chaokun Wang, Xiang Ying, and Boyang Wang. 2017. Deep community detection in topologically incomplete networks. Physica A: Statistical Mechanics and its Applications 469 (2017), 342–352.
[52]
Jaewon Yang and Jure Leskovec. 2015. Defining and evaluating network communities based on ground-truth. Knowledge and Information Systems 42, 1 (2015), 181–213.
[53]
Ying Yin, Yuhai Zhao, He Li, and Xiangjun Dong. 2021. Multi-objective evolutionary clustering for large-scale dynamic community detection. Information Sciences 549 (2021), 269–287.
[54]
Jean-Gabriel Young, Antoine Allard, Laurent Hébert-Dufresne, and Louis J. Dubé. 2015. A shadowing problem in the detection of overlapping communities: Lifting the resolution limit through a cascading procedure. PloS One 10, 10 (2015), e0140133.
[55]
Xiaotong Zhang, Han Liu, Qimai Li, and Xiao-Ming Wu. 2019. Attributed graph clustering via adaptive graph convolution. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. 4327–4333.
[56]
Yao Zhang, Yun Xiong, Yun Ye, Tengfei Liu, Weiqiang Wang, Yangyong Zhu, and Philip S. Yu. 2020. SEAL: Learning heuristics for community detection with generative adversarial networks. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1103–1113.

Cited By

View all
  • (2024)CoBjeason: Reasoning Covered Object in Image by Multi-Agent Collaboration Based on Informed Knowledge GraphACM Transactions on Knowledge Discovery from Data10.1145/364356518:5(1-56)Online publication date: 28-Feb-2024
  • (2024)Credit Card Fraud Detection via Intelligent Sampling and Self-supervised LearningACM Transactions on Intelligent Systems and Technology10.1145/364128315:2(1-29)Online publication date: 28-Mar-2024
  • (2024)Relevance Feedback with Brain SignalsACM Transactions on Information Systems10.1145/363787442:4(1-37)Online publication date: 9-Feb-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Knowledge Discovery from Data
ACM Transactions on Knowledge Discovery from Data  Volume 17, Issue 5
June 2023
386 pages
ISSN:1556-4681
EISSN:1556-472X
DOI:10.1145/3583066
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 February 2023
Online AM: 17 October 2022
Accepted: 27 September 2022
Revised: 12 August 2022
Received: 03 December 2021
Published in TKDD Volume 17, Issue 5

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Social networks
  2. local community detection
  3. hidden community
  4. local modularity

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)150
  • Downloads (Last 6 weeks)11
Reflects downloads up to 14 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)CoBjeason: Reasoning Covered Object in Image by Multi-Agent Collaboration Based on Informed Knowledge GraphACM Transactions on Knowledge Discovery from Data10.1145/364356518:5(1-56)Online publication date: 28-Feb-2024
  • (2024)Credit Card Fraud Detection via Intelligent Sampling and Self-supervised LearningACM Transactions on Intelligent Systems and Technology10.1145/364128315:2(1-29)Online publication date: 28-Mar-2024
  • (2024)Relevance Feedback with Brain SignalsACM Transactions on Information Systems10.1145/363787442:4(1-37)Online publication date: 9-Feb-2024
  • (2024)Evolving Knowledge Graph Representation Learning with Multiple Attention Strategies for Citation Recommendation SystemACM Transactions on Intelligent Systems and Technology10.1145/363527315:2(1-26)Online publication date: 28-Mar-2024
  • (2023)Multi-aspect Graph Contrastive Learning for Review-enhanced RecommendationACM Transactions on Information Systems10.1145/361810642:2(1-29)Online publication date: 8-Nov-2023
  • (2023)Reinforced PU-learning with Hybrid Negative Sampling Strategies for RecommendationACM Transactions on Intelligent Systems and Technology10.1145/358256214:3(1-25)Online publication date: 8-May-2023
  • (2023)Learn to be Fair without Labels: A Distribution-based Learning Framework for Fair RankingProceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3578337.3605132(23-32)Online publication date: 9-Aug-2023
  • (2023)Generative Relevance Feedback with Large Language ModelsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591992(2026-2031)Online publication date: 19-Jul-2023
  • (2023)Augmenting Passage Representations with Query Generation for Enhanced Cross-Lingual Dense RetrievalProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591952(1827-1832)Online publication date: 19-Jul-2023
  • (2023)Multi-view subspace clustering for learning joint representation via low-rank sparse representationApplied Intelligence10.1007/s10489-023-04716-z53:19(22511-22530)Online publication date: 29-Jun-2023
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media