Statistics > Computation
[Submitted on 12 Mar 2022]
Title:Distributed Community Detection in Large Networks
View PDFAbstract:Community detection for large networks is a challenging task due to the high computational cost as well as the heterogeneous community structure. Stochastic block model (SBM) is a popular model to analyze community structure where nodes belonging to the same communities are connected with equal probability. Modularity optimization methods provide a fast and effective way for community detection under SBM with assortative community structure, where nodes within communities are densely connected and nodes across communities are relatively loosely connected. However, the non-assortative community structure, where nodes across communities are densely connected, widely exists in real-world networks, thus leading to the inconsistency of modularity optimization methods in applications. In this paper, we consider networks with "grouped communities" (or "the group structure"), where nodes within grouped communities are densely connected and nodes across grouped communities are relatively loosely connected, while nodes belonging to the same group but different communities can be either densely or loosely connected. We incorporate the group structure in the SBM and propose a novel divide-and-conquer algorithm to detect the community structure. We show that the proposed method can recover both the group structure and the community structure asymptotically. Numerical studies demonstrate that the proposed method can reduce the computational cost significantly while still achieving competitive performance. Further, we extend the proposed framework from the SBM to the degree-corrected SBM for more general applications.
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.