Scalable and exact sampling method for probabilistic generative graph models

Sebastian Moreno, Joseph J. Pfeiffer, Jennifer Neville

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Interest in modeling complex networks has fueled the development of multiple probabilistic generative graph models (PGGMs). PGGMs are statistical methods that model the network distribution and match common characteristics of real world networks. Recently, scalable sampling algorithms for well known PGGMs, made the analysis of large-scale, sparse networks feasible for the first time. However, it has been demonstrated that these scalable sampling algorithms do not sample from the original underlying distribution, and sometimes produce very unlikely graphs. To address this, we extend the algorithm proposed in Moreno et al. (in: IEEE 14th international conference on data mining, pp 440–449, 2014) for a single model and develop a general solution for a broad class of PGGMs. Our approach exploits the fact that PGGMs are typically parameterized by a small set of unique probability values—this enables fast generation via independent sampling of groups of edges with the same probability value. By sampling within groups, we remove bias due to conditional sampling and probability reallocation. We show that our grouped sampling methods are both provably correct and efficient. Our new algorithm reduces time complexity by avoiding the expensive rejection sampling step previously necessary, and we demonstrate its generality, by outlining implementations for six different PGGMs. We conduct theoretical analysis and empirical evaluation to demonstrate the strengths of our algorithms. We conclude by sampling a network with over a billion edges in 95 s on a single processor.

Original languageEnglish
Pages (from-to)1561-1596
Number of pages36
JournalData Mining and Knowledge Discovery
Volume32
Issue number6
DOIs
StatePublished - 1 Nov 2018
Externally publishedYes

Keywords

  • Graph generation
  • Network analysis
  • Network models
  • Scalable sampling
  • Social networks

Fingerprint

Dive into the research topics of 'Scalable and exact sampling method for probabilistic generative graph models'. Together they form a unique fingerprint.

Cite this