-
TF-GNN: Graph Neural Networks in TensorFlow
Authors:
Oleksandr Ferludin,
Arno Eigenwillig,
Martin Blais,
Dustin Zelle,
Jan Pfeifer,
Alvaro Sanchez-Gonzalez,
Wai Lok Sibon Li,
Sami Abu-El-Haija,
Peter Battaglia,
Neslihan Bulut,
Jonathan Halcrow,
Filipe Miguel Gonçalves de Almeida,
Pedro Gonnet,
Liangze Jiang,
Parth Kothari,
Silvio Lattanzi,
André Linhares,
Brandon Mayer,
Vahab Mirrokni,
John Palowitch,
Mihir Paradkar,
Jennifer She,
Anton Tsitsulin,
Kevin Villela,
Lisa Wang
, et al. (2 additional authors not shown)
Abstract:
TensorFlow-GNN (TF-GNN) is a scalable library for Graph Neural Networks in TensorFlow. It is designed from the bottom up to support the kinds of rich heterogeneous graph data that occurs in today's information ecosystems. In addition to enabling machine learning researchers and advanced developers, TF-GNN offers low-code solutions to empower the broader developer community in graph learning. Many…
▽ More
TensorFlow-GNN (TF-GNN) is a scalable library for Graph Neural Networks in TensorFlow. It is designed from the bottom up to support the kinds of rich heterogeneous graph data that occurs in today's information ecosystems. In addition to enabling machine learning researchers and advanced developers, TF-GNN offers low-code solutions to empower the broader developer community in graph learning. Many production models at Google use TF-GNN, and it has been recently released as an open source project. In this paper we describe the TF-GNN data model, its Keras message passing API, and relevant capabilities such as graph sampling and distributed training.
△ Less
Submitted 23 July, 2023; v1 submitted 7 July, 2022;
originally announced July 2022.
-
Streaming Belief Propagation for Community Detection
Authors:
Yuchen Wu,
MohammadHossein Bateni,
Andre Linhares,
Filipe Miguel Goncalves de Almeida,
Andrea Montanari,
Ashkan Norouzi-Fard,
Jakab Tardos
Abstract:
The community detection problem requires to cluster the nodes of a network into a small number of well-connected "communities". There has been substantial recent progress in characterizing the fundamental statistical limits of community detection under simple stochastic block models. However, in real-world applications, the network structure is typically dynamic, with nodes that join over time. In…
▽ More
The community detection problem requires to cluster the nodes of a network into a small number of well-connected "communities". There has been substantial recent progress in characterizing the fundamental statistical limits of community detection under simple stochastic block models. However, in real-world applications, the network structure is typically dynamic, with nodes that join over time. In this setting, we would like a detection algorithm to perform only a limited number of updates at each node arrival. While standard voting approaches satisfy this constraint, it is unclear whether they exploit the network information optimally. We introduce a simple model for networks growing over time which we refer to as streaming stochastic block model (StSBM). Within this model, we prove that voting algorithms have fundamental limitations. We also develop a streaming belief-propagation (StreamBP) approach, for which we prove optimality in certain regimes. We validate our theoretical findings on synthetic and real data.
△ Less
Submitted 10 June, 2021; v1 submitted 9 June, 2021;
originally announced June 2021.
-
InstantEmbedding: Efficient Local Node Representations
Authors:
Ştefan Postăvaru,
Anton Tsitsulin,
Filipe Miguel Gonçalves de Almeida,
Yingtao Tian,
Silvio Lattanzi,
Bryan Perozzi
Abstract:
In this paper, we introduce InstantEmbedding, an efficient method for generating single-node representations using local PageRank computations. We theoretically prove that our approach produces globally consistent representations in sublinear time. We demonstrate this empirically by conducting extensive experiments on real-world datasets with over a billion edges. Our experiments confirm that Inst…
▽ More
In this paper, we introduce InstantEmbedding, an efficient method for generating single-node representations using local PageRank computations. We theoretically prove that our approach produces globally consistent representations in sublinear time. We demonstrate this empirically by conducting extensive experiments on real-world datasets with over a billion edges. Our experiments confirm that InstantEmbedding requires drastically less computation time (over 9,000 times faster) and less memory (by over 8,000 times) to produce a single node's embedding than traditional methods including DeepWalk, node2vec, VERSE, and FastRP. We also show that our method produces high quality representations, demonstrating results that meet or exceed the state of the art for unsupervised representation learning on tasks like node classification and link prediction.
△ Less
Submitted 14 October, 2020;
originally announced October 2020.
