Showing 1–15 of 15 results for author: Leskelä, L

Information divergences and likelihood ratios of Poisson processes and point patterns

Authors: Lasse Leskelä

Abstract: This article develops an analytical framework for studying information divergences and likelihood ratios associated with Poisson processes and point patterns on general measurable spaces. The main results include explicit analytical formulas for Kullback-Leibler divergences, Rényi divergences, Hellinger distances, and likelihood ratios of the laws of Poisson point patterns in terms of their intens… ▽ More This article develops an analytical framework for studying information divergences and likelihood ratios associated with Poisson processes and point patterns on general measurable spaces. The main results include explicit analytical formulas for Kullback-Leibler divergences, Rényi divergences, Hellinger distances, and likelihood ratios of the laws of Poisson point patterns in terms of their intensity measures. The general results yield similar formulas for inhomogeneous Poisson processes, compound Poisson processes, as well as spatial and marked Poisson point patterns. Additional results include simple characterisations of absolute continuity, mutual singularity, and the existence of common dominating measures. The analytical toolbox is based on Tsallis divergences of sigma-finite measures on abstract measurable spaces. The treatment is purely information-theoretic and free of any topological assumptions. △ Less

Submitted 30 March, 2024; originally announced April 2024.

Comments: 48 pages

MSC Class: 62B10; 60G55; 94A17

Spatial Queues with Nearest Neighbour Shifts

Authors: B. R. Vinay Kumar, Lasse Leskelä

Abstract: In this work we study multi-server queues on a Euclidean space. Consider $N$ servers that are distributed uniformly in $[0,1]^d$. Customers (users) arrive at the servers according to independent Poisson processes of intensity $λ$. However, they probabilistically decide whether to join the queue they arrived at, or move to one of the nearest neighbours. The strategy followed by the customers affect… ▽ More In this work we study multi-server queues on a Euclidean space. Consider $N$ servers that are distributed uniformly in $[0,1]^d$. Customers (users) arrive at the servers according to independent Poisson processes of intensity $λ$. However, they probabilistically decide whether to join the queue they arrived at, or move to one of the nearest neighbours. The strategy followed by the customers affects the load on the servers in the long run. In this paper, we are interested in characterizing the fraction of servers that bear a larger load as compared to when the users do not follow any strategy, i.e., they join the queue they arrive at. These are called overloaded servers. In the one-dimensional case ($d=1$), we evaluate the expected fraction of overloaded servers for any finite $N$ when the users follow probabilistic nearest neighbour shift strategies. Additionally, for servers distributed in a $d$-dimensional space we provide expressions for the fraction of overloaded servers in the system as the total number of servers $N\rightarrow \infty$. Numerical experiments are provided to support our claims. Typical applications of our results include electric vehicles queueing at charging stations, and queues in airports or supermarkets. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Comments: A part of this work was accepted to the conference International Teletraffic Congress (ITC 35) held between 3--5 October 2023 in Turin, Italy

MSC Class: 60K30; 05C80

Multilayer hypergraph clustering using the aggregate similarity matrix

Authors: Kalle Alaluusua, Konstantin Avrachenkov, B. R. Vinay Kumar, Lasse Leskelä

Abstract: We consider the community recovery problem on a multilayer variant of the hypergraph stochastic block model (HSBM). Each layer is associated with an independent realization of a d-uniform HSBM on N vertices. Given the similarity matrix containing the aggregated number of hyperedges incident to each pair of vertices, the goal is to obtain a partition of the N vertices into disjoint communities. In… ▽ More We consider the community recovery problem on a multilayer variant of the hypergraph stochastic block model (HSBM). Each layer is associated with an independent realization of a d-uniform HSBM on N vertices. Given the similarity matrix containing the aggregated number of hyperedges incident to each pair of vertices, the goal is to obtain a partition of the N vertices into disjoint communities. In this work, we investigate a semidefinite programming (SDP) approach and obtain information-theoretic conditions on the model parameters that guarantee exact recovery both in the assortative and the disassortative cases. △ Less

Submitted 3 November, 2023; v1 submitted 27 January, 2023; originally announced January 2023.

Comments: 16 pages, 3 tables. Reason for replacement on 3 Nov 2023: incorporating the possibility of non-uniform layers. Reason for replacement on 18 May 2023: improving clarity of the presentation and clarifying the contribution/novelty of the paper

MSC Class: 05C65; 05C80; 62H30; 90B15; 90C22; 90C35; 94A16

Journal ref: In: Dewar, M., Prałat, P., Szufel, P., Théberge, F., Wrzosek, M. (eds) Algorithms and Models for the Web Graph. WAW 2023. Lecture Notes in Computer Science, vol 13894. Springer, Cham. pp. 83-98

Normal and stable approximation to subgraph counts in superpositions of Bernoulli random graphs

Authors: Mindaugas Bloznelis, Joona Karjalainen, Lasse Leskelä

Abstract: The clustering property of complex networks indicates the abundance of small dense subgraphs in otherwise sparse networks. For a community-affiliation network defined by a superposition of Bernoulli random graphs, which has a nonvanishing global clustering coefficient and a power-law degree distribution, we establish normal and $α$--stable approximations to the number of small cliques, cycles an… ▽ More The clustering property of complex networks indicates the abundance of small dense subgraphs in otherwise sparse networks. For a community-affiliation network defined by a superposition of Bernoulli random graphs, which has a nonvanishing global clustering coefficient and a power-law degree distribution, we establish normal and $α$--stable approximations to the number of small cliques, cycles and more general $2$-connected subgraphs. △ Less

Submitted 13 March, 2022; v1 submitted 6 July, 2021; originally announced July 2021.

MSC Class: 60F05; 05C82; 91D30

Journal ref: J. Appl. Probab. 61 (2024) 401-419

Community recovery in non-binary and temporal stochastic block models

Authors: Konstantin Avrachenkov, Maximilien Dreveton, Lasse Leskelä

Abstract: This article studies the estimation of latent community memberships from pairwise interactions in a network of $N$ nodes, where the observed interactions can be of arbitrary type, including binary, categorical, and vector-valued, and not excluding even more general objects such as time series or spatial point patterns. As a generative model for such data, we introduce a stochastic block model with… ▽ More This article studies the estimation of latent community memberships from pairwise interactions in a network of $N$ nodes, where the observed interactions can be of arbitrary type, including binary, categorical, and vector-valued, and not excluding even more general objects such as time series or spatial point patterns. As a generative model for such data, we introduce a stochastic block model with a general measurable interaction space $\mathcal S$, for which we derive information-theoretic bounds for the minimum achievable error rate. These bounds yield sharp criteria for the existence of consistent and strongly consistent estimators in terms of data sparsity, statistical similarity between intra- and inter-block interaction distributions, and the shape and size of the interaction space. The general framework makes it possible to study temporal and multiplex networks with $\mathcal S = \{0,1\}^T$, in settings where both $N \to \infty$ and $T \to \infty$, and the temporal interaction patterns are correlated over time. For temporal Markov interactions, we derive sharp consistency thresholds. We also present fast online estimation algorithms which fully utilise the non-binary nature of the observed data. Numerical experiments on synthetic and real data show that these algorithms rapidly produce accurate estimates even for very sparse data arrays. △ Less

Submitted 30 August, 2022; v1 submitted 11 August, 2020; originally announced August 2020.

MSC Class: 62H30; 60J10; 90B15; 91D30

Towards analyzing large graphs with quantum annealing and quantum gate computers

Authors: Hannu Reittu, Ville Kotovirta, Lasse Leskelä, Hannu Rummukainen, Tomi Räty

Abstract: The use of quantum computing in graph community detection and regularity checking related to Szemeredi's Regularity Lemma (SRL) are demonstrated with D-Wave Systems' quantum annealer and simulations. We demonstrate the capability of quantum computing in solving hard problems relevant to big data. A new community detection algorithm based on SRL is also introduced and tested. In worst case scenario… ▽ More The use of quantum computing in graph community detection and regularity checking related to Szemeredi's Regularity Lemma (SRL) are demonstrated with D-Wave Systems' quantum annealer and simulations. We demonstrate the capability of quantum computing in solving hard problems relevant to big data. A new community detection algorithm based on SRL is also introduced and tested. In worst case scenario of regularity check we use Grover's algorithm and quantum phase estimation algorithm, in order to speed-up computations using a quantum gate computers. △ Less

Submitted 30 June, 2020; originally announced June 2020.

Comments: Extended version of a conference paper, IEEE BigData 2019, Los Angeles U.S.A. International Journal of Data Mining Science (IJDAT), 2020

ACM Class: I.5

Assortativity and bidegree distributions on Bernoulli random graph superpositions

Authors: Mindaugas Bloznelis, Joona Karjalainen, Lasse Leskelä

Abstract: A probabilistic generative network model with $n$ nodes and $m$ overlap** layers is obtained as a superposition of $m$ mutually independent Bernoulli random graphs of varying size and strength. When $n$ and $m$ are large and of the same order of magnitude, the model admits a sparse limiting regime with a tunable power-law degree distribution and nonvanishing clustering coefficient. In this artic… ▽ More A probabilistic generative network model with $n$ nodes and $m$ overlap** layers is obtained as a superposition of $m$ mutually independent Bernoulli random graphs of varying size and strength. When $n$ and $m$ are large and of the same order of magnitude, the model admits a sparse limiting regime with a tunable power-law degree distribution and nonvanishing clustering coefficient. In this article we prove an asymptotic formula for the joint degree distribution of adjacent nodes. This yields a simple analytical formula for the model assortativity, and opens up ways to analyze rank correlation coefficients suitable for random graphs with heavy-tailed degree distributions. We also study the effects of power laws on the asymptotic joint degree distributions. △ Less

Submitted 31 May, 2021; v1 submitted 26 February, 2020; originally announced February 2020.

Comments: 32 pages

MSC Class: 60C05; 60B10; 91D30; 62G35 ACM Class: G.3; J.4; G.2.2

Clique and cycle frequencies in a sparse random graph model with overlap** communities

Authors: Tommi Gröhn, Joona Karjalainen, Lasse Leskelä

Abstract: A statistical network model with overlap** communities can be generated as a superposition of mutually independent random graphs of varying size. The model is parameterized by a number of nodes, number of communities, distribution of community sizes, and the edge probability inside the communities. This model admits sparse parameter regimes with power-law limiting degree distributions, and nonva… ▽ More A statistical network model with overlap** communities can be generated as a superposition of mutually independent random graphs of varying size. The model is parameterized by a number of nodes, number of communities, distribution of community sizes, and the edge probability inside the communities. This model admits sparse parameter regimes with power-law limiting degree distributions, and nonvanishing clustering coefficient. This article presents large-scale approximations of clique and cycle frequencies for graph samples generated by this model, which are valid for regimes with bounded and unbounded number of overlap** communities. Our results reveal the growth rates of these subgraph frequencies and show that their theoretical densities can be reliably estimated from data. △ Less

Submitted 13 May, 2021; v1 submitted 28 November, 2019; originally announced November 2019.

Comments: 23 pages

MSC Class: 62F10; 05C80; 60C05

Analysis of large sparse graphs using regular decomposition of graph distance matrices

Authors: Hannu Reittu, Lasse Leskelä, Tomi Räty, Marco Fiorucci

Abstract: Statistical analysis of large and sparse graphs is a challenging problem in data science due to the high dimensionality and nonlinearity of the problem. This paper presents a fast and scalable algorithm for partitioning such graphs into disjoint groups based on observed graph distances from a set of reference nodes. The resulting partition provides a low-dimensional approximation of the full dista… ▽ More Statistical analysis of large and sparse graphs is a challenging problem in data science due to the high dimensionality and nonlinearity of the problem. This paper presents a fast and scalable algorithm for partitioning such graphs into disjoint groups based on observed graph distances from a set of reference nodes. The resulting partition provides a low-dimensional approximation of the full distance matrix which helps to reveal global structural properties of the graph using only small samples of the distance matrix. The presented algorithm is inspired by the information-theoretic minimum description principle. We investigate the performance of this algorithm for selected real data sets and for synthetic graph data sets generated using stochastic block models and power-law random graphs, together with analytical considerations for sparse stochastic block models with bounded average degrees. △ Less

Submitted 21 December, 2018; v1 submitted 26 November, 2018; originally announced November 2018.

Comments: IEEE BigData 2018 Conference Workshop, Advances in High Dimensional Big Data, 10.-13.12. 2018, Seattle USA

Parameter estimators of random intersection graphs with thinned communities

Authors: Joona Karjalainen, Johan S. H. van Leeuwaarden, Lasse Leskelä

Abstract: This paper studies a statistical network model generated by a large number of randomly sized overlap** communities, where any pair of nodes sharing a community is linked with probability $q$ via the community. In the special case with $q=1$ the model reduces to a random intersection graph which is known to generate high levels of transitivity also in the sparse context. The parameter $q$ adds a… ▽ More This paper studies a statistical network model generated by a large number of randomly sized overlap** communities, where any pair of nodes sharing a community is linked with probability $q$ via the community. In the special case with $q=1$ the model reduces to a random intersection graph which is known to generate high levels of transitivity also in the sparse context. The parameter $q$ adds a degree of freedom and leads to a parsimonious and analytically tractable network model with tunable density, transitivity, and degree fluctuations. We prove that the parameters of this model can be consistently estimated in the large and sparse limiting regime using moment estimators based on partially observed densities of links, 2-stars, and triangles. △ Less

Submitted 24 June, 2018; v1 submitted 4 February, 2018; originally announced February 2018.

Comments: 15 pages

MSC Class: 62F10; 05C80; 60C05

Moment-based parameter estimation in binomial random intersection graph models

Authors: Joona Karjalainen, Lasse Leskelä

Abstract: Binomial random intersection graphs can be used as parsimonious statistical models of large and sparse networks, with one parameter for the average degree and another for transitivity, the tendency of neighbours of a node to be connected. This paper discusses the estimation of these parameters from a single observed instance of the graph, using moment estimators based on observed degrees and frequ… ▽ More Binomial random intersection graphs can be used as parsimonious statistical models of large and sparse networks, with one parameter for the average degree and another for transitivity, the tendency of neighbours of a node to be connected. This paper discusses the estimation of these parameters from a single observed instance of the graph, using moment estimators based on observed degrees and frequencies of 2-stars and triangles. The observed data set is assumed to be a subgraph induced by a set of $n_0$ nodes sampled from the full set of $n$ nodes. We prove the consistency of the proposed estimators by showing that the relative estimation error is small with high probability for $n_0 \gg n^{2/3} \gg 1$. As a byproduct, our analysis confirms that the empirical transitivity coefficient of the graph is with high probability close to the theoretical clustering coefficient of the model. △ Less

Submitted 24 June, 2018; v1 submitted 13 April, 2017; originally announced April 2017.

Comments: 15 pages, 6 figures

MSC Class: 62F12; 05C80

Diclique clustering in a directed random graph

Authors: Mindaugas Bloznelis, Lasse Leskelä

Abstract: We discuss a notion of clustering for directed graphs, which describes how likely two followers of a node are to follow a common target. The associated network motifs, called dicliques or bi-fans, have been found to be key structural components in various real-world networks. We introduce a two-mode statistical network model consisting of actors and auxiliary attributes, where an actor i decides t… ▽ More We discuss a notion of clustering for directed graphs, which describes how likely two followers of a node are to follow a common target. The associated network motifs, called dicliques or bi-fans, have been found to be key structural components in various real-world networks. We introduce a two-mode statistical network model consisting of actors and auxiliary attributes, where an actor i decides to follow an actor j whenever i demands an attribute supplied by j. We show that the digraph admits nontrivial clustering properties of the aforementioned type, as well as power-law indegree and outdegree distributions. △ Less

Submitted 8 July, 2016; originally announced July 2016.

Comments: 12 pages, 2 figures

MSC Class: 91D30; 60E15 ACM Class: J.4; G.3; G.2.2

The impact of degree variability on connectivity properties of large networks

Authors: Lasse Leskelä, Hoa Ngo

Abstract: The goal of is to study how increased variability in the degree distribution impacts the global connectivity properties of a large network. We approach this question by modeling the network as a uniform random graph with a given degree sequence. We analyze the effect of the degree variability on the approximate size of the largest connected component using stochastic ordering techniques. A counter… ▽ More The goal of is to study how increased variability in the degree distribution impacts the global connectivity properties of a large network. We approach this question by modeling the network as a uniform random graph with a given degree sequence. We analyze the effect of the degree variability on the approximate size of the largest connected component using stochastic ordering techniques. A counterexample shows that a higher degree variability may lead to a larger connected component, contrary to basic intuition about branching processes. When certain extremal cases are ruled out, the higher degree variability is shown to decrease the limiting approximate size of the largest connected component. △ Less

Submitted 13 January, 2017; v1 submitted 13 August, 2015; originally announced August 2015.

Comments: Extended version of WAW'15 conference article

MSC Class: 91D30; 60E15 ACM Class: J.4; G.3; G.2.2

Journal ref: Internet Mathematics 13 (2017) 1-24

Information spreading in a large population of active transmitters and passive receivers

Authors: Pekka Aalto, Lasse Leskelä

Abstract: This paper discusses a simple stochastic model for the spread of messages in a large population with two types of individuals: transmitters and receivers. Transmitters, after receiving the message, start spreading copies of the message to their neighbors. Receivers may receive the message, but will never spread it further. We derive approximations of the broadcast time and the first passage times… ▽ More This paper discusses a simple stochastic model for the spread of messages in a large population with two types of individuals: transmitters and receivers. Transmitters, after receiving the message, start spreading copies of the message to their neighbors. Receivers may receive the message, but will never spread it further. We derive approximations of the broadcast time and the first passage times of selected individuals in populations of size tending to infinity. These approximations explain how much the fact that only a fraction of the individuals are transmitters slows down the propagation of information. Our results also sharply characterize the statistical dependence structure of first passage times using Gumbel and logistic distributions of extreme value statistics. △ Less

Submitted 28 June, 2015; v1 submitted 23 December, 2014; originally announced December 2014.

Comments: 22 pages

MSC Class: 60K35; 91D30; 92D25

Journal ref: SIAM Journal on Applied Mathematics 75 (2015) 1965-1982

Interacting branching processes and linear file-sharing networks

Authors: L. Leskelä, Philippe Robert, Florian Simatos

Abstract: File-sharing networks are distributed systems used to disseminate files among nodes of a communication network. The general simple principle of these systems is that once a node has retrieved a file, it may become a server for this file. In this paper, the capacity of these networks is analyzed with a stochastic model when there is a constant flow of incoming requests for a given file.… ▽ More File-sharing networks are distributed systems used to disseminate files among nodes of a communication network. The general simple principle of these systems is that once a node has retrieved a file, it may become a server for this file. In this paper, the capacity of these networks is analyzed with a stochastic model when there is a constant flow of incoming requests for a given file. It is shown that the problem can be solved by analyzing the asymptotic behavior of a class of interacting branching processes. Several results of independent interest concerning these branching processes are derived and then used to study the file-sharing systems. △ Less

Submitted 22 April, 2010; v1 submitted 2 July, 2009; originally announced July 2009.

Journal ref: Advances in Applied Probability, 42(3), 2010