Showing 1–16 of 16 results for author: Krivitsky, P N

Rejoinder to Discussion of "A Tale of Two Datasets: Representativeness and Generalisability of Inference for Samples of Networks''

Authors: Pavel N. Krivitsky, Pietro Coletti, Niel Hens

Abstract: This rejoinder responds to discussions by of Caimo, Niezink, and Schweinberger and Fritz of ''A Tale of Two Datasets: Representativeness and Generalisability of Inference for Samples of Networks'' by Krivitsky, Coletti, and Hens, all published in the Journal of the American Statistical Association in 2023. This rejoinder responds to discussions by of Caimo, Niezink, and Schweinberger and Fritz of ''A Tale of Two Datasets: Representativeness and Generalisability of Inference for Samples of Networks'' by Krivitsky, Coletti, and Hens, all published in the Journal of the American Statistical Association in 2023. △ Less

Submitted 10 December, 2023; originally announced December 2023.

Comments: 10 pages, 3 figures, 3 tables

Journal ref: Journal of the American Statistical Association, 118(544), 2235-2238 (2023)

Modeling Tie Duration in ERGM-Based Dynamic Network Models

Authors: Pavel N. Krivitsky

Abstract: Krivitsky and Handcock (2014) proposed a Separable Temporal ERGM (STERGM) framework for modeling social networks, which facilitates separable modeling of the tie duration distributions and the structural dynamics of tie formation. In this note, we explore the hazard structures achievable in this framework, with first- and higher-order Markov assumptions, and propose ways to model a variety of dura… ▽ More Krivitsky and Handcock (2014) proposed a Separable Temporal ERGM (STERGM) framework for modeling social networks, which facilitates separable modeling of the tie duration distributions and the structural dynamics of tie formation. In this note, we explore the hazard structures achievable in this framework, with first- and higher-order Markov assumptions, and propose ways to model a variety of duration distributions in this framework. △ Less

Submitted 14 March, 2022; originally announced March 2022.

Comments: Reposting of Penn State University Department of Statistics Technical Report 12-02 (April 2012), lost in a web site migration; 14 pages, 3 figures, 1 table. arXiv admin note: text overlap with arXiv:2203.06866

ergm 4: Computational Improvements

Authors: Pavel N. Krivitsky, David R. Hunter, Martina Morris, Chad Klumb

Abstract: The ergm package supports the statistical analysis and simulation of network data. It anchors the statnet suite of packages for network analysis in R introduced in a special issue in Journal of Statistical Software in 2008. This article provides an overview of the performance improvements in the 2021 release of ergm version 4. These include performance enhancements to the Markov chain Monte Carlo… ▽ More The ergm package supports the statistical analysis and simulation of network data. It anchors the statnet suite of packages for network analysis in R introduced in a special issue in Journal of Statistical Software in 2008. This article provides an overview of the performance improvements in the 2021 release of ergm version 4. These include performance enhancements to the Markov chain Monte Carlo and maximum likelihood estimation algorithms as well as broader and faster searching for networks with certain target statistics using simulated annealing. △ Less

Submitted 15 March, 2022; originally announced March 2022.

Comments: Computational improvements discussion originally in arXiv:2106.04997v1, extracted into its own preprint; 23 pages, 2 figures, 3 tables

Modeling of Dynamic Networks based on Egocentric Data with Durational Information

Authors: Pavel N. Krivitsky

Abstract: Modeling of dynamic networks -- networks that evolve over time -- has manifold applications in many fields. In epidemiology in particular, there is a need for data-driven modeling of human sexual relationship networks for the purpose of modeling and simulation of the spread of sexually transmitted disease. Dynamic network data about such networks are extremely difficult to collect, however, and mu… ▽ More Modeling of dynamic networks -- networks that evolve over time -- has manifold applications in many fields. In epidemiology in particular, there is a need for data-driven modeling of human sexual relationship networks for the purpose of modeling and simulation of the spread of sexually transmitted disease. Dynamic network data about such networks are extremely difficult to collect, however, and much more readily available are egocentrically sampled data of a network at a single time point, with some attendant information about the sexual history of respondents. Krivitsky and Handcock (2014) proposed a Separable Temporal ERGM (STERGM) framework, which facilitates separable modeling of the tie duration distributions and the structural dynamics of tie formation. In this work, we apply this modeling framework to this problem, by studying the long-run properties of STERGM processes, develo** methods for fitting STERGMs to egocentrically sampled data, and extending the network size adjustment method of Krivitsky, Handcock, and Morris (2011) to dynamic models. △ Less

Submitted 14 March, 2022; originally announced March 2022.

Comments: Reposting of Penn State University Department of Statistics Technical Report 12-01 (April 2012), lost in a web site migration; 36 pages, 4 figures, 1 table

A Tale of Two Datasets: Representativeness and Generalisability of Inference for Samples of Networks

Authors: Pavel N. Krivitsky, Pietro Coletti, Niel Hens

Abstract: The last two decades have seen considerable progress in foundational aspects of statistical network analysis, but the path from theory to application is not straightforward. Two large, heterogeneous samples of small networks of within-household contacts in Belgium were collected using two different but complementary sampling designs: one smaller but with all contacts in each household observed, th… ▽ More The last two decades have seen considerable progress in foundational aspects of statistical network analysis, but the path from theory to application is not straightforward. Two large, heterogeneous samples of small networks of within-household contacts in Belgium were collected using two different but complementary sampling designs: one smaller but with all contacts in each household observed, the other larger and more representative but recording contacts of only one person per household. We wish to combine their strengths to learn the social forces that shape household contact formation and facilitate simulation for prediction of disease spread, while generalising to the population of households in the region. To accomplish this, we describe a flexible framework for specifying multi-network models in the exponential family class and identify the requirements for inference and prediction under this framework to be consistent, identifiable, and generalisable, even when data are incomplete; explore how these requirements may be violated in practice; and develop a suite of quantitative and graphical diagnostics for detecting violations and suggesting improvements to candidate models. We report on the effects of network size, geography, and household roles on household contact patterns (activity, heterogeneity in activity, and triadic closure). △ Less

Submitted 18 July, 2023; v1 submitted 8 February, 2022; originally announced February 2022.

Comments: 101 pages (3 front matter, 26 body, 72 appendix), 35 figures (4 body, 31 appendix), 66 tables (1 body, 61 appendix)

Journal ref: Journal of the American Statistical Association, 118(544), 2213-2224 (2023)

Likelihood-based Inference for Exponential-Family Random Graph Models via Linear Programming

Authors: Pavel N. Krivitsky, Alina R. Kuvelkar, David R. Hunter

Abstract: This article discusses the problem of determining whether a given point, or set of points, lies within the convex hull of another set of points in $d$ dimensions. This problem arises naturally in a statistical context when using a particular approximation to the loglikelihood function for an exponential family model; in particular, we discuss the application to network models here. While the conve… ▽ More This article discusses the problem of determining whether a given point, or set of points, lies within the convex hull of another set of points in $d$ dimensions. This problem arises naturally in a statistical context when using a particular approximation to the loglikelihood function for an exponential family model; in particular, we discuss the application to network models here. While the convex hull question may be solved via a simple linear program, this approach is not well known in the statistical literature. Furthermore, this article details several substantial improvements to the convex hull-testing algorithm currently implemented in the widely used 'ergm' package for network modeling. △ Less

Submitted 7 February, 2022; originally announced February 2022.

Comments: 26 pages, 4 figures, 1 table

Journal ref: Electronic Journal of Statistics, 17(2): 3337-3356 (2023)

ergm 4: New features

Authors: Pavel N. Krivitsky, David R. Hunter, Martina Morris, Chad Klumb

Abstract: The ergm package supports the statistical analysis and simulation of network data. It anchors the statnet suite of packages for network analysis in R introduced in a special issue in Journal of Statistical Software in 2008. This article provides an overview of the new functionality in the 2021 release of ergm version 4. These include more flexible handling of nodal covariates, term operators that… ▽ More The ergm package supports the statistical analysis and simulation of network data. It anchors the statnet suite of packages for network analysis in R introduced in a special issue in Journal of Statistical Software in 2008. This article provides an overview of the new functionality in the 2021 release of ergm version 4. These include more flexible handling of nodal covariates, term operators that extend and simplify model specification, new models for networks with valued edges, improved handling of constraints on the sample space of networks, and estimation with missing edge data. We also identify the new packages in the statnet suite that extend ergm's functionality to other network data types and structural features and the robust set of online resources that support the statnet development process and applications. △ Less

Submitted 15 March, 2022; v1 submitted 9 June, 2021; originally announced June 2021.

Comments: Computational improvements discussion in the previous version was split out into another preprint; 30 pages, 2 figures

Journal ref: Journal of Statistical Software, 105(1), 1-44 (2023)

Revisiting Bayesian Autoencoders with MCMC

Authors: Rohitash Chandra, Mahir Jain, Manavendra Maharana, Pavel N. Krivitsky

Abstract: Autoencoders gained popularity in the deep learning revolution given their ability to compress data and provide dimensionality reduction. Although prominent deep learning methods have been used to enhance autoencoders, the need to provide robust uncertainty quantification remains a challenge. This has been addressed with variational autoencoders so far. Bayesian inference via Markov Chain Monte Ca… ▽ More Autoencoders gained popularity in the deep learning revolution given their ability to compress data and provide dimensionality reduction. Although prominent deep learning methods have been used to enhance autoencoders, the need to provide robust uncertainty quantification remains a challenge. This has been addressed with variational autoencoders so far. Bayesian inference via Markov Chain Monte Carlo (MCMC) sampling has faced several limitations for large models; however, recent advances in parallel computing and advanced proposal schemes have opened routes less traveled. This paper presents Bayesian autoencoders powered by MCMC sampling implemented using parallel computing and Langevin-gradient proposal distribution. The results indicate that the proposed Bayesian autoencoder provides similar performance accuracy when compared to related methods in the literature. Furthermore, it provides uncertainty quantification in the reduced data representation. This motivates further applications of the Bayesian autoencoder framework for other deep learning models. △ Less

Submitted 28 April, 2022; v1 submitted 12 April, 2021; originally announced April 2021.

Journal ref: R. Chandra, M. Jain, M. Maharana and P. N. Krivitsky, "Revisiting Bayesian Autoencoders With MCMC," in IEEE Access, vol. 10, pp. 40482-40495, 2022, doi: 10.1109/ACCESS.2022.3163270

Exponential-Family Models of Random Graphs: Inference in Finite-, Super-, and Infinite Population Scenarios

Authors: Michael Schweinberger, Pavel N. Krivitsky, Carter T. Butts, Jonathan Stewart

Abstract: Exponential-family Random Graph Models (ERGMs) constitute a large statistical framework for modeling sparse and dense random graphs, short- and long-tailed degree distributions, covariates, and a wide range of complex dependencies. Special cases of ERGMs are generalized linear models (GLMs), Bernoulli random graphs, $β$-models, $p_1$-models, and models related to Markov random fields in spatial st… ▽ More Exponential-family Random Graph Models (ERGMs) constitute a large statistical framework for modeling sparse and dense random graphs, short- and long-tailed degree distributions, covariates, and a wide range of complex dependencies. Special cases of ERGMs are generalized linear models (GLMs), Bernoulli random graphs, $β$-models, $p_1$-models, and models related to Markov random fields in spatial statistics and other areas of statistics. While widely used in practice, questions have been raised about the theoretical properties of ERGMs. These include concerns that some ERGMs are near-degenerate and that many ERGMs are non-projective. To address them, careful attention must be paid to model specifications and their underlying assumptions, and in which inferential settings models are employed. As we discuss, near-degeneracy can affect simplistic ERGMs lacking structure, but well-posed ERGMs with additional structure can be well-behaved. Likewise, lack of projectivity can affect non-likelihood-based inference, but likelihood-based inference does not require projectivity. Here, we review well-posed ERGMs along with likelihood-based inference. We first clarify the core statistical notions of "sample" and "population" in the ERGM framework, and separate the process that generates the population graph from the observation process. We then review likelihood-based inference in finite-, super-, and infinite-population scenarios. We conclude with consistency results, and an application to human brain networks △ Less

Submitted 12 September, 2019; v1 submitted 15 July, 2017; originally announced July 2017.

Journal ref: Statistical Science 35(4): 627 - 662 (2020)

Sharing Social Network Data: Differentially Private Estimation of Exponential-Family Random Graph Models

Authors: Vishesh Karwa, Pavel N. Krivitsky, Aleksandra B. Slavković

Abstract: Motivated by a real-life problem of sharing social network data that contain sensitive personal information, we propose a novel approach to release and analyze synthetic graphs in order to protect privacy of individual relationships captured by the social network while maintaining the validity of statistical results. A case study using a version of the Enron e-mail corpus dataset demonstrates the… ▽ More Motivated by a real-life problem of sharing social network data that contain sensitive personal information, we propose a novel approach to release and analyze synthetic graphs in order to protect privacy of individual relationships captured by the social network while maintaining the validity of statistical results. A case study using a version of the Enron e-mail corpus dataset demonstrates the application and usefulness of the proposed techniques in solving the challenging problem of maintaining privacy \emph{and} supporting open access to network data to ensure reproducibility of existing studies and discovering new scientific insights that can be obtained by analyzing such data. We use a simple yet effective randomized response mechanism to generate synthetic networks under $ε$-edge differential privacy, and then use likelihood based inference for missing data and Markov chain Monte Carlo techniques to fit exponential-family random graph models to the generated synthetic networks. △ Less

Submitted 23 September, 2016; v1 submitted 9 November, 2015; originally announced November 2015.

Comments: Updated, 39 pages

Capturing Multivariate Spatial Dependence: Model, Estimate and then Predict

Authors: Noel Cressie, Sandy Burden, Walter Davis, Pavel N. Krivitsky, Payam Mokhtarian, Thomas Suesse, Andrew Zammit-Mangion

Abstract: Physical processes rarely occur in isolation, rather they influence and interact with one another. Thus, there is great benefit in modeling potential dependence between both spatial locations and different processes. It is the interaction between these two dependencies that is the focus of Genton and Kleiber's paper under discussion. We see the problem of ensuring that any multivariate spatial cov… ▽ More Physical processes rarely occur in isolation, rather they influence and interact with one another. Thus, there is great benefit in modeling potential dependence between both spatial locations and different processes. It is the interaction between these two dependencies that is the focus of Genton and Kleiber's paper under discussion. We see the problem of ensuring that any multivariate spatial covariance matrix is nonnegative definite as important, but we also see it as a means to an end. That "end" is solving the scientific problem of predicting a multivariate field. [arXiv:1507.08017]. △ Less

Submitted 30 July, 2015; originally announced July 2015.

Comments: Published at http://dx.doi.org/10.1214/15-STS517 in the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-STS-STS517

Journal ref: Statistical Science 2015, Vol. 30, No. 2, 170-175

Exponential-Family Random Graph Models for Rank-Order Relational Data

Authors: Pavel N. Krivitsky, Carter T. Butts

Abstract: Rank-order relational data, in which each actor ranks the others according to some criterion, often arise from sociometric measurements of judgment (e.g., self-reported interpersonal interaction) or preference (e.g., relative liking). We propose a class of exponential-family models for rank-order relational data and derive a new class of sufficient statistics for such data, which assume no more th… ▽ More Rank-order relational data, in which each actor ranks the others according to some criterion, often arise from sociometric measurements of judgment (e.g., self-reported interpersonal interaction) or preference (e.g., relative liking). We propose a class of exponential-family models for rank-order relational data and derive a new class of sufficient statistics for such data, which assume no more than within-subject ordinal properties. Application of MCMC MLE to this family allows us to estimate effects for a variety of plausible mechanisms governing rank structure in cross-sectional context, and to model the evolution of such structures over time. We apply this framework to model the evolution of relative liking judgments in an acquaintance process, and to model recall of relative volume of interpersonal interaction among members of a technology education program. △ Less

Submitted 20 June, 2015; v1 submitted 1 October, 2012; originally announced October 2012.

Comments: 50 pages, 6 figures, 4 tables, 1 algorithm. The paper has been expanded and clarified, and some terms were changed

MSC Class: 91D30 (Primary) 90B15; 62M05; 60J20 (Secondary) ACM Class: G.3

Journal ref: Krivitsky, P. N. & Butts, C. T. (2017) Exponential-Family Random Graph Models for Rank-Order Relational Data. Sociological Methodology, 47(1): 68-112

On the Question of Effective Sample Size in Network Modeling: An Asymptotic Inquiry

Authors: Pavel N. Krivitsky, Eric D. Kolaczyk

Abstract: The modeling and analysis of networks and network data has seen an explosion of interest in recent years and represents an exciting direction for potential growth in statistics. Despite the already substantial amount of work done in this area to date by researchers from various disciplines, however, there remain many questions of a decidedly foundational nature - natural analogues of standard ques… ▽ More The modeling and analysis of networks and network data has seen an explosion of interest in recent years and represents an exciting direction for potential growth in statistics. Despite the already substantial amount of work done in this area to date by researchers from various disciplines, however, there remain many questions of a decidedly foundational nature - natural analogues of standard questions already posed and addressed in more classical areas of statistics - that have yet to even be posed, much less addressed. Here we raise and consider one such question in connection with network modeling. Specifically, we ask, "Given an observed network, what is the sample size?" Using simple, illustrative examples from the class of exponential random graph models, we show that the answer to this question can very much depend on basic properties of the networks expected under the model, as the number of vertices $n_V$ in the network grows. In particular, adopting the (asymptotic) scaling of the variance of the maximum likelihood parameter estimates as a notion of effective sample size ($n_{\mathrm{eff}}$), we show that when modeling the overall propensity to have ties and the propensity to reciprocate ties, whether the networks are sparse or not under the model (i.e., having a constant or an increasing number of ties per vertex, respectively) is sufficient to yield an order of magnitude difference in $n_{\mathrm{eff}}$, from $O(n_V)$ to $O(n^2_V)$. In addition, we report simulation study results that suggest similar properties for models for triadic (friend-of-a-friend) effects. We then explore some practical implications of this result, using both simulation and data on food-sharing from Lamalera, Indonesia. △ Less

Submitted 5 August, 2015; v1 submitted 5 December, 2011; originally announced December 2011.

Comments: Published at http://dx.doi.org/10.1214/14-STS502 in the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-STS-STS502

Journal ref: Statistical Science 2015, Vol. 30, No. 2, 184-198

Exponential-Family Random Graph Models for Valued Networks

Authors: Pavel N. Krivitsky

Abstract: Exponential-family random graph models (ERGMs) provide a principled and flexible way to model and simulate features common in social networks, such as propensities for homophily, mutuality, and friend-of-a-friend triad closure, through choice of model terms (sufficient statistics). However, those ERGMs modeling the more complex features have, to date, been limited to binary data: presence or absen… ▽ More Exponential-family random graph models (ERGMs) provide a principled and flexible way to model and simulate features common in social networks, such as propensities for homophily, mutuality, and friend-of-a-friend triad closure, through choice of model terms (sufficient statistics). However, those ERGMs modeling the more complex features have, to date, been limited to binary data: presence or absence of ties. Thus, analysis of valued networks, such as those where counts, measurements, or ranks are observed, has necessitated dichotomizing them, losing information and introducing biases. In this work, we generalize ERGMs to valued networks. Focusing on modeling counts, we formulate an ERGM for networks whose ties are counts and discuss issues that arise when moving beyond the binary case. We introduce model terms that generalize and model common social network features for such data and apply these methods to a network dataset whose values are counts of interactions. △ Less

Submitted 19 January, 2012; v1 submitted 7 January, 2011; originally announced January 2011.

Comments: 42 pages, including 2 appendixes (3 pages total), 5 figures, 2 tables, 1 algorithm listing; a substantial revision and reorganization: major changes include focus shifted to counts in particular, sections added on modeling actor heterogeneity, a subsection on degeneracy, another example, and an appendix on non-steepness of the CMP distribution

MSC Class: 91D30 (Primary) 60B05 (Secondary) ACM Class: G.3

Journal ref: Electron. J. Statist. 6 (2012) 1100-1128

A Separable Model for Dynamic Networks

Authors: Pavel N. Krivitsky, Mark S. Handcock

Abstract: Models of dynamic networks --- networks that evolve over time --- have manifold applications. We develop a discrete-time generative model for social network evolution that inherits the richness and flexibility of the class of exponential-family random graph models. The model --- a Separable Temporal ERGM (STERGM) --- facilitates separable modeling of the tie duration distributions and the structur… ▽ More Models of dynamic networks --- networks that evolve over time --- have manifold applications. We develop a discrete-time generative model for social network evolution that inherits the richness and flexibility of the class of exponential-family random graph models. The model --- a Separable Temporal ERGM (STERGM) --- facilitates separable modeling of the tie duration distributions and the structural dynamics of tie formation. We develop likelihood-based inference for the model, and provide computational algorithms for maximum likelihood estimation. We illustrate the interpretability of the model in analyzing a longitudinal network of friendship ties within a school. △ Less

Submitted 19 August, 2012; v1 submitted 8 November, 2010; originally announced November 2010.

Comments: 28 pages (including a 4-page appendix); a substantial rewrite, with many corrections, changes in terminology, and a different analysis for the example

MSC Class: 91D30 (Primary); 62M05; 60J20 (Secondary) ACM Class: G.3

Journal ref: Journal of the Royal Statistical Society, Series B 76(1) (2014) 29-46

Adjusting for Network Size and Composition Effects in Exponential-Family Random Graph Models

Authors: Pavel N. Krivitsky, Mark S. Handcock, Martina Morris

Abstract: Exponential-family random graph models (ERGMs) provide a principled way to model and simulate features common in human social networks, such as propensities for homophily and friend-of-a-friend triad closure. We show that, without adjustment, ERGMs preserve density as network size increases. Density invariance is often not appropriate for social networks. We suggest a simple modification based on… ▽ More Exponential-family random graph models (ERGMs) provide a principled way to model and simulate features common in human social networks, such as propensities for homophily and friend-of-a-friend triad closure. We show that, without adjustment, ERGMs preserve density as network size increases. Density invariance is often not appropriate for social networks. We suggest a simple modification based on an offset which instead preserves the mean degree and accommodates changes in network composition asymptotically. We demonstrate that this approach allows ERGMs to be applied to the important situation of egocentrically sampled data. We analyze data from the National Health and Social Life Survey (NHSLS). △ Less

Submitted 27 December, 2010; v1 submitted 29 April, 2010; originally announced April 2010.

Comments: 37 pages, 2 figures, 5 tables; notation revised and clarified, some sections (particularly 4.3 and 5) made more rigorous, some derivations moved into the appendix, typos fixed, some wording changed

MSC Class: 91D30 (Primary) 62D; 62F12; 62F40; 62P25; 62M40 (Secondary)

Journal ref: Statistical Methodology 8 (2011) 319-339