-
Towards Key Performance Indicators of Research Infrastructures
Authors:
Jana Kolar,
Marjan Cugmas,
Anuška Ferligoj
Abstract:
In 2018, the European Strategic Forum for research infrastructures (ESFRI) was tasked by the Competitiveness Council, a configuration of the Council of the EU, to develop a common approach for monitoring of Research Infrastructures' performance. To this end, ESFRI established a working group, which has proposed 21 Key Performance Indicators (KPIs) to monitor the progress of the Research Infrastruc…
▽ More
In 2018, the European Strategic Forum for research infrastructures (ESFRI) was tasked by the Competitiveness Council, a configuration of the Council of the EU, to develop a common approach for monitoring of Research Infrastructures' performance. To this end, ESFRI established a working group, which has proposed 21 Key Performance Indicators (KPIs) to monitor the progress of the Research Infrastructures (RIs) addressed towards their objectives. The RIs were then asked to assess their relevance for their institution. The paper aims to identify the relevance of certain indicators for particular groups of RIs by using cluster and discriminant analysis. This could contribute to development of a monitoring system, tailored to particular RIs.
To obtain a typology of the RIs, we first performed cluster analysis of the RIs according to their properties, which revealed clusters of RIs with similar characteristics, based on to the domain of operation, such as food, environment or engineering. Then, discriminant analysis was used to study how the relevance of the KPIs differs among the obtained clusters. This analysis revealed that the percentage of RIs correctly classified into five clusters, using the KPIs, is 80%. Such a high percentage indicates that there are significant differences in the relevance of certain indicators, depending on the ESFRI domain of the RI. The indicators therefore need to be adapted to the type of infrastructure. It is therefore proposed that the Strategic Working Groups of ESFRI addressing specific domains should be involved in the tailored development of the monitoring of pan-European RIs.
△ Less
Submitted 1 October, 2019;
originally announced October 2019.
-
Symmetric core-cohesive blockmodel in preschool children's interaction networks
Authors:
Marjan Cugmas,
Dawn DeLay,
Aleš Žiberna,
Anuška Ferligoj
Abstract:
Researchers have extensively studied the social mechanisms that drive the formation of networks observed among preschool children. However, less attention has been given to global network structures in terms of blockmodels. A blockmodel is a network where the nodes are groups of equivalent units (according to links to others) from a studied network. Cugmas et al. (2019) showed that mutuality, popu…
▽ More
Researchers have extensively studied the social mechanisms that drive the formation of networks observed among preschool children. However, less attention has been given to global network structures in terms of blockmodels. A blockmodel is a network where the nodes are groups of equivalent units (according to links to others) from a studied network. Cugmas et al. (2019) showed that mutuality, popularity, assortativity, and different types of transitivity mechanisms can lead the global network structure to the proposed asymmetric core-cohesive blockmodel. Yet, they did not provide any evidence that such a global network structure actually appears in any empirical data. In this paper, the symmetric version of the core-cohesive blockmodel type is proposed. This blockmodel type consists of three or more groups of units. The units from each group are internally well linked to each other while those from different groups are not linked to each other. This is true for all groups, except one in which the units have mutual links to all other units in the network. In this study, it is shown that the proposed blockmodel type appears in empirical interactional networks collected among preschool children. Monte Carlo simulations confirm that the most often studied social network mechanisms can lead the global network structure to the proposed symmetric blockmodel type. The units' attributes are not considered in this study.
△ Less
Submitted 5 June, 2019;
originally announced June 2019.
-
Comparing Two Partitions of Non-Equal Sets of Units
Authors:
Marjan Cugmas,
Anuška Ferligoj
Abstract:
Rand (1971) proposed what has since become a well-known index for comparing two partitions obtained on the same set of units. The index takes a value on the interval between 0 and 1, where a higher value indicates more similar partitions. Sometimes, e.g. when the units are observed in two time periods, the splitting and merging of clusters should be considered differently, according to the operati…
▽ More
Rand (1971) proposed what has since become a well-known index for comparing two partitions obtained on the same set of units. The index takes a value on the interval between 0 and 1, where a higher value indicates more similar partitions. Sometimes, e.g. when the units are observed in two time periods, the splitting and merging of clusters should be considered differently, according to the operationalization of the stability of clusters. The Rand Index is symmetric in the sense that both the splitting and merging of clusters lower the value of the index. In such a non-symmetric case, one of the Wallace indexes (Wallace, 1983) can be used. Further, there are several cases when one wants to compare two partitions obtained on different sets of units, where the intersection of these sets of units is a non-empty set of units. In this instance, the new units and units which leave the clusters from the first partition can be considered as a factor lowering the value of the index. Therefore, a modified Rand index is presented. Because the splitting and merging of clusters have to be considered differently in some situations, an asymmetric modified Wallace Index is also proposed. For all presented indices, the correction for chance is described, which allows different values of a selected index to be compared.
△ Less
Submitted 21 May, 2018;
originally announced May 2018.
-
Scientific co-authorship networks
Authors:
Marjan Cugmas,
Anuška Ferligoj,
Luka Kronegger
Abstract:
The paper addresses the stability of the co-authorship networks in time. The analysis is done on the networks of Slovenian researchers in two time periods (1991-2000 and 2001-2010). Two researchers are linked if they published at least one scientific bibliographic unit in a given time period. As proposed by Kronegger et al. (2011), the global network structures are examined by generalized blockmod…
▽ More
The paper addresses the stability of the co-authorship networks in time. The analysis is done on the networks of Slovenian researchers in two time periods (1991-2000 and 2001-2010). Two researchers are linked if they published at least one scientific bibliographic unit in a given time period. As proposed by Kronegger et al. (2011), the global network structures are examined by generalized blockmodeling with the assumed multi-core--semi-periphery--periphery blockmodel type. The term core denotes a group of researchers who published together in a systematic way with each other.
The obtained blockmodels are comprehensively analyzed by visualizations and through considering several statistics regarding the global network structure. To measure the stability of the obtained blockmodels, different adjusted modified Rand and Wallace indices are applied. Those enable to distinguish between the splitting and merging of cores when operationalizing the stability of cores. Also, the adjusted modified indices can be used when new researchers occur in the second time period (newcomers) and when some researchers are no longer present in the second time period (departures). The research disciplines are described and clustered according to the values of these indices. Considering the obtained clusters, the sources of instability of the research disciplines are studied (e.g., merging or splitting of cores, newcomers or departures). Furthermore, the differences in the stability of the obtained cores on the level of scientific disciplines are studied by linear regression analysis where some personal characteristics of the researchers (e.g., age, gender), are also considered.
△ Less
Submitted 2 November, 2017;
originally announced November 2017.
-
Generating global network structures by triad types
Authors:
Marjan Cugmas,
Anuška Ferligoj,
Aleš Žiberna
Abstract:
This paper addresses the question of whether it is possible to generate networks with a given global structure (defined by selected blockmodels, i.e., cohesive, core-periphery, hierarchical and transitivity), considering only different types of triads. Two methods are used to generate networks: (i) the method of relocating links; and (ii) the Monte Carlo Multi Chain algorithm implemented in the "e…
▽ More
This paper addresses the question of whether it is possible to generate networks with a given global structure (defined by selected blockmodels, i.e., cohesive, core-periphery, hierarchical and transitivity), considering only different types of triads. Two methods are used to generate networks: (i) the method of relocating links; and (ii) the Monte Carlo Multi Chain algorithm implemented in the "ergm" package implemented in R. Although all types of triads can generate networks with the selected blockmodel types, the selection of only a subset of triads improves the generated networks' blockmodel structure. However, in the case of a hierarchical blockmodel without complete blocks on the diagonal, additional local structures are needed to achieve the desired global structure of generated networks. This shows that blockmodels can emerge based on only local processes that do not take attributes into account.
△ Less
Submitted 27 October, 2017;
originally announced October 2017.
