-
Ukrainian Arts and Humanities research in Scopus: A Bibliometric Analysis
Authors:
Serhii Nazarovets,
Olesya Mryglod
Abstract:
This article presents the results of a quantitative analysis of Ukrainian Arts and Humanities (A&H) research from 2012 to 2021, as observed in Scopus. The overall publication activity and the relative share of A&H publications in relation to Ukraine's total research output, comparing them with other countries. The study analyzes the diversity and total number of sources, as well as the geographic…
▽ More
This article presents the results of a quantitative analysis of Ukrainian Arts and Humanities (A&H) research from 2012 to 2021, as observed in Scopus. The overall publication activity and the relative share of A&H publications in relation to Ukraine's total research output, comparing them with other countries. The study analyzes the diversity and total number of sources, as well as the geographic distribution of authors and citing authors, to provide insights into the internationalization level of Ukrainian A&H research. Additionally, the topical spectrum and language usage are considered to complete the overall picture. According to our results, the publication patterns for Ukrainian A&H research exhibit dynamics comparable to those of other countries, with a gradual increase in the total number of papers and sources. However, the citedness is lower than expected, and the share of publications in top-quartile sources is lower for 2020-2021 period compared to the previous years. The impact of internationally collaborative papers, especially those in English, is higher. Nevertheless, over half of all works remain uncited, probably due to the limited readership of the journals selected for publication.
△ Less
Submitted 15 August, 2023;
originally announced August 2023.
-
One for all and all for one: on the role of a conference in a scientist's life
Authors:
Olesya Mryglod
Abstract:
The quantitative description of the scientific conference MECO (Middle European Cooperation in Statistical Physics) based on bibliographic records is presented in the paper. Statistics of contributions and participants, co-authorship patterns at the levels of authors and countries, typical proportions of newcomers and permanent participants as well as other characteristics of the scientific event…
▽ More
The quantitative description of the scientific conference MECO (Middle European Cooperation in Statistical Physics) based on bibliographic records is presented in the paper. Statistics of contributions and participants, co-authorship patterns at the levels of authors and countries, typical proportions of newcomers and permanent participants as well as other characteristics of the scientific event are discussed. The results of this case study contribute to better understanding of the ways of formalization and assessment of conferences and their role in individual academic careers. To highlight the latter, the change of perspective is used: in addition to the general analysis of the conference data, an ego-centric approach is used to emphasize the role of a particular participant for the conference and, vice versa, the role of MECO in the researcher's professional life. This paper is part of the special CMP issue dedicated to the anniversary of Bertrand Berche - a well-known physicist, an active member of the community of authors and editors of the journal, long time collaborator and dear friend of the author.
△ Less
Submitted 6 March, 2023; v1 submitted 8 December, 2022;
originally announced December 2022.
-
Peculiarities of gender disambiguation and ordering of non-English authors' names for Economic papers beyond core databases
Authors:
O. Mryglod,
S. Nazarovets,
S. Kozmenko
Abstract:
This paper presents the results of further exploration of Crossref data related to Ukrainian Economics research (the first part can be found in [Mryglod, O., Nazarovets, S. & Kozmenko, S. (2021) Scientometrics, 126, 8187]). Our purpose is to supplement the quantitative portrait of Ukrainian Economics discipline with the results of gender and author ordering analysis at the level of individual auth…
▽ More
This paper presents the results of further exploration of Crossref data related to Ukrainian Economics research (the first part can be found in [Mryglod, O., Nazarovets, S. & Kozmenko, S. (2021) Scientometrics, 126, 8187]). Our purpose is to supplement the quantitative portrait of Ukrainian Economics discipline with the results of gender and author ordering analysis at the level of individual authors, special methods of working with bibliographic data with a predominant share of non-English authors are used. The properties of gender mixing, the likelihood of male and female authors occupying the first position in the authorship list, as well as the arrangements of names are studied. A data set containing bibliographic records related to Ukrainian journal publications in the field of Economics is constructed using Crossref metadata. The described stages for working with such specific data help to work at the level of authors and analyse, in particular, gender issues. Despite the larger number of female authors, gender equality is more likely to be reported at the individual level for the discipline of Ukrainian Economics. The tendencies towards collaborative or solo-publications and gender mixing patterns are found to be dependent on the journal: the differences for publications indexed in Scopus and/or Web of Science databases are found. It has also been found that Ukrainian Economics research is characterized by rather a non-alphabetical order of authors. To our knowledge, this is the first large-scale quantitative study of Ukrainian Economic discipline. The results obtained are valuable not only at the national level, but also contribute to general knowledge about Economic research, gender issues and authors' names ordering. Here, for the first time, attention is drawn to the explicit use of the features of the Slavic authors' names.
△ Less
Submitted 29 November, 2022;
originally announced November 2022.
-
Big fish and small ponds: why the departmental h-index should not be used to rank universities
Authors:
Olesya Mryglod,
Yurij Holovatch,
Ralph Kenna
Abstract:
The size-dependent nature of the so-called group or departmental h-index is reconsidered in this paper. While the influence of unit size on such collective measures was already demonstrated a decade ago, institutional ratings based on this metric can still be found and still impact on the reputations and funding of many research institutions. The aim of this paper is to demonstrate the fallacy of…
▽ More
The size-dependent nature of the so-called group or departmental h-index is reconsidered in this paper. While the influence of unit size on such collective measures was already demonstrated a decade ago, institutional ratings based on this metric can still be found and still impact on the reputations and funding of many research institutions. The aim of this paper is to demonstrate the fallacy of this approach to collective research-quality assessment in a simple way, focusing on the h-index in its original form. We show that randomly reshuffling real scientometric data (varying numbers of citations) amongst institutions of varying size, while maintaining the volume of their research outputs, has little effect on their departmental h-index. This suggests that the relative position in ratings based on the collective h-index is determined not only by quality (impact) of particular research outputs but by their volume. Therefore, the application of the collective h-index in its original form is disputable as a basement for comparison at aggregated levels such as to research groups, institutions or journals. We suggest a possible remedy for this failing which is implementable in a manner that is as simple and understandable as the h-index itself.
△ Less
Submitted 1 February, 2022;
originally announced February 2022.
-
Network of scientific concepts: empirical analysis and modeling
Authors:
Vasyl Palchykov,
Mariana Krasnytska,
Olesya Mryglod,
Yurij Holovatch
Abstract:
Concepts in a certain domain of science are linked via intrinsic connections reflecting the structure of knowledge. To get a qualitative insight and a quantitative description of this structure, we perform empirical analysis and modeling of the network of scientific concepts in the domain of physics. To this end we use a collection of manuscripts submitted to the e-print repository arXiv and the v…
▽ More
Concepts in a certain domain of science are linked via intrinsic connections reflecting the structure of knowledge. To get a qualitative insight and a quantitative description of this structure, we perform empirical analysis and modeling of the network of scientific concepts in the domain of physics. To this end we use a collection of manuscripts submitted to the e-print repository arXiv and the vocabulary of scientific concepts collected via the ScienceWISE.info platform and construct a network of scientific concepts based on their co-occurrences in publications. The resulting complex network possesses a number of specific features (high node density, dissortativity, structural correlations, skewed node degree distribution) that can not be understood as a result of simple growth by several commonly used network models. We show that the model based on a simultaneous account of two factors, growth by blocks and preferential selection, gives an explanation of empirically observed properties of the concepts network.
△ Less
Submitted 9 August, 2021;
originally announced August 2021.
-
Universal and specific features of Ukrainian economic research: publication analysis based on Crossref data
Authors:
O. Mryglod,
S. Nazarovets,
S. Kozmenko
Abstract:
Our study is one of the first examples of multidimensional and longitudinal disciplinary analysis at the national level based on Crossref data. We present a large-scale quantitative analysis of Ukrainian economics. This study is not yet another example of research aimed at ranking of local journals, authors or institutions, but rather exploring general tendencies that can be compared to other coun…
▽ More
Our study is one of the first examples of multidimensional and longitudinal disciplinary analysis at the national level based on Crossref data. We present a large-scale quantitative analysis of Ukrainian economics. This study is not yet another example of research aimed at ranking of local journals, authors or institutions, but rather exploring general tendencies that can be compared to other countries or regions. We study different aspects of Ukrainian economics output. In particular, the collaborative nature, geographic landscape and some peculiarities of citation statistics are investigated. We have found that Ukrainian economics is characterized by a comparably small share of co-authored publications, however, it demonstrates the tendency towards more collaborative output. Based on our analysis, we discuss specific and universal features of Ukrainian economic research. The importance of supporting various initiatives aimed at enriching open scholarly metadata is considered. A comprehensive and high-quality meta description of publications is probably the shortest path to a better understanding of national trends, especially for non-English speaking countries. The results of our analysis can be used to better understand Ukrainian economic research and support research policy decisions.
△ Less
Submitted 16 June, 2021;
originally announced June 2021.
-
Collective authorship in Ukrainian science: marginal effect or new phenomenon?
Authors:
Olesya Mryglod,
Ihor Mryglod
Abstract:
One of the features of modern science is the formation of stable large collaborations of researchers working together within the projects that require the concentration of huge financial and human resources. Results of such common work are published in scientific papers by large co-authorship teams that include sometimes thousands of names. The goal of this work is to study the influence of such p…
▽ More
One of the features of modern science is the formation of stable large collaborations of researchers working together within the projects that require the concentration of huge financial and human resources. Results of such common work are published in scientific papers by large co-authorship teams that include sometimes thousands of names. The goal of this work is to study the influence of such publications on the values of scientometric indicators calculated for individuals, research groups and science of Ukraine in general. Bibliometric data related to Ukraine, some academic institutions and selected individual researchers were collected from Scopus database and used for our study. It is demonstrated that while the relative share of publications by collective authors is comparatively small, their presence in a general pool can lead to statistically significant effects. The obtained results clearly show that traditional quantitative approaches for research assessment should be changed in order to take into account this phenomenon. Keywords: collective authorship, scientometrics, group science, Ukraine.
△ Less
Submitted 12 November, 2020;
originally announced November 2020.
-
Data Mining in Scientometrics: usage analysis for academic publications
Authors:
Olesya Mryglod,
Yurij Holovatch,
Ralph Kenna
Abstract:
We perform a statistical analysis of scientific-publication data with a goal to provide quantitative analysis of scientific process. Such an investigation belongs to the newly established field of scientometrics: a branch of the general science of science that covers all quantitative methods to analyze science and research process. As a case study we consider download and citation statistics of th…
▽ More
We perform a statistical analysis of scientific-publication data with a goal to provide quantitative analysis of scientific process. Such an investigation belongs to the newly established field of scientometrics: a branch of the general science of science that covers all quantitative methods to analyze science and research process. As a case study we consider download and citation statistics of the journal `Europhysics Letters' (EPL), as Europe's flagship letters journal of broad interest to the physics community. While citations are usually considered as an indicator of academic impact, downloads reflect rather the level of attractiveness or popularity of a publication. We discuss peculiarities of both processes and correlations between them.
△ Less
Submitted 9 July, 2018;
originally announced July 2018.
-
Scientometric analysis of Condensed Matter Physics journal
Authors:
O. Mryglod
Abstract:
The paper is dedicated to 25th anniversary of Condensed Matter Physics journal (CMP). It contains the results of comprehensive analysis of different journal-related data. CMP co-authorship relationships are studied analysing the collaboration network. Its cumulative statical and dynamical properties as well as the structure are discussed. The international contribution to the journal is assessed u…
▽ More
The paper is dedicated to 25th anniversary of Condensed Matter Physics journal (CMP). It contains the results of comprehensive analysis of different journal-related data. CMP co-authorship relationships are studied analysing the collaboration network. Its cumulative statical and dynamical properties as well as the structure are discussed. The international contribution to the journal is assessed using the authors' affiliation data. The network of the countries collaborating within CMP is considered. Another kind of network is used to investigate the topical spectrum: two PACS indices assigned to one paper are connected by link here. The structure of the most significant interdisciplinary connections is analysed. Finally, the download statistics and the corresponding records of the papers' citations are used to discuss the journal's impact.
△ Less
Submitted 26 June, 2018;
originally announced June 2018.
-
Complex-network approach for visualizing and quantifying the evolution of a scientific topic
Authors:
Olesya Mryglod,
Bertrand Berche,
Yurij Holovatch,
Ralph Kenna
Abstract:
Tracing the evolution of specific topics is a subject area which belongs to the general problem of map** the structure of scientific knowledge. Often bibliometric data bases are used to study the history of scientific topic evolution from its appearance to its extinction or merger with other topics. In this chapter the authors present an analysis of the academic response to the disaster that occ…
▽ More
Tracing the evolution of specific topics is a subject area which belongs to the general problem of map** the structure of scientific knowledge. Often bibliometric data bases are used to study the history of scientific topic evolution from its appearance to its extinction or merger with other topics. In this chapter the authors present an analysis of the academic response to the disaster that occurred in 1986 in Chornobyl (Chernobyl), Ukraine, considered as one of the most devastating nuclear power plant accidents in history. Using a bibliographic database the distributions of Chornobyl-related papers in different scientific fields are analysed, as are their growth rates and properties of co-authorship networks. Elements of descriptive statistics and tools of complex-network theory are used to highlight interdisciplinary as well as international effects. In particular, tools of complex-network science enable information visualization complemented by further quantitative analysis. A further goal of the chapter is to provide a simple pedagogical introduction to the application of complex-network analysis for visual data representation and interdisciplinary communication.
△ Less
Submitted 3 July, 2017;
originally announced July 2017.
-
A scientists' view of scientometrics: Not everything that counts can be counted
Authors:
R. Kenna,
O. Mryglod,
B. Berche
Abstract:
Like it or not, attempts to evaluate and monitor the quality of academic research have become increasingly prevalent worldwide. Performance reviews range from at the level of individuals, through research groups and departments, to entire universities. Many of these are informed by, or functions of, simple scientometric indicators and the results of such exercises impact onto careers, funding and…
▽ More
Like it or not, attempts to evaluate and monitor the quality of academic research have become increasingly prevalent worldwide. Performance reviews range from at the level of individuals, through research groups and departments, to entire universities. Many of these are informed by, or functions of, simple scientometric indicators and the results of such exercises impact onto careers, funding and prestige. However, there is sometimes a failure to appreciate that scientometrics are, at best, very blunt instruments and their incorrect usage can be misleading. Rather than accepting the rise and fall of individuals and institutions on the basis of such imprecise measures, calls have been made for indicators be regularly scrutinised and for improvements to the evidence base in this area. It is thus incumbent upon the scientific community, especially the physics, complexity-science and scientometrics communities, to scrutinise metric indicators. Here, we review recent attempts to do this and show that some metrics in widespread use cannot be used as reliable indicators research quality.
△ Less
Submitted 30 March, 2017;
originally announced March 2017.
-
Analyses of a Virtual World
Authors:
Yurij Holovatch,
Olesya Mryglod,
Michael Szell,
Stefan Thurner
Abstract:
We present an overview of a series of results obtained from the analysis of human behavior in a virtual environment. We focus on the massive multiplayer online game (MMOG) Pardus which has a worldwide participant base of more than 400,000 registered players. We provide evidence for striking statistical similarities between social structures and human-action dynamics in the real and virtual worlds.…
▽ More
We present an overview of a series of results obtained from the analysis of human behavior in a virtual environment. We focus on the massive multiplayer online game (MMOG) Pardus which has a worldwide participant base of more than 400,000 registered players. We provide evidence for striking statistical similarities between social structures and human-action dynamics in the real and virtual worlds. In this sense MMOGs provide an extraordinary way for accurate and falsifiable studies of social phenomena. We further discuss possibilities to apply methods and concepts developed in the course of these studies to analyse oral and written narratives.
△ Less
Submitted 3 February, 2016;
originally announced February 2016.
-
Academic research groups: evaluation of their quality and quality of their evaluation
Authors:
Bertrand Berche,
Yurij Holovatch,
Ralph Kenna,
Olesya Mryglod
Abstract:
In recent years, evaluation of the quality of academic research has become an increasingly important and influential business. It determines, often to a large extent, the amount of research funding flowing into universities and similar institutes from governmental agencies and it impacts upon academic careers. Policy makers are becoming increasingly reliant upon, and influenced by, the outcomes of…
▽ More
In recent years, evaluation of the quality of academic research has become an increasingly important and influential business. It determines, often to a large extent, the amount of research funding flowing into universities and similar institutes from governmental agencies and it impacts upon academic careers. Policy makers are becoming increasingly reliant upon, and influenced by, the outcomes of such evaluations. In response, university managers are increasingly attracted to simple indicators as guides to the dynamics of the positions of their various institutions in league tables. However, these league tables are frequently drawn up by inexpert bodies such as newspapers and magazines, using rather arbitrary measures and criteria. Terms such as "critical mass' and "metrics" are often bandied about without proper understanding of what they actually mean. Rather than accepting the rise and fall of universities, departments and individuals on a turbulent sea of arbitrary measures, we suggest it is incumbent upon the scientific community itself to clarify their nature. Here we report on recent attempts to do that by properly defining critical mass and showing how group size influences research quality. We also examine currently predominant metrics and show that these fail as reliable indicators of group research quality.
△ Less
Submitted 26 November, 2015;
originally announced November 2015.
-
Quantifying the evolution of a scientific topic: reaction of the academic community to the Chornobyl disaster
Authors:
Olesya Mryglod,
Yurij Holovatch,
Ralph Kenna,
Bertrand Berche
Abstract:
We analyze the reaction of academic communities to a particular urgent topic which abruptly arises as a scientific problem. To this end, we have chosen the disaster that occurred in 1986 in Chornobyl (Chernobyl), Ukraine, considered as one of the most devastating nuclear power plant accidents in history. The academic response is evaluated using scientific-publication data concerning the disaster u…
▽ More
We analyze the reaction of academic communities to a particular urgent topic which abruptly arises as a scientific problem. To this end, we have chosen the disaster that occurred in 1986 in Chornobyl (Chernobyl), Ukraine, considered as one of the most devastating nuclear power plant accidents in history. The academic response is evaluated using scientific-publication data concerning the disaster using the Scopus database to present the picture on an international scale and the bibliographic database "Ukrainika naukova" to consider it on a national level. We measured distributions of papers in different scientific fields, their growth rates and properties of co-authorship networks. {The elements of descriptive statistics and the tools of the complex network theory are used to highlight the interdisciplinary as well as international effects.} Our analysis allows to compare contributions of the international community to Chornobyl-related research as well as integration of Ukraine in the international research on this subject. Furthermore, the content analysis of titles and abstracts of the publications allowed to detect the most important terms used for description of Chornobyl-related problems.
△ Less
Submitted 18 November, 2015;
originally announced November 2015.
-
Predicting Results of the Research Excellence Framework using Departmental h-Index -- Revisited
Authors:
O. Mryglod,
R. Kenna,
Yu. Holovatch,
B. Berche
Abstract:
We revisit our recent study [Predicting results of the Research Excellence Framework using departmental h-index, Scientometrics, 2014, 1-16; arXiv:1411.1996] in which we attempted to predict outcomes of the UK's Research Excellence Framework (REF~2014) using the so-called departmental $h$-index. Here we report that our predictions failed to anticipate with any accuracy either overall REF outcomes…
▽ More
We revisit our recent study [Predicting results of the Research Excellence Framework using departmental h-index, Scientometrics, 2014, 1-16; arXiv:1411.1996] in which we attempted to predict outcomes of the UK's Research Excellence Framework (REF~2014) using the so-called departmental $h$-index. Here we report that our predictions failed to anticipate with any accuracy either overall REF outcomes or movements of individual institutions in the rankings relative to their positions in the previous Research Assessment Exercise (RAE~2008).
△ Less
Submitted 30 January, 2015;
originally announced January 2015.
-
Predicting results of the Research Excellence Framework using departmental $h$-Index
Authors:
Olesya Mryglod,
Ralph Kenna,
Yurij Holovatch,
Bertrand Berche
Abstract:
We compare estimates for past institutional research performances coming from two bibliometric indicators to the results of the UK's Research Assessment Exercise which last took place in 2008. We demonstrate that a version of the departmental h-index is better correlated with the actual results of that peer-review exercise than a competing metric known as the normalised citation-based indicator. W…
▽ More
We compare estimates for past institutional research performances coming from two bibliometric indicators to the results of the UK's Research Assessment Exercise which last took place in 2008. We demonstrate that a version of the departmental h-index is better correlated with the actual results of that peer-review exercise than a competing metric known as the normalised citation-based indicator. We then determine the corresponding h-indices for 2008-2013, the period examined in the UK's Research Excellence Framework (REF) 2014. We place herewith the resulting predictions on the arXiv in advance of the REF results being published (December 2014). These may be considered as unbiased predictions of relative performances in that exercise. We will revisit this paper after the REF results are available and comment on the reliability or otherwise of these bibliometrics as compared with peer review.
△ Less
Submitted 4 December, 2014; v1 submitted 7 November, 2014;
originally announced November 2014.
-
Is your EPL attractive? Classification of publications through download statistics
Authors:
Olesya Mryglod,
Ralph Kenna,
Yurij Holovatch
Abstract:
Here we consider the download statistics of EPL publications. We find that papers in the journal are characterised by fast accumulations of downloads during the first couple of months after publication, followed by slower rates thereafter, behaviour which can be represented by a model with predictive power. We also find that individual papers can be classified in various ways, allowing us to compa…
▽ More
Here we consider the download statistics of EPL publications. We find that papers in the journal are characterised by fast accumulations of downloads during the first couple of months after publication, followed by slower rates thereafter, behaviour which can be represented by a model with predictive power. We also find that individual papers can be classified in various ways, allowing us to compare categories for open-access and non-open-access papers. For example, for the latter publications, which comprise the bulk of EPL papers, a small proportion (2%) display intense bursts of download activity, possibly following an extended period of less remarkable behaviour. About 18% have an especially high degree of attractiveness over and above what is typical for the journal. One can also classify the ageing of attractiveness by examining download half-lives. Approximately 18% have strong interest initially, waning in time. A further 20% exhibit "delayed recognition" with relatively late spurs in download activity. Although open-access papers enjoy more downloads on average, the proportions falling into each category are similar.
△ Less
Submitted 4 December, 2014; v1 submitted 28 September, 2014;
originally announced September 2014.
-
Interevent time distributions of human multi-level activity in a virtual world
Authors:
Olesya Mryglod,
Benedikt Fuchs,
Michael Szell,
Yurij Holovatch,
Stefan Thurner
Abstract:
Studying human behaviour in virtual environments provides extraordinary opportunities for a quantitative analysis of social phenomena with levels of accuracy that approach those of the natural sciences. In this paper we use records of player activities in the massive multiplayer online game Pardus over 1,238 consecutive days, and analyze dynamical features of sequences of actions of players. We bu…
▽ More
Studying human behaviour in virtual environments provides extraordinary opportunities for a quantitative analysis of social phenomena with levels of accuracy that approach those of the natural sciences. In this paper we use records of player activities in the massive multiplayer online game Pardus over 1,238 consecutive days, and analyze dynamical features of sequences of actions of players. We build on previous work were temporal structures of human actions of the same type were quantified, and extend provide an empirical understanding of human actions of different types. This study of multi-level human activity can be seen as a dynamic counterpart of static multiplex network analysis. We show that the interevent time distributions of actions in the Pardus universe follow highly non-trivial distribution functions, from which we extract action-type specific characteristic "decay constants". We discuss characteristic features of interevent time distributions, including periodic patterns on different time scales, bursty dynamics, and various functional forms on different time scales. We comment on gender differences of players in emotional actions, and find that while male and female act similarly when performing some positive actions, females are slightly faster for negative actions. We also observe effects on the age of players: more experienced players are generally faster in making decisions about engaging and terminating in enmity and friendship, respectively.
△ Less
Submitted 8 July, 2014;
originally announced July 2014.
-
Comparison of a citation-based indicator and peer review for absolute and specific measures of research-group excellence
Authors:
O. Mryglod,
R. Kenna,
Yu. Holovatch,
B. Berche
Abstract:
Many different measures are used to assess academic research excellence and these are subject to ongoing discussion and debate within the scientometric, university-management and policy-making communities internationally. One topic of continued importance is the extent to which citation-based indicators compare with peer-review-based evaluation. Here we analyse the correlations between values of a…
▽ More
Many different measures are used to assess academic research excellence and these are subject to ongoing discussion and debate within the scientometric, university-management and policy-making communities internationally. One topic of continued importance is the extent to which citation-based indicators compare with peer-review-based evaluation. Here we analyse the correlations between values of a particular citation-based impact indicator and peer-review scores in several academic disciplines, from natural to social sciences and humanities. We perform the comparison for research groups rather than for individuals. We make comparisons on two levels. At an absolute level, we compare total impact and overall strength of the group as a whole. At a specific level, we compare academic impact and quality, normalised by the size of the group. We find very high correlations at the former level for some disciplines and poor correlations at the latter level for all disciplines. This means that, although the citation-based scores could help to describe research-group strength, in particular for the so-called hard sciences, they should not be used as a proxy for ranking or comparison of research groups. Moreover, the correlation between peer-evaluated and citation-based scores is weaker for soft sciences.
△ Less
Submitted 27 May, 2013;
originally announced May 2013.
-
Absolute and specific measures of research group excellence
Authors:
O. Mryglod,
R. Kenna,
Yu. Holovatch,
B. Berche
Abstract:
A desirable goal of scientific management is to introduce, if it exists, a simple and reliable way to measure the scientific excellence of publicly-funded research institutions and universities to serve as a basis for their ranking and financing. While citation-based indicators and metrics are easily accessible, they are far from being universally accepted as way to automate or inform evaluation p…
▽ More
A desirable goal of scientific management is to introduce, if it exists, a simple and reliable way to measure the scientific excellence of publicly-funded research institutions and universities to serve as a basis for their ranking and financing. While citation-based indicators and metrics are easily accessible, they are far from being universally accepted as way to automate or inform evaluation processes or to replace evaluations based on peer review. Here we consider absolute measurements of research excellence at an amalgamated, institutional level and specific measures of research excellence as performance per head. Using biology research institutions in the UK as a test case, we examine the correlations between peer-review-based and citation-based measures of research excellence on these two scales. We find that citation-based indicators are very highly correlated with peer-evaluated measures of group strength but are poorly correlated with group quality. Thus, and almost paradoxically, our analysis indicates that citation counts could possibly form a basis for deciding on how to fund research institutions but they should not be used as a basis for ranking them in terms of quality.
△ Less
Submitted 2 October, 2012;
originally announced October 2012.
-
Editorial process in scientific journals: analysis and modeling
Authors:
O. Mryglod,
Yu. Holovatch,
I. Mryglod
Abstract:
The editorial handling of papers in scientific journals as a human activity process is considered. Using recently proposed approaches of human dynamics theory we examine the probability distributions of random variables reflecting the temporal characteristics of studied processes. The first part of this paper contains our results of analysis of the real data about papers published in scientific jo…
▽ More
The editorial handling of papers in scientific journals as a human activity process is considered. Using recently proposed approaches of human dynamics theory we examine the probability distributions of random variables reflecting the temporal characteristics of studied processes. The first part of this paper contains our results of analysis of the real data about papers published in scientific journals. The second part is devoted to modeling of time-series connected with editorial work. The purpose of our work is to present new object that can be studied in terms of human dynamics theory and to corroborate the scientometrical application of the results obtained.
△ Less
Submitted 28 September, 2011;
originally announced September 2011.
-
Analysis of temporal characteristics of the editorial processing in scientific periodicals
Authors:
Olesya Mryglod,
Yurij Holovatch,
Ihor Mryglod
Abstract:
The first part of our work is connected with the analysis of typical random variables for the specific human-initiated process. We study the data characterizing editorial work with received manuscripts in several scientific journals. In such a way we found the waiting time distributions that could be called the typical for an ordinary peer-review scientific journal. In the second part of this stud…
▽ More
The first part of our work is connected with the analysis of typical random variables for the specific human-initiated process. We study the data characterizing editorial work with received manuscripts in several scientific journals. In such a way we found the waiting time distributions that could be called the typical for an ordinary peer-review scientific journal. In the second part of this study a model of editorial processing of received manuscripts is developed. Within the model, different scenarios of the manuscript editorial processing are examined. Combining the results of the quantitative experiment and model simulations we arrive to the set of conclusions about time characteristics of editorial process in scientific journals and a peer-review contribution.
△ Less
Submitted 28 October, 2010;
originally announced October 2010.
-
Intelligent data analysis based on the complex network theory methods: a case study
Authors:
O. Mryglod,
Yu. Holovatch
Abstract:
The development of modern information technologies permits to collect and to analyze huge amounts of statistical data in different spheres of life. The main problem is not to only to collect but to process all relevant information. The purpose of our work is to show the example of intelligent data analysis in such complex and non-formalized field as science. Using the statistical data about scient…
▽ More
The development of modern information technologies permits to collect and to analyze huge amounts of statistical data in different spheres of life. The main problem is not to only to collect but to process all relevant information. The purpose of our work is to show the example of intelligent data analysis in such complex and non-formalized field as science. Using the statistical data about scientific periodical it is possible to perform its comprehensive analysis and to solve different practical problems. The combination of various approaches including the statistical analysis, methods of the complex network theory and different techniques that can be used for the concept map** permits to perform an intelligent data analysis in order to obtain underlying patterns and hidden connections. Results of such analysis can be used for particular practical problems like information retrieval within journal.
△ Less
Submitted 7 July, 2010;
originally announced July 2010.
-
Human activity as the decision-based queueing process: statistical data analysis of waiting times in scientific journals
Authors:
O. Mryglod,
Yu. Holovatch
Abstract:
We consider the editorial processing of papers in scientific journals as a human activity process based on the decision making. A functional form of the probability distributions of random variables describing a human dynamics is studied using classical approaches of mass service systems theory, physics of critical phenomena and statistical methods of data analysis. Our additional goal is to corro…
▽ More
We consider the editorial processing of papers in scientific journals as a human activity process based on the decision making. A functional form of the probability distributions of random variables describing a human dynamics is studied using classical approaches of mass service systems theory, physics of critical phenomena and statistical methods of data analysis. Our additional goal is to corroborate the scientometrical application of the results obtained. Keywords: data analysis, statistics, mass service systems, human activity, scientometrics
△ Less
Submitted 6 July, 2010;
originally announced July 2010.
