-
Does the geographic proximity effect on knowledge spillovers vary across research fields?
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
Policy makers are interested in the influence of geographic distance on knowledge flows, however these can be expected to vary across research fields. The effects of geographic distance on flows are analyzed by means of citations to scientific literature. The field of observation consists of the 2010-2012 Italian publications and relevant citations up to the close of 2017. The geographic proximity…
▽ More
Policy makers are interested in the influence of geographic distance on knowledge flows, however these can be expected to vary across research fields. The effects of geographic distance on flows are analyzed by means of citations to scientific literature. The field of observation consists of the 2010-2012 Italian publications and relevant citations up to the close of 2017. The geographic proximity effect is analyzed at national, continental, and intercontinental level in 244 fields, and results as evident at national level and in some cases at continental level, but not at intercontinental level. For flows between Italian municipalities, citations decrease with distance in all fields. At continental level, four fields are identified having knowledge flows that grow with distance; at intercontinental level, this occurs in 26 fields. The influence of distance is more limited in the fields of Humanities and Social sciences, much more significant in the Sciences, mainly in the Natural sciences.
△ Less
Submitted 26 March, 2021;
originally announced March 2021.
-
Knowledge spillovers: does the geographic proximity effect decay over time? A discipline-level analysis, accounting for cognitive proximity, with and without self-citations
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
This work analyzes the variation over time of the effect of geographic distance on knowledge flows. The flows are measured through the citations exchanged between scientific publications, including and excluding self-citations. To calculate geographic distances between citing and cited publication, each publication is associated with a "prevailing" territory, according to the authors' affiliations…
▽ More
This work analyzes the variation over time of the effect of geographic distance on knowledge flows. The flows are measured through the citations exchanged between scientific publications, including and excluding self-citations. To calculate geographic distances between citing and cited publication, each publication is associated with a "prevailing" territory, according to the authors' affiliations. We then apply a gravity model to account for the research size of the territories, in terms of cognitive proximity of citing-cited publications. The field of observation is the 2010-2017 world publications citing the 2010-2012 Italian publications, as indexed in the Web of Science. The results show that in domestic knowledge flows, geographic proximity remains an influential factor through time, although with differences among disciplines and trends of attenuating effects. Finally, we replicate the analyses of knowledge flows but with the exclusion of self-citations: in this manner the effect of geographic proximity seems reduced, particularly at the national scale, but the differences (with vs without self-citations) lessen through time. As shown in previous works, the effect of distance on continental flows is modest (imperceptible for intercontinental flows), yet here too time has some influence, including concerning exclusion of self-citations.
△ Less
Submitted 25 March, 2021;
originally announced March 2021.
-
On the relation between the degree of internationalization of cited and citing publications: A field level analysis, including and excluding self-citations
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The growing complexity of scientific challenges demands increasingly intense research collaboration, both domestic and international. The resulting trend affects not only the modes of producing new knowledge, but also the way it is disseminated within scientific communities. This paper analyses the relationship between the "degree of internationalization" of a country's scientific production and t…
▽ More
The growing complexity of scientific challenges demands increasingly intense research collaboration, both domestic and international. The resulting trend affects not only the modes of producing new knowledge, but also the way it is disseminated within scientific communities. This paper analyses the relationship between the "degree of internationalization" of a country's scientific production and that of the relevant citing publications. The empirical analysis is based on 2010-2012 Italian publications. Findings show: i) the probability of being cited increases with the degree of internationalization of the research team; ii) totally domestic research teams tend to cite to a greater extent totally domestic publications; iii) vice versa, publications resulting from international collaborations tend to be more cited by totally foreign publications rather than by publications including domestic authors. These results emerge both at overall and at discipline level. Findings might inform research policies geared towards internationalization.
△ Less
Submitted 25 March, 2021;
originally announced March 2021.
-
The role of geographic proximity in knowledge diffusion, measured by citations to scientific literature
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
This paper analyses the influence of geographic distance on knowledge flows, measured through citations to scientific publications. Previous works using the same approach are limited to single disciplines. In this study, we analyse the Italian scientific production in all disciplines matured in the period 2010-2012. To calculate the geographic distances between citing and cited publications, each…
▽ More
This paper analyses the influence of geographic distance on knowledge flows, measured through citations to scientific publications. Previous works using the same approach are limited to single disciplines. In this study, we analyse the Italian scientific production in all disciplines matured in the period 2010-2012. To calculate the geographic distances between citing and cited publications, each one is associated with a "prevalent" territory on the basis of the authors' affiliations. The results of the application of a gravity model, estimated using ordinary least squares regression, show that despite the spread of IT, geographic distance continues to be an influential factor in the process of knowledge flows between territories. In particular, the analysis reveals that the effect of geographic distance on knowledge flows is significant at the national level, not negligible at the continental level, but completely irrelevant at the intercontinental level.
△ Less
Submitted 3 February, 2020;
originally announced February 2020.
-
The collaboration behavior of top scientists
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The intention of this work is to analyze top scientists' collaboration behavior at the "international", "domestic extramural" and "intramural" levels, and compare it to that of their lesser performing colleagues. The field of observation consists of the entire faculty of the Italian academic system, and so the coauthorship of scientific publications by over 12,000 professors. The broader aim is to…
▽ More
The intention of this work is to analyze top scientists' collaboration behavior at the "international", "domestic extramural" and "intramural" levels, and compare it to that of their lesser performing colleagues. The field of observation consists of the entire faculty of the Italian academic system, and so the coauthorship of scientific publications by over 12,000 professors. The broader aim is to improve understanding of the causal nexus between research collaboration and performance. The analysis is thus longitudinal, over two successive five-year periods. Results show a strong increase in the propensity to collaborate at domestic level (both extramural and intramural), however this is less for scientists who remain or become top, than it is for their lower-performing colleagues. In contrast, the increase in international collaboration behavior is greater for scientists who become or remain top than it is for their peers. The increase in productivity by those who acquire top scientist status is due precisely to the greater average impact of the publications achieved in collaboration with foreign colleagues.
△ Less
Submitted 18 September, 2019;
originally announced September 2019.
-
A nation's foreign and domestic professors: which have better research performance? (The Italian case)
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
This work investigates the research performance of foreign faculty in the Italian academic system. Incoming professors compose l'1% of total faculty across the sciences, although with variations by discipline. Their scientific performance measured over 2010-2014 is on average better than that of their Italian colleagues: the greatest difference is for associate professors. Psychology is the discip…
▽ More
This work investigates the research performance of foreign faculty in the Italian academic system. Incoming professors compose l'1% of total faculty across the sciences, although with variations by discipline. Their scientific performance measured over 2010-2014 is on average better than that of their Italian colleagues: the greatest difference is for associate professors. Psychology is the discipline with the greatest concentration of top foreign scientists. However there are notable shares of unproductive foreign professors or of those with mediocre performance. The findings stimulate reflection on issues of national policy concerning attractiveness of the higher education system to skilled people from abroad, given the ongoing heavy Italian brain drain.
△ Less
Submitted 13 September, 2019;
originally announced September 2019.
-
Diversification versus specialization in scientific research: which strategy pays off?
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The current work addresses a theme previously unexplored in the literature: that of whether the results arising from research activity in fields other than the scientist's pri-mary field have greater value than the others. Operationally, the authors proceed by identifying: the scientific production of each researcher under observation; field classifi-cation of the publications; the field containin…
▽ More
The current work addresses a theme previously unexplored in the literature: that of whether the results arising from research activity in fields other than the scientist's pri-mary field have greater value than the others. Operationally, the authors proceed by identifying: the scientific production of each researcher under observation; field classifi-cation of the publications; the field containing the greatest number of the researcher's publications; attribution of value of each publication. The results show that diversifica-tion at the aggregate level does not pay off, although there are some exceptions at the level of individual disciplines. The implications at policy level are notable. Since the in-centive systems of research organizations are based on the impact of scientific output, the scientists concerned could resist engaging in multidisciplinary projects.
△ Less
Submitted 13 September, 2019;
originally announced September 2019.
-
A gender analysis of top scientists' collaboration behavior: evidence from Italy
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
This work analyzes the differences in collaboration behavior between males and females among a particular type of scholars: top scientists, and as compared to non top scientists. The field of observation consists of the Italian academic system and the co-authorships of scientific publications by 11,145 professors. The results obtained from a cross-sectional analysis covering the five-year period 2…
▽ More
This work analyzes the differences in collaboration behavior between males and females among a particular type of scholars: top scientists, and as compared to non top scientists. The field of observation consists of the Italian academic system and the co-authorships of scientific publications by 11,145 professors. The results obtained from a cross-sectional analysis covering the five-year period 2006-2010 show that there are no significant differences in the overall propensity to collaborate in the top scientists of the two genders. At the level of single disciplines there are no differences in collaboration behavior, except in the case of: i) international collaborations, for Mathematics and Chemistry - where the propensity for collaboration is greater for males; and ii) extramural domestic collaborations in Physics, in which it is the females that show greater propensity for collaboration. Because international collaboration is positively correlated to research performance, findings can inform science policy aimed at increasing the representation of female top performers.
△ Less
Submitted 3 June, 2019;
originally announced June 2019.
-
Authorship analysis of specialized vs diversified research output
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The present work investigates the relations between amplitude and type of collaboration (intramural, extramural domestic or international) and output of specialized versus diversified research. By specialized or diversified research, we mean within or beyond the author's dominant research topic. The field of observation is the scientific production over five years from about 23,500 academics. The…
▽ More
The present work investigates the relations between amplitude and type of collaboration (intramural, extramural domestic or international) and output of specialized versus diversified research. By specialized or diversified research, we mean within or beyond the author's dominant research topic. The field of observation is the scientific production over five years from about 23,500 academics. The analyses are conducted at the aggregate and disciplinary level. The results lead to the conclusion that in general, the output of diversified research is no more frequently the fruit of collaboration than is specialized research. At the level of the particular collaboration types, international collaborations weakly underlie the specialized kind of research output; on the contrary, extramural domestic and intramural collaborations are weakly associated with diversified research. While the weakness of association remains, exceptions are observed at the level of the individual disciplines.
△ Less
Submitted 7 May, 2019;
originally announced May 2019.
-
Specialization vs diversification in research activities: the extent, intensity and relatedness of field diversification by individual scientists
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
We investigate whether and in what measure scientists tend to diversify their research activity, and if this tendency varies according to their belonging to different disciplinary areas. We analyze the nature of research diversification along three dimensions: extent of diversification, intensity of diversification, and degree of relatedness of topics in which researchers diversifies. For this pur…
▽ More
We investigate whether and in what measure scientists tend to diversify their research activity, and if this tendency varies according to their belonging to different disciplinary areas. We analyze the nature of research diversification along three dimensions: extent of diversification, intensity of diversification, and degree of relatedness of topics in which researchers diversifies. For this purpose we propose three bibliometric indicators, based on the disciplinary placement of scientific output of individual scientists. The empirical investigation shows that the extent of diversification is lowest for scientists in Mathematics and highest in Chemistry; intensity of diversification is lowest in Earth sciences and highest in Industrial and information engineering; and degree of relatedness is lowest in Earth sciences and highest in Chemistry.
△ Less
Submitted 21 December, 2018;
originally announced December 2018.
-
Identifying interdisciplinarity through the disciplinary classification of co-authors of scientific publications
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The growing complexity of challenges involved in scientific progress demands ever more frequent application of competencies and knowledge from different scientific fields. The present work analyzes the degree of collaboration among scientists from different disciplines in order to identify the most frequent "combinations of knowledge" in research activity. The methodology adopts an innovative bibl…
▽ More
The growing complexity of challenges involved in scientific progress demands ever more frequent application of competencies and knowledge from different scientific fields. The present work analyzes the degree of collaboration among scientists from different disciplines in order to identify the most frequent "combinations of knowledge" in research activity. The methodology adopts an innovative bibliometric approach based on the disciplinary affiliation of publication co-authors. The field of observation includes all publications (173,134) indexed in the Science Citation Index Expanded (SCI-E) for the five years 2004-2008, authored by all scientists in the hard sciences (43,223) at Italian universities (68). The analysis examines 205 research fields grouped in nine disciplines. Identifying the fields with the highest potential of interdisciplinary collaboration is useful to inform research polices at national and regional levels, as well as management strategies at the institutional level.
△ Less
Submitted 21 December, 2018;
originally announced December 2018.
-
A new bibliometric approach to assess the scientific specialization of regions
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The objective of the current work is to identify the territorial scientific specializations present in Italy, at the levels of regions and provinces (NUTS2 and NUTS3). To do this, we take a bibliometric approach based on the scientific production of the entire public research system in the hard sciences sphere, for the five years 2006-2010. In particular, we apply a new index of scientific special…
▽ More
The objective of the current work is to identify the territorial scientific specializations present in Italy, at the levels of regions and provinces (NUTS2 and NUTS3). To do this, we take a bibliometric approach based on the scientific production of the entire public research system in the hard sciences sphere, for the five years 2006-2010. In particular, we apply a new index of scientific specialization (Scientific Specialization Index, SSI) that takes account of both the quantity and quality of scientific production achieved by the research institutions of a given territory.
△ Less
Submitted 20 December, 2018;
originally announced December 2018.
-
Research collaboration and productivity: is there correlation?
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The incidence of extramural collaboration in academic research activities is increasing as a result of various factors. These factors include policy measures aimed at fostering partnership and networking among the various components of the research system, policies which are in turn justified by the idea that knowledge sharing could increase the effectiveness of the system. Over the last two decad…
▽ More
The incidence of extramural collaboration in academic research activities is increasing as a result of various factors. These factors include policy measures aimed at fostering partnership and networking among the various components of the research system, policies which are in turn justified by the idea that knowledge sharing could increase the effectiveness of the system. Over the last two decades, the scientific community has also stepped up activities to assess the actual impact of collaboration intensity on the performance of research systems. This study draws on a number of empirical analyses, with the intention of measuring the effects of extramural collaboration on research performance and, indirectly, verifying the legitimacy of policies that support this type of collaboration. The analysis focuses on the Italian academic research system. The aim of the work is to assess the level of correlation, at institutional level, between scientific productivity and collaboration intensity as a whole, both internationally and with private organizations. This will be carried out using a bibliometric type of approach, which equates collaboration with the co-authorship of scientific publications.
△ Less
Submitted 19 December, 2018;
originally announced December 2018.
-
Map** excellence in national research systems: the case of Italy
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The study of the concept of "scientific excellence" and the methods for its measurement and evaluation is taking on increasing importance in the development of research policies in many nations. However, scientific excellence results as difficult to define in both conceptual and operational terms, because of its multi-dimensional and highly complex character. The literature on the theme is limited…
▽ More
The study of the concept of "scientific excellence" and the methods for its measurement and evaluation is taking on increasing importance in the development of research policies in many nations. However, scientific excellence results as difficult to define in both conceptual and operational terms, because of its multi-dimensional and highly complex character. The literature on the theme is limited to few studies of an almost pioneering character. This work intends to contribute to the state of the art by exploring a bibliometric methodology which is effective, simple and inexpensive, and which further identifies "excellent" centers of research by beginning from excellence of the individual researchers affiliated with such centers. The study concentrates on the specific case of public research organizations in Italy, analyzing 109 scientific categories of research in the so called "hard" sciences and identifying 157 centers of excellence operating in 60 of these categories. The findings from this first application of the methodology should be considered exploratory and indicative. With a longer period of observation and the addition of further measurements, making the methodology more robust, it can be extended and adapted to a variety of national and supranational contexts, aiding with policy decisions at various levels.
△ Less
Submitted 19 December, 2018;
originally announced December 2018.
-
University-industry collaboration in Italy: a bibliometric examination
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa,
Marco Solazzi
Abstract:
This work investigates public-private research collaboration between Italian universities and domestic industry, applying a bibliometric type of approach. The study is based on an exhaustive listing of all co-authored publications in international journals that are jointly realized by Italian university scientists and researchers in the private sector: this listing permits the development of a nat…
▽ More
This work investigates public-private research collaboration between Italian universities and domestic industry, applying a bibliometric type of approach. The study is based on an exhaustive listing of all co-authored publications in international journals that are jointly realized by Italian university scientists and researchers in the private sector: this listing permits the development of a national map** system for public-private collaboration, which results unique for its extensive and representative character. It is shown that, in absolute terms, most collaborations occur in medicine and chemistry, while it is industrial and information engineering which shows the highest percentage of co-authored articles out of all articles in the field. In addition, the investigation empirically examines and tests several hypotheses concerning the qualitative-quantitative impact of collaboration on the scientific production of individual university researchers. The analyses demonstrate that university researchers who collaborate with those in the private sector show research performance that is superior to that of colleagues who are not involved in such collaboration. But the impact factor of journals publishing academic articles co-authored by industry is generally lower than that concerning co-authorships with other entities. Finally, a further specific elaboration also reveals that publications with public-private co-authorship do not show a level of multidisciplinarity that is significantly different than that of other publications.
△ Less
Submitted 21 November, 2018;
originally announced November 2018.
-
Testing the trade-off between productivity and quality in research activities
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
In recent years there has been an increasingly pressing need for the evaluation of results from public sector research activity, particularly to permit the efficient allocation of ever scarcer resources. Many of the studies and evaluation exercises that have been conducted at the national and international level emphasize the quality dimension of research output, while neglecting that of productiv…
▽ More
In recent years there has been an increasingly pressing need for the evaluation of results from public sector research activity, particularly to permit the efficient allocation of ever scarcer resources. Many of the studies and evaluation exercises that have been conducted at the national and international level emphasize the quality dimension of research output, while neglecting that of productivity. This work is intended to test for the possible existence of correlation between quantity and quality of scientific production and determine whether the most productive researchers are also those that achieve results that are qualitatively better than those of their colleagues. The analysis proposed refers to the entire Italian university system and is based on the observation of production in the hard sciences by above 26,000 researchers in the period 2001 to 2005. The results show that the output of more productive researchers is superior in quality than that of less productive researchers. The relation between productivity and quality results as largely insensitive to the types of indicators or the test methods applied and also seems to differ little among the various disciplines examined.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
Citations versus journal impact factor as proxy of quality: Could the latter ever be preferable?
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
In recent years bibliometricians have paid increasing attention to research evaluation methodological problems, among these being the choice of the most appropriate indicators for evaluating quality of scientific publications, and thus for evaluating the work of single scientists, research groups and entire organizations. Much literature has been devoted to analyzing the robustness of various indi…
▽ More
In recent years bibliometricians have paid increasing attention to research evaluation methodological problems, among these being the choice of the most appropriate indicators for evaluating quality of scientific publications, and thus for evaluating the work of single scientists, research groups and entire organizations. Much literature has been devoted to analyzing the robustness of various indicators, and many works warn against the risks of using easily available and relatively simple proxies, such as journal impact factor. The present work continues this line of research, examining whether it is valid that the use of the impact factor should always be avoided in favour of citations, or whether the use of impact factor could be acceptable, even preferable, in certain circumstances. The evaluation was conducted by observing all scientific publications in the hard sciences by Italian universities, for the period 2004-2007. Performance sensitivity analyses were conducted with changing indicators of quality and years of observation.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
The role of information asymmetry in the market for university-industry research collaboration
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa,
Marco Solazzi
Abstract:
This study concerns the market for research collaboration between industry and universities. It presents an analysis of the population of all Italian university-industry collaborations that resulted in at least one international scientific publication between 2001 and 2003. Using spatial and bibliometric analysis relating to scientific output of university researchers, the study shows the importan…
▽ More
This study concerns the market for research collaboration between industry and universities. It presents an analysis of the population of all Italian university-industry collaborations that resulted in at least one international scientific publication between 2001 and 2003. Using spatial and bibliometric analysis relating to scientific output of university researchers, the study shows the importance of geographic proximity in companies' choices of university partner. The analysis also reveals inefficiency in the market: in a large proportion of cases private companies could have chosen more qualified research partners in universities located closer to the place of business.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
A national-scale cross-time analysis of university research performance
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
Research policies in the more developed nations are ever more oriented towards the introduction of productivity incentives and competition mechanisms intended to increase efficiency in research institutions. Assessments of the effects of these policy interventions on public research activity often neglect the normal, inherent variation in the performance of research institutions over time. In this…
▽ More
Research policies in the more developed nations are ever more oriented towards the introduction of productivity incentives and competition mechanisms intended to increase efficiency in research institutions. Assessments of the effects of these policy interventions on public research activity often neglect the normal, inherent variation in the performance of research institutions over time. In this work, we propose a cross-time bibliometric analysis of research performance by all Italian universities in two consecutive periods (2001-2003 and 2004-2008) not affected by national policy interventions. Findings show that productivity and impact increased at the level of individual scientists. At the level of university, significant variation in the rank was observed.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
University-industry research collaboration: a model to assess university capability
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
Scholars and policy makers recognize that collaboration between industry and the public research institutions is a necessity for innovation and national economic development. This work presents an econometric model which expresses the university capability for collaboration with industry as a function of size, location and research quality. The field of observation is made of the census of 2001-20…
▽ More
Scholars and policy makers recognize that collaboration between industry and the public research institutions is a necessity for innovation and national economic development. This work presents an econometric model which expresses the university capability for collaboration with industry as a function of size, location and research quality. The field of observation is made of the census of 2001-2003 scientific articles in the hard sciences, co-authored by universities and private enterprises located in Italy. The analysis shows that research quality of universities has an impact higher than geographic distance on the capability for collaborating with industry. The model proposed and the measures that descend from it are suited for use at various levels of administration, to assist in realizing the "third role" of universities: the contribution to socio-economic development through public to private technology transfer.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
National research assessment exercises: the effects of changing the rules of the game during the game
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
National research evaluation exercises provide a comparative measure of research performance of the nation's institutions, and as such represent a tool for stimulating research productivity, particularly if the results are used to inform selective funding by government. While a school of thought welcomes frequent changes in evaluation criteria in order to prevent the subjects evaluated from adopti…
▽ More
National research evaluation exercises provide a comparative measure of research performance of the nation's institutions, and as such represent a tool for stimulating research productivity, particularly if the results are used to inform selective funding by government. While a school of thought welcomes frequent changes in evaluation criteria in order to prevent the subjects evaluated from adopting opportunistic behaviors, it is evident that the "rules of the game" should above all be functional towards policy objectives, and therefore be known with adequate forewarning prior to the evaluation period. Otherwise, the risk is that policy-makers will find themselves faced by a dilemma: should they reward universities that responded best to the criteria in effect at the outset of the observation period or those that result as best according to rules that emerged during or after the observation period? This study verifies if and to what extent some universities are penalized instead of rewarded for good behavior, in pursuit of the objectives of the "known" rules of the game, by comparing the research performances of Italian universities for the period of the nation's next evaluation exercise (2004-2008): first as measured according to criteria available at the outset of the period and next according to those announced at the end of the period.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
Research productivity: are higher academic ranks more productive than lower ones?
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
This work analyses the links between individual research performance and academic rank. A typical bibliometric methodology is used to study the performance of all Italian university researchers active in the hard sciences, for the period 2004-2008. The objective is to characterize the performance of the ranks of full, associate and assistant professors, along various dimensions, in order to verify…
▽ More
This work analyses the links between individual research performance and academic rank. A typical bibliometric methodology is used to study the performance of all Italian university researchers active in the hard sciences, for the period 2004-2008. The objective is to characterize the performance of the ranks of full, associate and assistant professors, along various dimensions, in order to verify the existence of performance differences among the ranks in general and for single disciplines.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
National research assessment exercises: a comparison of peer review and bibliometrics rankings
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
Development of bibliometric techniques has reached such a level as to suggest their integration or total substitution for classic peer review in the national research assessment exercises, as far as the hard sciences are concerned. In this work we compare rankings lists of universities captured by the first Italian evaluation exercise, through peer review, with the results of bibliometric simulati…
▽ More
Development of bibliometric techniques has reached such a level as to suggest their integration or total substitution for classic peer review in the national research assessment exercises, as far as the hard sciences are concerned. In this work we compare rankings lists of universities captured by the first Italian evaluation exercise, through peer review, with the results of bibliometric simulations. The comparison shows the great differences between peer review and bibliometric rankings for excellence and productivity.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
A new approach to measure the scientific strengths of territories
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The current work applies a methodology for map** the supply of new knowledge from public research organizations, in this case from Italian institutions at the level of regions and provinces (NUTS2 and NUTS3). Through the analysis of scientific production indexed in the Web of Science for the period 2006-2010, the new knowledge is classified in subject categories and mapped according to an algori…
▽ More
The current work applies a methodology for map** the supply of new knowledge from public research organizations, in this case from Italian institutions at the level of regions and provinces (NUTS2 and NUTS3). Through the analysis of scientific production indexed in the Web of Science for the period 2006-2010, the new knowledge is classified in subject categories and mapped according to an algorithm for the reconciliation of authors' affiliations. Unlike other studies in the literature based on simple counting of publications, the present study adopts an indicator, Scientific Strength, which takes account of both the quantity of scientific production and its impact on the advancement of knowledge. The differences in the results that arise from the two approaches are examined. The results of works of this kind can inform public research policies, at national and local levels, as well as the localization strategies of research-based companies.
△ Less
Submitted 31 October, 2018;
originally announced October 2018.
-
When research assessment exercises leave room for opportunistic behavior by the subjects under evaluation
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
This study inserts in the stream of research on the perverse effects that PBRF systems can induce in the subjects evaluated. The authors' opinion is that more often than not, it is the doubtful scientific basis of the evaluation criteria that leave room for opportunistic behaviors. The work examines the 2004-2010 Italian national research assessment (VQR) to verify possible opportunistic behavior…
▽ More
This study inserts in the stream of research on the perverse effects that PBRF systems can induce in the subjects evaluated. The authors' opinion is that more often than not, it is the doubtful scientific basis of the evaluation criteria that leave room for opportunistic behaviors. The work examines the 2004-2010 Italian national research assessment (VQR) to verify possible opportunistic behavior by universities in order to limit the penalization of their performance (and funding) due to the presence of scientifically unproductive professors in faculty. In particular, institutions may have favored "gift authorship" practices. The analysis thus focuses on the output of professors who were unproductive in the VQR publication window, but became productive ("new productives") in the following five years: a number of universities show a remarkably higher than average share of publications by new productives that are in co-authorship exclusively with colleagues from the same university.
△ Less
Submitted 31 October, 2018;
originally announced October 2018.
-
Variability of research performance across disciplines within universities in non-competitive higher education systems
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
Many nations are adopting higher education strategies that emphasize the development of elite universities able to compete at the international level in the attraction of skills and resources. Elite universities pursue excellence in all their disciplines and fields of action. The impression is that this does not occur in "non-competitive" education systems, and that instead, within single universi…
▽ More
Many nations are adopting higher education strategies that emphasize the development of elite universities able to compete at the international level in the attraction of skills and resources. Elite universities pursue excellence in all their disciplines and fields of action. The impression is that this does not occur in "non-competitive" education systems, and that instead, within single universities excellent disciplines will coexist with mediocre ones. To test this, the authors measure research productivity in the hard sciences for all Italian universities over the period 2004-2008 at the levels of the institution, their individual disciplines and fields within them. The results show that the distribution of excellent disciplines is not concentrated in a few universities: top universities show disciplines and fields that are often mediocre, while generally mediocre universities will often include top disciplines.
△ Less
Submitted 30 October, 2018;
originally announced October 2018.
-
Inefficiency in selecting products for submission to national research assessment exercises
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
One of the critical issues in national research assessment exercises concerns the choice of whether to evaluate the entire scientific portfolio of the institutions or a subset composed of the best products. Under the second option, the capacities of the institutions to select the appropriate researchers and their best products (the UK case) or simply the best products of every researcher (the Ital…
▽ More
One of the critical issues in national research assessment exercises concerns the choice of whether to evaluate the entire scientific portfolio of the institutions or a subset composed of the best products. Under the second option, the capacities of the institutions to select the appropriate researchers and their best products (the UK case) or simply the best products of every researcher (the Italian case) becomes critical, both for purposes of correct assessment of the real quality of research in the institutions evaluated, and for the selective funding that follows. In this work, through case studies of three Italian universities, we analyze the efficiency of the product selection that is intended to maximize the universities' scores in the current national research assessment exercise, the results of which will be the basis for assigning an important share of public financing over the coming years.
△ Less
Submitted 30 October, 2018;
originally announced October 2018.
-
The effect of a country's name in the title of a publication on its visibility and citability
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The objective of this research is to determine if the reference to a country in the title, keywords or abstract of a publication can influence its visibility (measured by the impact factor of the publishing journal) and citability (measured by the citations received). The study is based on Italian scientific production indexed in the Web of Science over the period 2004-2011. The analysis is conduc…
▽ More
The objective of this research is to determine if the reference to a country in the title, keywords or abstract of a publication can influence its visibility (measured by the impact factor of the publishing journal) and citability (measured by the citations received). The study is based on Italian scientific production indexed in the Web of Science over the period 2004-2011. The analysis is conducted by comparing the values of four impact indicators for two subsets: i) the indexed publications with a country's name in the title, keywords or abstract; ii) the remainder of the population, with no country' name. The results obtained both at the general level and by subject category show that publications with a country name systematically receive lower impact values, with the exception of a limited number of subject categories, Also, the incidence of highly-cited articles is lower for the first subset.
△ Less
Submitted 30 October, 2018;
originally announced October 2018.
-
Do interdisciplinary research teams deliver higher gains to science?
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
The present paper takes its place in the stream of studies that analyze the effect of interdisciplinarity on the impact of research output. Unlike previous studies, in this study the interdisciplinarity of the publications is not inferred through their citing or cited references, but rather by identifying the authors' designated fields of research. For this we draw on the scientific classification…
▽ More
The present paper takes its place in the stream of studies that analyze the effect of interdisciplinarity on the impact of research output. Unlike previous studies, in this study the interdisciplinarity of the publications is not inferred through their citing or cited references, but rather by identifying the authors' designated fields of research. For this we draw on the scientific classification of Italian academics, and their publications as indexed in the WoS over a five-year period (2004-2008). We divide the publications in three subsets on the basis the nature of co-authorship: those papers coauthored with academics from different fields, which show high intensity of inter-field collaboration ("specific" collaboration, occurring in 110 pairings of fields); those papers coauthored with academics who are simply from different "non-specific" fields; and finally co-authorships within a single field. We then compare the citations of the papers and the impact factor of the publishing journals between the three subsets. The results show significant differences, generally in favor of the interdisciplinary authorships, in only one third (or slightly more) of the cases. The analysis provides the value of the median differences for each pair of publication subsets.
△ Less
Submitted 30 October, 2018;
originally announced October 2018.
-
The effects of gender, age and academic rank on research diversification
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
In this work we analyze the combined effects of gender, age and academic rank on the propensity of individual scholars to diversify their scientific activity. The aspect of research diversification is measured along three main dimensions, namely its extent and intensity and the cognitive relatedness of the fields of diversification. We apply two regression models to the dataset of scientific outpu…
▽ More
In this work we analyze the combined effects of gender, age and academic rank on the propensity of individual scholars to diversify their scientific activity. The aspect of research diversification is measured along three main dimensions, namely its extent and intensity and the cognitive relatedness of the fields of diversification. We apply two regression models to the dataset of scientific output of all Italian professors in the sciences over the period 2004-2008. The aim is to understand how personal and organizational traits can influence individual behaviors in terms of research diversification. Among other considerations, our findings urge caution in identifying research diversification as a co-determinant of the gender productivity gap between males and females.
△ Less
Submitted 30 October, 2018;
originally announced October 2018.
-
The effect of multidisciplinary collaborations on research diversification
Authors:
Giovanni Abramo,
Ciriaco Andrea D'Angelo,
Flavia Di Costa
Abstract:
This work verifies whether research diversification by a scientist is in some measure related to their collaboration with multidisciplinary teams. The analysis considers the publications achieved by 5300 Italian academics in the sciences over the period 2004-2008. The findings show that a scientist's outputs resulting from research diversification are more often than not the result of collaboratio…
▽ More
This work verifies whether research diversification by a scientist is in some measure related to their collaboration with multidisciplinary teams. The analysis considers the publications achieved by 5300 Italian academics in the sciences over the period 2004-2008. The findings show that a scientist's outputs resulting from research diversification are more often than not the result of collaborations with multidisciplinary teams. The effect becomes more pronounced with larger and particularly with more diversified teams. This phenomenon is observed both at the overall level and for the disciplinary macro-areas.
△ Less
Submitted 30 October, 2018;
originally announced October 2018.
