arXiv subjects

Ciriaco Andrea D'Angelo

Publications and source records attributed to Ciriaco Andrea D'Angelo.

At least 55 records · Page 3Linked to original sources

arXiv2018

Measuring science: irresistible temptations, easy shortcuts and dangerous consequences

In benchmarking international research, although publication and citation analyses should not be used to compare different disciplines, scientometrists frequently fail to resist the temptation to present rankings based on total publications and citations. Such measures are affected by significant distortions, due to the uneven fertility across scientific disciplines and the dishomogeneity of scientific specialisation among nations and universities. In this paper, we provide an indication of the extent of the distortions when comparative bibliometric analyses fail to recognise the range of levels of scientific fertility, not only within a given major disciplinary area but also within the different scientific disciplines encompassed by the same area.

cs.DL↗

arXiv2018

Identifying interdisciplinarity through the disciplinary classification of co-authors of scientific publications

The growing complexity of challenges involved in scientific progress demands ever more frequent application of competencies and knowledge from different scientific fields. The present work analyzes the degree of collaboration among scientists from different disciplines in order to identify the most frequent "combinations of knowledge" in research activity. The methodology adopts an innovative bibliometric approach based on the disciplinary affiliation of publication co-authors. The field of observation includes all publications (173,134) indexed in the Science Citation Index Expanded (SCI-E) for the five years 2004-2008, authored by all scientists in the hard sciences (43,223) at Italian universities (68). The analysis examines 205 research fields grouped in nine disciplines. Identifying the fields with the highest potential of interdisciplinary collaboration is useful to inform research polices at national and regional levels, as well as management strategies at the institutional level.

cs.DL↗

arXiv2018

Gender bias in academic recruitment

It is well known that women are underrepresented in the academic systems of many countries. Gender discrimination is one of the factors that could contribute to this phenomenon. This study considers a recent national academic recruitment campaign in Italy, examining whether women are subject to more or less bias than men. The findings show that no gender-related differences occur among the candidates who benefit from positive bias, while among those candidates affected by negative bias, the incidence of women is lower than that of men. Among the factors that determine success in a competition for an academic position, the number of the applicant's career years in the same university as the committee members assumes greater weight for male candidates than for females. Being of the same gender as the committee president is also a factor that assumes greater weight for male applicants. On the other hand, for female applicants, the presence of a full professor in the same university with the same family name as the candidate assumes greater weight than for male candidates.

cs.DL↗

arXiv2018

Specialization vs diversification in research activities: the extent, intensity and relatedness of field diversification by individual scientists

We investigate whether and in what measure scientists tend to diversify their research activity, and if this tendency varies according to their belonging to different disciplinary areas. We analyze the nature of research diversification along three dimensions: extent of diversification, intensity of diversification, and degree of relatedness of topics in which researchers diversifies. For this purpose we propose three bibliometric indicators, based on the disciplinary placement of scientific output of individual scientists. The empirical investigation shows that the extent of diversification is lowest for scientists in Mathematics and highest in Chemistry; intensity of diversification is lowest in Earth sciences and highest in Industrial and information engineering; and degree of relatedness is lowest in Earth sciences and highest in Chemistry.

cs.DL↗

arXiv2018

The alignment of public research supply and industry demand for effective technology transfer: the case of Italy

Italy lags quite behind vis-a'-vis other industrialized countries, in public to private technology transfer. One of the possible causes might be the mismatch between new knowledge supplied by public research and industry demand. We test this hypothesis through a survey of leading public research scientists in four high-tech sectors. The findings show that most research project results seem to be of immediate industrial interest, which contrasts with the low patent and licensing performances of Italian public research institutions. For one third of all the results of the research, there are no Italian companies able to exploit them. The same, however, is not true for the remaining results, which shows that the misalignment between public supply and industry demand alone cannot account for poor technology transfer. What emerges from our investigation is that a closer coordination of research policy and industrial policy is required, as well as closer attention to initiatives which may support the transfer of public research results to domestic industry.

cs.DL↗

arXiv2018

A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments

National exercises for the evaluation of research activity by universities are becoming regular practice in ever more countries. These exercises have mainly been conducted through the application of peer-review methods. Bibliometrics has not been able to offer a valid large-scale alternative because of almost overwhelming difficulties in identifying the true author of each publication. We will address this problem by presenting a heuristic approach to author name disambiguation in bibliometric datasets for large-scale research assessments. The application proposed concerns the Italian university system, consisting of 80 universities and a research staff of over 60,000 scientists. The key advantage of the proposed approach is the ease of implementation. The algorithms are of practical application and have considerably better scalability and expandability properties than state-of-the-art unsupervised approaches. Moreover, the performance in terms of precision and recall, which can be further improved, seems thoroughly adequate for the typical needs of large-scale bibliometric research assessments.

cs.DL↗

arXiv2018

Assessing the accuracy of the h and g indexes for measuring researchers' productivity

Bibliometric indicators are increasingly used in support of decisions for recruitment, career advancement, rewarding and selective funding for scientists. Given the importance of the applications, bibliometricians are obligated to carry out empirical testing of the robustness of the indicators, in simulations of real contexts. In this work we compare the results of national-scale research assessments at the individual level, based on three different indexes: the h-index, g-index and "fractional scientific strength", or FSS, an indicator previously proposed by the authors. For each index, we construct and compare rankings lists of all Italian academic researchers working in the hard sciences over the period 2001-2005. The analysis quantifies the shifts in ranks that occur when researchers' productivity rankings by simple indicators such as h- or g-index are compared with that by more accurate FSS.

cs.DL↗

arXiv2018

The measurement of italian universities' research productivity by a non parametric-bibliometric methodology

This paper presents a methodology for measuring the technical efficiency of research activities. It is based on the application of data envelopment analysis to bibliometric data on the Italian university system. For that purpose, different input values (research personnel by level and extra funding) and output values (quantity, quality and level of contribution to actual scientific publications) are considered. Our study aims at overcoming some of the limitations connected to the methodologies that have so far been proposed in the literature, in particular by surveying the scientific production of universities by authors' name.

cs.DL↗

arXiv2018

The collaboration behaviors of scientists in Italy: a field level analysis

The analysis of research collaboration by field is traditionally conducted beginning with the classification of the publications from the context of interest. In this work we propose an alternative approach based on the classification of the authors by field. The proposed method is more precise if the intended use is to provide a benchmark for the evaluation of individual propensity to collaborate. In the current study we apply the new methodology to all Italian university researchers in the hard sciences, measuring the propensity to collaborate for the various fields: in general, and specifically with intramural colleagues, extramural domestic and extramural foreign organizations. Using a simulation, we show that the results present substantial differences from those obtained through application of traditional approaches.

cs.DL↗

arXiv2018

Individual research performance: a proposal for comparing apples to oranges

The evaluation of performance at the individual level is of fundamental importance in informing management decisions. The literature provides various indicators and types of measures, however a problem that is still unresolved and little addressed is how to compare the performance of researchers working in different fields (apples to oranges). In this work we propose a solution, testing various scaling factors for the distributions of research productivity in 174 scientific fields. The analysis is based on the observation of scientific production by all Italian university researchers active in the hard sciences over the period 2004-2008, as indexed by the Web of Science. The most effective scaling factor is the average of the productivity distribution of researchers with productivity above zero.

cs.DL↗

arXiv2018

A new bibliometric approach to assess the scientific specialization of regions

The objective of the current work is to identify the territorial scientific specializations present in Italy, at the levels of regions and provinces (NUTS2 and NUTS3). To do this, we take a bibliometric approach based on the scientific production of the entire public research system in the hard sciences sphere, for the five years 2006-2010. In particular, we apply a new index of scientific specialization (Scientific Specialization Index, SSI) that takes account of both the quantity and quality of scientific production achieved by the research institutions of a given territory.

cs.DL↗

arXiv2018

Research collaboration and productivity: is there correlation?

The incidence of extramural collaboration in academic research activities is increasing as a result of various factors. These factors include policy measures aimed at fostering partnership and networking among the various components of the research system, policies which are in turn justified by the idea that knowledge sharing could increase the effectiveness of the system. Over the last two decades, the scientific community has also stepped up activities to assess the actual impact of collaboration intensity on the performance of research systems. This study draws on a number of empirical analyses, with the intention of measuring the effects of extramural collaboration on research performance and, indirectly, verifying the legitimacy of policies that support this type of collaboration. The analysis focuses on the Italian academic research system. The aim of the work is to assess the level of correlation, at institutional level, between scientific productivity and collaboration intensity as a whole, both internationally and with private organizations. This will be carried out using a bibliometric type of approach, which equates collaboration with the co-authorship of scientific publications.

cs.DL↗

arXiv2018

Gender differences in research productivity: a bibliometric analysis of the Italian academic system

The literature dedicated to analysis of the difference in research productivity between the sexes tends to agree in indicating better performance for men. This study enters in the vein of work on the subject. Through bibliometric examination of the entire population of research personnel working in the scientific-technological disciplines of Italian university system, it confirms the presence of significant differences in productivity between men and women. But such differences result as being smaller than reported in a large part of the literature, confirming an ongoing tendency towards decline, and are also seen as more noticeable for quantitative performance indicators than other indicators. The gap between the sexes presents important sectorial specificities. In spite of the generally better performance of men, it can not be ignored that there are a significant number of scientific sectors in which the performance of women does not result as inferior.

cs.DL↗

arXiv2018

Allocative efficiency in public research funding:can bibliometrics help?

The use of outcome control modes of research evaluation exercises is ever more frequent. They are conceived as tools to stimulate increased levels of research productivity, and to guide choices in allocating components of government research budgets for publicly funded institutions. There are several contributions in the literature that compare the different methodological approaches that policy makers could adopt for these exercises, however the comparisons are limited to only a few disciplines. This work, examining the case of the whole of the "hard sciences" of the Italian academic system, makes a comparison between results obtained from peer review type of evaluations (as adopted by the Ministry of Universities and Research) and those possible from a bibliometric approach (as developed by the authors). The aim is to understand to what extent bibliometric methodology, which is noted as relatively inexpensive, time-saving and exhaustive, can complement and integrate peer review methodology in research evaluation.

cs.DL↗

arXiv2018

Mapping excellence in national research systems: the case of Italy

The study of the concept of "scientific excellence" and the methods for its measurement and evaluation is taking on increasing importance in the development of research policies in many nations. However, scientific excellence results as difficult to define in both conceptual and operational terms, because of its multi-dimensional and highly complex character. The literature on the theme is limited to few studies of an almost pioneering character. This work intends to contribute to the state of the art by exploring a bibliometric methodology which is effective, simple and inexpensive, and which further identifies "excellent" centers of research by beginning from excellence of the individual researchers affiliated with such centers. The study concentrates on the specific case of public research organizations in Italy, analyzing 109 scientific categories of research in the so called "hard" sciences and identifying 157 centers of excellence operating in 60 of these categories. The findings from this first application of the methodology should be considered exploratory and indicative. With a longer period of observation and the addition of further measurements, making the methodology more robust, it can be extended and adapted to a variety of national and supranational contexts, aiding with policy decisions at various levels.

cs.DL↗

arXiv2018

Assessing technical and cost efficiency of research activities: A case study of the Italian university system

This paper employs data envelopment analysis (DEA) to assess both technical and cost efficiency of research activities of the Italian university system. Differently from both peer review and the top-down discipline-invariant bibliographic approaches used elsewhere, a bottom-up bibliometric methodology is applied. Publications are assigned first to authors and then to one of nine scientific and technical university disciplinary areas. Inputs are specified in terms of the numbers of full, associate and assistant professors and outputs as the number of publications, contributions to publications and their scientific impact as variously measured across the disciplines included. DEA is undertaken cross-sectionally using the averages of these inputs and outputs over the period 2001-2003. The results typically show much variation in the rankings of the disciplinary areas within and across universities, depending on the efficiency indicator employed.

cs.DL↗

arXiv2018

A Decision Support System for Public Research Organizations Participating in National Research Assessment Exercises

We are witnessing a rapid trend towards the adoption of exercises for evaluation of national research systems, generally based on the peer review approach. They respond to two main needs: stimulating higher efficiency in research activities by public laboratories, and realizing better allocative efficiency in government funding of such institutions. However the peer review approach is typified by several limitations that raise doubts for the achievement of the ultimate objectives. In particular, subjectivity of judgment, which occurs during the step of selecting research outputs to be submitted for the evaluations, risks heavily distorting both the final ratings of the organizations evaluated and the ultimate funding they receive. These distortions become ever more relevant if the evaluation is limited to small samples of the scientific production of the research institutions. The objective of the current study is to propose a quantitative methodology based on bibliometric data that would provide a reliable support for the process of selecting the best products of a laboratory, and thus limit distortions. Benefits are twofold: single research institutions can maximize the probability of receiving a fair evaluation coherent with the real quality of their research. At the same time, broader adoptions of this approach could also provide strong advantages at the macroeconomic level, since it guarantees financial allocations based on the real value of the institutions under evaluation. In this study, the proposed methodology has been applied to the hard science sectors of the Italian university research system for the period 2004-2006.

cs.DL↗

arXiv2018

The contribution of star scientists to overall sex differences in research productivity

The state of the art on the issue of sex differences in research efficiency agrees in recognizing higher performances for males, however there are divergences in explaining the possible causes. One of the causes advanced is that there are sex differences in the availability of aptitude at the "high end". By comparing sex differences in concentration and performance of Italian academic star scientists to the case in the population complement, this work aims to verify if star, or "high-end", scientists play a preponderant role in determining higher performance among males. The study reveals the existence of a greater relative concentration of males among star scientists, as well as a performance gap between male and female star scientists that is greater than for the rest of the population. In the latter subpopulation the performance gap between the two sexs is seen as truly marginal.

cs.DL↗