Searcharxiv⌕ Search

arXiv subjects

Ciriaco Andrea D'Angelo

Publications and source records attributed to Ciriaco Andrea D'Angelo.

At least 19 recordsLinked to original sources

Enhancing the prediction of publications' long-term impact using early citations, readerships, and non-scientific factors

This study aims to improve the accuracy of long-term citation impact prediction by integrating early citation counts, Mendeley readership, and various non-scientific factors, such as journal impact factor, authorship and reference list characteristics, funding and open-access status. Traditional citation-based models often fall short by relying solely on early citations, which may not capture broader indicators of a publication's potential influence. By incorporating non-scientific predictors, this model provides a more nuanced and comprehensive framework that outperforms existing models in predicting long-term impact. Using a dataset of Italian-authored publications from the Web of Science, regression models were developed to evaluate the impact of these predictors over time. Results indicate that early citations and Mendeley readership are significant predictors of long-term impact, with additional contributions from factors like authorship diversity and journal impact factor. The study finds that open-access status and funding have diminishing predictive power over time, suggesting their influence is primarily short-term. This model benefits various stakeholders, including funders and policymakers, by offering timely and more accurate assessments of emerging research. Future research could extend this model by incorporating broader altmetrics and expanding its application to other disciplines and regions. The study concludes that integrating non-citation-based factors with early citations captures a more complex view of scholarly impact, aligning better with real-world research influence.

cs.DL↗

The role of non-scientific factors vis-a-vis the quality of publications in determining their scholarly impact

In the evaluation of scientific publications' impact, the interplay between intrinsic quality and non-scientific factors remains a subject of debate. While peer review traditionally assesses quality, bibliometric techniques gauge scholarly impact. This study investigates the role of non-scientific attributes alongside quality scores from peer review in determining scholarly impact. Leveraging data from the first Italian Research Assessment Exercise (VTR 2001-2003) and Web of Science citations, we analyse the relationship between quality scores, non-scientific factors, and publication short- and long-term impact. Our findings shed light on the significance of non-scientific elements overlooked in peer review, offering policymakers and research management insights in choosing evaluation methodologies. Sections delve into the debate, identify non-scientific influences, detail methodologies, present results, and discuss implications.

cs.DL↗

Analyzing the inter-domain vs intra-domain knowledge flows

Similar to how innovations often find success in fields other than their original domains, in this study we explore whether the same holds true for scientific discoveries. We investigate the flow of knowledge across scientific disciplines, focusing on connections between citing and cited publications. Specifically, we analyze the connections among cited publications from 2015 indexed in the Web of Science and their citing counterparts to measure rates of knowledge dissemination within and across different fields. Our study aims to address key research questions concerning the disparities between inter- and intra-domain knowledge dissemination rates, the correlation between knowledge dissemination types and scholarly impact, as well as the evolution of knowledge dissemination patterns over time. These findings deepen our understanding of knowledge flows and offer practical insights with significant implications for evaluative bibliometrics.

cs.DL↗

How reliable are unsupervised author disambiguation algorithms in the assessment of research organization performance?

The paper examines extent of bias in the performance rankings of research organisations when the assessments are based on unsupervised author-name disambiguation algorithms. It compares the outcomes of a research performance evaluation exercise of Italian universities using the unsupervised approach by Caron and van Eck (2014) for derivation of the universities' research staff, with those of a benchmark using the supervised algorithm of D'Angelo, Giuffrida, and Abramo (2011), which avails of input data. The methodology developed could be replicated for comparative analyses in other frameworks of national or international interest, meaning that practitioners would have a precise measure of the extent of distortions inherent in any evaluation exercises using unsupervised algorithms. This could in turn be useful in informing policy-makers' decisions on whether to invest in building national research staff databases, instead of settling for the unsupervised approaches with their measurement biases.

cs.DL↗

The geographic proximity effect on domestic cross-sector vis-a-vis intra-sector research collaborations

Geographic proximity is acknowledged to be a key factor in research collaborations. Specifically, it can work as a possible substitute for institutional proximity. The present study investigates the relevance of the "proximity" effect for different types of national research collaborations. We apply a bibliometric approach based on the Italian 2010-2017 scientific production indexed in the Web of Science. On such dataset, we apply statistical tools for analyzing if and to what extent geographical distance between co-authors in the byline of a publication varies across collaboration types, scientific disciplines, and along time. Results can inform policies aimed at effectively stimulating cross-sector collaborations, and also bear direct practical implications for research performance assessments.

econ.GN↗

Public-private research collaborations: longitudinal field-level analysis of determinants, frequency and impact

This study on public-private research collaboration measures the variation over time of the propensity of academics to collaborate with colleagues from private companies. It also investigates the change in weights of the main drivers underlying the academics' propensity to collaborate, and whether the type profile of the collaborating academics changes. To do this, the study applies an inferential model on a dataset of professors working in Italian universities in consecutive periods, 2010-2013 and 2014-2017. The results, obtained at overall and field levels, support the formulation of policies aimed at fostering public-private research collaborations, and should be taken into account in post-assessment of their effectiveness.

econ.GN↗

Drivers of academic engagement in public-private research collaboration: an empirical study

University-industry research collaboration is one of the major research policy priorities of advanced economies. In this study, we try to identify the main drivers that could influence the propensity of academics to engage in research collaborations with the private sector, in order to better inform policies and initiatives to foster such collaborations. At this purpose, we apply an inferential model to a dataset of 32,792 Italian professors in order to analyze the relative impact of individual and contextual factors affecting the propensity of academics to engage in collaboration with industry, at overall level and across disciplines. The outcomes reveal that the typical profile of the professor collaborating with industry is a male under age 40, full professor, very high performer, with highly diversified research, and who has a certain tradition in collaborating with industry. This professor is likely to be part of a staff used to collaborating with industry, in a small university, typically a polytechnic, located in the north of the country.

econ.GN↗

A comparison of two approaches for measuring interdisciplinary research output: the disciplinary diversity of authors vs the disciplinary diversity of the reference list

This study investigates the convergence of two bibliometric approaches to the measurement of interdisciplinary research: one based on analyzing disciplinary diversity in the reference list of publications, the other based on the disciplinary diversity of authors of publications. In particular we measure the variety, balance, disparity and integrated diversity index of, respectively, single-author, multi-author single-field, and multi-author multi-field publications. We find that, in general, the diversity of the reference list grows with the number of fields reflected in a paper's authors' list and, to a lesser extent, with the number of authors being equal the number of fields. Further, we find that when fields belonging to different disciplines are reflected in the authors' list, the disparity in the reference list is higher than in the case of fields belonging to the same discipline. However, this general tendency varies across disciplines, and noticeable exceptions are found at individual paper level.

cs.DL↗

Gender differences in research performance within and between countries: Italy vs Norway

In this study, the scientific performance of Italian and Norwegian university professors is analysed using bibliometric indicators. The study is based on over 36,000 individuals and their publication output during the period 2011-2015. Applying a multidimensional indicator in which several aspects of the research performance are captured, we find large differences in the performance of men and women. These gender differences are evident across all analysed levels, such as country, field, and academic position. However, most of the gender differences can be explained by the tails of the distributions-in particular, there is a much higher proportion of men among the top 10% performing scientists. For the remaining 90% of the population, the gender differences are practically non-existent. The results of the two countries, which differ in terms of the societal role of women, are contrasting. Further, we discuss possible biases that are intrinsic in quantitative performance indicators, which might disfavour female researchers.

cs.DL↗

Collecting large-scale publication data at the level of individual researchers: A practical proposal for author name disambiguation

The disambiguation of author names is an important and challenging task in bibliometrics. We propose an approach that relies on an external source of information for selecting and validating clusters of publications identified through an unsupervised author name disambiguation method. The application of the proposed approach to a random sample of Italian scholars shows encouraging results, with an overall precision, recall, and F-Measure of over 96%. The proposed approach can serve as a starting point for large-scale census of publication portfolios for bibliometric analyses at the level of individual researchers.

cs.DL↗

Does the geographic proximity effect on knowledge spillovers vary across research fields?

Policy makers are interested in the influence of geographic distance on knowledge flows, however these can be expected to vary across research fields. The effects of geographic distance on flows are analyzed by means of citations to scientific literature. The field of observation consists of the 2010-2012 Italian publications and relevant citations up to the close of 2017. The geographic proximity effect is analyzed at national, continental, and intercontinental level in 244 fields, and results as evident at national level and in some cases at continental level, but not at intercontinental level. For flows between Italian municipalities, citations decrease with distance in all fields. At continental level, four fields are identified having knowledge flows that grow with distance; at intercontinental level, this occurs in 26 fields. The influence of distance is more limited in the fields of Humanities and Social sciences, much more significant in the Sciences, mainly in the Natural sciences.

cs.DL↗

Predicting the future success of scientific publications through social network and semantic analysis

Citations acknowledge the impact a scientific publication has on subsequent work. At the same time, deciding how and when to cite a paper, is also heavily influenced by social factors. In this work, we conduct an empirical analysis based on a dataset of 2010-2012 global publications in chemical engineering. We use social network analysis and text mining to measure publication attributes and understand which variables can better help predicting their future success. Controlling for intrinsic quality of a publication and for the number of authors in the byline, we are able to predict scholarly impact of a paper in terms of citations received six years after publication with almost 80 percent accuracy. Results suggest that, all other things being equal, it is better to co-publish with rotating co-authors and write the papers' abstract using more positive words, and a more complex, thus more informative, language. Publications that result from the collaboration of different social groups also attract more citations.

cs.DL↗

A novel methodology to assess the scientific standing of nations at field level

The formulation of national research policies would benefit greatly from reliable strategic analysis of the scientific infrastructure, aimed at identifying the relevant strengths and weaknesses at field level. Bibliometric methodologies thus far proposed in the literature are not completely satisfactory. This work proposes a novel "output-to-input-oriented" approach, which permits identification of research strengths and weaknesses on the basis of the ratios of top scientists and highly cited articles to research expenditures in each field. The proposed approach is applied to the Italian academic system. 2012-2016 scientific publications are analyzed, in the 218 research fields where bibliometric assessment is appropriate.

cs.DL↗

The domestic localization of knowledge flows as evidenced by publication citation: The case of Italy

This work applies a new approach to measure knowledge flows. Assuming that citation linkages between articles imply a flow of knowledge from the cited to the citing authors, we investigate the geographic flows of scientific knowledge produced in Italy across its regions, at both overall and field level. Furthermore, we measure the the specialization indexes for outflows and inflows of knowledge by a given region. Findings show that larger regions in terms of research output are more likely net exporters of new knowledge. At the same time, we register a positive correlation between the share of intraregional flows and the size of overall scientific output of a region.

cs.DL↗

Knowledge spillovers: does the geographic proximity effect decay over time? A discipline-level analysis, accounting for cognitive proximity, with and without self-citations

This work analyzes the variation over time of the effect of geographic distance on knowledge flows. The flows are measured through the citations exchanged between scientific publications, including and excluding self-citations. To calculate geographic distances between citing and cited publication, each publication is associated with a "prevailing" territory, according to the authors' affiliations. We then apply a gravity model to account for the research size of the territories, in terms of cognitive proximity of citing-cited publications. The field of observation is the 2010-2017 world publications citing the 2010-2012 Italian publications, as indexed in the Web of Science. The results show that in domestic knowledge flows, geographic proximity remains an influential factor through time, although with differences among disciplines and trends of attenuating effects. Finally, we replicate the analyses of knowledge flows but with the exclusion of self-citations: in this manner the effect of geographic proximity seems reduced, particularly at the national scale, but the differences (with vs without self-citations) lessen through time. As shown in previous works, the effect of distance on continental flows is modest (imperceptible for intercontinental flows), yet here too time has some influence, including concerning exclusion of self-citations.

cs.DL↗

On the relation between the degree of internationalization of cited and citing publications: A field level analysis, including and excluding self-citations

The growing complexity of scientific challenges demands increasingly intense research collaboration, both domestic and international. The resulting trend affects not only the modes of producing new knowledge, but also the way it is disseminated within scientific communities. This paper analyses the relationship between the "degree of internationalization" of a country's scientific production and that of the relevant citing publications. The empirical analysis is based on 2010-2012 Italian publications. Findings show: i) the probability of being cited increases with the degree of internationalization of the research team; ii) totally domestic research teams tend to cite to a greater extent totally domestic publications; iii) vice versa, publications resulting from international collaborations tend to be more cited by totally foreign publications rather than by publications including domestic authors. These results emerge both at overall and at discipline level. Findings might inform research policies geared towards internationalization.

cs.DL↗

Informed peer review for publication assessments: Are improved impact measures worth the hassle?

In this work we ask whether and to what extent applying a predictor of publications' impact better than early citations, has an effect on the assessment of research performance of individual scientists. Specifically, we measure the total impact of Italian professors in the sciences and economics in a period of time, valuing their publications first by early citations and then by a weighted combination of early citations and impact factor of the hosting journal. As expected, scores and ranks by the two indicators show a very strong correlation, but there occur also significant shifts in many fields, mainly in Economics and statistics, and Mathematics and computer science. The higher the share of uncited professors in a field and the shorter the citation time window, the more recommendable the recourse to the above combination.

cs.DL↗

The different responses of universities to introduction of performance-based research funding

Governments and organizations design performance-based research funding systems (PBFRS) for strategic aims, such as to selectively allocate scarce resources and stimulate research efficiency. In this work we analyze the relative change in research productivity of Italian universities after the introduction of such a system, featuring financial and reputational incentives. Using a bibliometric approach, we compare the relative research performance of universities before and after introduction of PBFRS, at the overall, discipline and field levels. The findings show convergence in the universities' performance, due above all to the remarkable improvement of the lowest performers. Geographically, the universities of the south (versus central and northern Italy) achieved the greatest improvement in relative performance. The methodology, and results, should be of use to university management and policy-makers.

cs.DL↗