Abstract
A work strand planned by the Science Europe Working Group on Research Policy and Programme Evaluation aims at mapping the state of affairs in data collection and their use at European funding and research organisations. In particular, the project identifies and proposes solutions for issues experienced by the Member Organisations (MO) regarding collection, standardisation and treatment of data related to the analysis and ex-post evaluation of activities funded or performed by MOs. This is implemented through a survey sent to the MOs. The survey was analysed with special attention to the particular needs of funding and performing organisations. On the basis of the results and the discussion among the work strand members and within the WG, we draw a preliminary set of conclusions to produce guidance on relevant topics, including researcher and funding identification, potential, properties and limitations of data and indicators that are used in the context of measurement of research output and its assessment, classification systems used in sciences systems including their various types and issues of availability, confidentiality and harmonisation of data and indicators. Feedback from such discussions will be used to identify areas for further action by Science Europe.
Similar content being viewed by others
References
Glänzel, W. (1996). The need for standards in bibliometric research and technology. Scientometrics, 35(2), 167–176.
Glänzel, W. (2015). The challenge of data collection, harmonisation and standardisation for use in research funding, output measurement and research assessment. Paper presented at the special session on “New frontiers and empirical evidence on the Efficiency, Effectiveness and Impact of Education, Research and Innovation” organised by C. Daraio at the 15th international conference on scientometrics and informetrics (ISSI 2015), Boğaziçi University, Istanbul.
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature, 520, 429–431.
Seglen, P. O. (1997). Why the impact factor of journals should not be used for evaluating research. British Medical Journal, 314(7079), 498–502.
Wouters, P., Glänzel, W., Gläser, J., & Rafols, I. (2013). The dilemmas of performance indicators of individual researchers—An urgent debate in bibliometrics. ISSI Newsletter, 9(3), 48–53.
Acknowledgments
The authors would like to thank Science Europe for creating the framework for this study and Professor Jordi Molas Gallart (INGENIO—CSIC and Polytechnic University of Valencia) and Matteo Razzanelli (Science Europe) for their valuable comments on previous versions of the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Glänzel, W., Beck, R., Milzow, K. et al. Data collection and use in research funding and performing organisations. General outlines and first results of a project launched by Science Europe. Scientometrics 106, 825–835 (2016). https://doi.org/10.1007/s11192-015-1815-z
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-015-1815-z