International Initiatives And Recommendationson Research Assessment
DOI:
https://doi.org/10.15407/sofs2025.03.046Keywords:
research institution, research assessment, international initiatives, quantitative indicators, expert evaluation, scientometricsAbstract
This article contains results of analysis and systematization of key international initiatives and recommendations playing a crucial role in shaping contemporary approaches to research evaluation. The topic’s relevance stems from the growing criticism of traditional evaluation systems relying heavily on bibliometric indicators, and the global scientific community’s need to find more comprehensive, balanced, and robust methods of assessment. These new methods should enhance research effectiveness, prevent metric misuse, and foster ethical practices. To achieve the research objective, we employed a systematic analysis of international declarations and manifestos, a comparative analysis of research evaluation approaches, as well as synthesis and generalization. The study’s source base includes landmark international documents such as the Leiden Manifesto for Research Metrics, the San Francisco Declaration on Research Assessment (DORA), and the Hong Kong Principles for Assessing Researchers, along with recommendations from leading scientific organizations and foundations. The findings indicate a global trend away from an exclusive focus on quantitative indicators (like the number of publications and citations) towards more comprehensive and qualitative evaluation. We found that new approaches consider the multifaceted nature of scientific contributions. This includes not only publication activity but also the quality, novelty, relevance, social and economic impact of research, participation in international cooperation, the contribution of research to personnel training, and the alignment of research with the institution’s mission and development prospects. The main conclusion emphasizes the necessity of implementing the principles of responsible research assessment into Ukrainian practice. This will help enhance the effectiveness, transparency, and accuracy of evaluations of research institutions. Based on the research results, we identified the main directions for improving the evaluation procedure in research institutions of Ukraine.
References
Abramo, G., & D’Angelo, C.A. (2015). The VQR, Italy’s second national research assessment: Methodological failures and ranking distortions. Journal of the Association for Information Science and Technology, 66 (11), 2202—2214. https://doi.org/10.1002/asi.23323
Ortiz Nez, R. (2021). Altmetrics: alternative metrics for scientific, technological and innovation evaluation. Academia Letters. 6 pages. Art. 1658. https://doi.org/10.20935/AL1658
Rúa-Ortiz, J., Peralta-González, M.J., Gregorio-Chaviano, O., & Piedra-Salomón, Y. (2022). Evaluation of Cuban scientific activity within the open science framework: Some reflections. Iberoamerican Journal of Science Measurement and Communication, 2 (3), 1—15. https://doi.org/10.47909/ijsmc.43
He, Y., Li, F., & Liu, X. (2024). Research progress on the evaluation mechanism of scientific research teams in the digital economy era. Journal of Internet and Digital Economics, 4 (3), 218—241. https://doi.org/10.1108/JIDE-04-2024-0016
Montorsi, M. (2024). The evaluation of scientific activity for academic careers: still an open issue. Updates in Surgery, 76, 1127—1129. https://doi.org/10.1007/s13304-024-01885-5
Mryglod, O.I., & Nazarovets, S.A. (2019). Scientometrics and management of scientific activities: once again about the global and Ukrainian. Visn. Nac. Akad. Nauk Ukr., 9, 81—94. https://doi.org/10.15407/visn2019.09.081 [in Ukrainian].
Yegorov, I. (2019). Evaluation of research institutes of the National Academy of Sciences of Ukraine: problems with implementation of the best practices. Fteval Journal for Research and Technology Policy Evaluation, 47, 89—93. https://doi.org/10.22163/fteval.2019.336
Kostenko, L., & Symonenko, T. (2020). Scientometrics 2.0: conceptual positions and approbation. Libraries of National Academies of Sciences: Problems of Functioning, Tendencing of Development, 18, 52—63. URL: http://jnas.nbuv.gov.ua/article/UJRN-0001197959 (last accessed: 20.05.2025) [in Russian].
Laktionova, T.M., Parasochka, I.F., & Havrylova, N.A. (2021). Bibliometric indicators of publication activities in research units of the institute. Science and Science of Science, 4 (114), 74—93. https://doi.org/10.15407/sofs2021.04.074 [in Ukrainian].
Zhukovych, I.A., & Yehorov, I.Yu. (2021). Evolution of Methodological Approaches to Evaluating the Effi ciency of the Activities of Research Organizations in Ukraine. Statistics of Ukraine, 2, 4—15. https://doi.org/10.31767/su.2(93)2021.02.01 [in Ukrainian].
Yehorov, I.Yu., & Zhukovych, I.A. (2022). Performance evaluation in research organizations: evolution of methodologies. Science and Science of Science, 3 (117), 36—50. https://doi.org/10.15407/sofs2022.03.036 [in Ukrainian].
Zhukovych, І.A. (2022). Peculiarities of Evaluating the Activity of Scientific Organizations in Some Countries of the Former USSR. Statistics of Ukraine, 2, 41—50. https://doi.org/10.31767/su.2(97)2022.02.05 [in Ukrainian].
Zhukovych, I.A., & Krasnonosova, O.M. (2023). Organization of Evaluation of Scientific Activity in China: Methodology and Experience. Biznes Inform, 10, 53— 63. https://doi.org/10.32983/2222-4459-2023-10-53-63 [in Ukrainian].
Аmerican Society for Cell Biology. DORA. Declaration on Research Assessment. URL: http://www.ascb.org/dora/ (last accessed: 20.05.2025).
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature, 520, 429—431. http://doi.org/10.1038/520429a
Wilsdon, J., Allen, L., Belfiore, Е., Campbell, Р., Curry, S., & Hill, S., et al. (2015). The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management. HEFCE. https://doi.org/10.13140/RG.2.1.4929.1363
Moher, D., Bouter, L., Kleinert, S., Glasziou, P., Sham, M.H., & Barbour, V., et al. (2020). The Hong Kong Principles for assessing researchers: Fostering research integrity. PLОS Biology. 18 (7). e3000737. https://doi.org/10.1371/journal.pbio.3000737
Curry, S., Gadd, E., & Wilsdon, J. (2020). Harnessing the Metric Tide: indicators, infrastructures & priorities for UK responsible research assessment. Research on Research Institute. Report. https://doi.org/10.6084/m9.figshare.21701624.v2
CoARA (2022). Agreement on reforming research assessment. URL: https://coara. eu/app/uploads/2022/09/2022_07_19_rra_agreement_final.pdf (last accessed: 20.05.2025).
Yegorov, I.Yu., Zhukovych, І.A., Krasnonosova, O.M., & Artiushenko, V.V. (2024). On the progress, results and problems of the evaluation of scientific institutions of the National Academy of Sciences of Ukraine in 2023. Visn. Nac. Akad. Nauk Ukr., 6, 14—24. https://doi.org/10.15407/visn2024.06.014 [in Ukrainian].
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Akademperiodyka of the NAS of Ukraine

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.



