International Initiatives And Recommendationson Research Assessment

Authors

  • I. A. Zhukovych State Institution “Center for Evaluation of Activity of Research Institutions and Scientific Support of Regional Development of Ukraine of the NАS of Ukraine”, Kyiv, Ukraine https://orcid.org/0000-0001-5027-5991

DOI:

https://doi.org/10.15407/sofs2025.03.046

Keywords:

research institution, research assessment, international initiatives, quantitative indicators, expert evaluation, scientometrics

Abstract

This article contains results of analysis and systematization of key international initiatives and recommendations playing a crucial role in shaping contemporary approaches to research evaluation. The topic’s relevance stems from the growing criticism of traditional evaluation systems relying heavily on bibliometric indicators, and the global scientific community’s need to find more comprehensive, balanced, and robust methods of assessment. These new methods should enhance research effectiveness, prevent metric misuse, and foster ethical practices. To achieve the research objective, we employed a systematic analysis of international declarations and manifestos, a comparative analysis of research evaluation approaches, as well as synthesis and generalization. The study’s source base includes landmark international documents such as the Leiden Manifesto for Research Metrics, the San Francisco Declaration on Research Assessment (DORA), and the Hong Kong Principles for Assessing Researchers, along with recommendations from leading scientific organizations and foundations. The findings indicate a global trend away from an exclusive focus on quantitative indicators (like the number of publications and citations) towards more comprehensive and qualitative evaluation. We found that new approaches consider the multifaceted nature of scientific contributions. This includes not only publication activity but also the quality, novelty, relevance, social and economic impact of research, participation in international cooperation, the contribution of research to personnel training, and the alignment of research with the institution’s mission and development prospects. The main conclusion emphasizes the necessity of implementing the principles of responsible research assessment into Ukrainian practice. This will help enhance the effectiveness, transparency, and accuracy of evaluations of research institutions. Based on the research results, we identified the main directions for improving the evaluation procedure in research institutions of Ukraine.

References

Abramo, G., & D’Angelo, C.A. (2015). The VQR, Italy’s second national research assessment: Methodological failures and ranking distortions. Journal of the Association for Information Science and Technology, 66 (11), 2202—2214. https://doi.org/10.1002/asi.23323

Ortiz Nez, R. (2021). Altmetrics: alternative metrics for scientific, technological and innovation evaluation. Academia Letters. 6 pages. Art. 1658. https://doi.org/10.20935/AL1658

Rúa-Ortiz, J., Peralta-González, M.J., Gregorio-Chaviano, O., & Piedra-Salomón, Y. (2022). Evaluation of Cuban scientific activity within the open science framework: Some reflections. Iberoamerican Journal of Science Measurement and Communication, 2 (3), 1—15. https://doi.org/10.47909/ijsmc.43

He, Y., Li, F., & Liu, X. (2024). Research progress on the evaluation mechanism of scientific research teams in the digital economy era. Journal of Internet and Digital Economics, 4 (3), 218—241. https://doi.org/10.1108/JIDE-04-2024-0016

Montorsi, M. (2024). The evaluation of scientific activity for academic careers: still an open issue. Updates in Surgery, 76, 1127—1129. https://doi.org/10.1007/s13304-024-01885-5

Mryglod, O.I., & Nazarovets, S.A. (2019). Scientometrics and management of scientific activities: once again about the global and Ukrainian. Visn. Nac. Akad. Nauk Ukr., 9, 81—94. https://doi.org/10.15407/visn2019.09.081 [in Ukrainian].

Yegorov, I. (2019). Evaluation of research institutes of the National Academy of Sciences of Ukraine: problems with implementation of the best practices. Fteval Journal for Research and Technology Policy Evaluation, 47, 89—93. https://doi.org/10.22163/fteval.2019.336

Kostenko, L., & Symonenko, T. (2020). Scientometrics 2.0: conceptual positions and approbation. Libraries of National Academies of Sciences: Problems of Functioning, Tendencing of Development, 18, 52—63. URL: http://jnas.nbuv.gov.ua/article/UJRN-0001197959 (last accessed: 20.05.2025) [in Russian].

Laktionova, T.M., Parasochka, I.F., & Havrylova, N.A. (2021). Bibliometric indicators of publication activities in research units of the institute. Science and Science of Science, 4 (114), 74—93. https://doi.org/10.15407/sofs2021.04.074 [in Ukrainian].

Zhukovych, I.A., & Yehorov, I.Yu. (2021). Evolution of Methodological Approaches to Evaluating the Effi ciency of the Activities of Research Organizations in Ukraine. Statistics of Ukraine, 2, 4—15. https://doi.org/10.31767/su.2(93)2021.02.01 [in Ukrainian].

Yehorov, I.Yu., & Zhukovych, I.A. (2022). Performance evaluation in research organizations: evolution of methodologies. Science and Science of Science, 3 (117), 36—50. https://doi.org/10.15407/sofs2022.03.036 [in Ukrainian].

Zhukovych, І.A. (2022). Peculiarities of Evaluating the Activity of Scientific Organizations in Some Countries of the Former USSR. Statistics of Ukraine, 2, 41—50. https://doi.org/10.31767/su.2(97)2022.02.05 [in Ukrainian].

Zhukovych, I.A., & Krasnonosova, O.M. (2023). Organization of Evaluation of Scientific Activity in China: Methodology and Experience. Biznes Inform, 10, 53— 63. https://doi.org/10.32983/2222-4459-2023-10-53-63 [in Ukrainian].

Аmerican Society for Cell Biology. DORA. Declaration on Research Assessment. URL: http://www.ascb.org/dora/ (last accessed: 20.05.2025).

Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature, 520, 429—431. http://doi.org/10.1038/520429a

Wilsdon, J., Allen, L., Belfiore, Е., Campbell, Р., Curry, S., & Hill, S., et al. (2015). The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management. HEFCE. https://doi.org/10.13140/RG.2.1.4929.1363

Moher, D., Bouter, L., Kleinert, S., Glasziou, P., Sham, M.H., & Barbour, V., et al. (2020). The Hong Kong Principles for assessing researchers: Fostering research integrity. PLОS Biology. 18 (7). e3000737. https://doi.org/10.1371/journal.pbio.3000737

Curry, S., Gadd, E., & Wilsdon, J. (2020). Harnessing the Metric Tide: indicators, infrastructures & priorities for UK responsible research assessment. Research on Research Institute. Report. https://doi.org/10.6084/m9.figshare.21701624.v2

CoARA (2022). Agreement on reforming research assessment. URL: https://coara. eu/app/uploads/2022/09/2022_07_19_rra_agreement_final.pdf (last accessed: 20.05.2025).

Yegorov, I.Yu., Zhukovych, І.A., Krasnonosova, O.M., & Artiushenko, V.V. (2024). On the progress, results and problems of the evaluation of scientific institutions of the National Academy of Sciences of Ukraine in 2023. Visn. Nac. Akad. Nauk Ukr., 6, 14—24. https://doi.org/10.15407/visn2024.06.014 [in Ukrainian].

Published

2025-10-06

How to Cite

Zhukovych, I. A. (2025). International Initiatives And Recommendationson Research Assessment. Science and Science of Science, (3(129), 46–62. https://doi.org/10.15407/sofs2025.03.046

Issue

Section

Vital Problems of Modern Science