开放科学环境下科研人员的负责任评价新取向分析

The New Orientation of Responsible Research Assessment for Researchers in the Context of Open Science

[目的/意义]分析开放科学环境下科研人员的负责任评价(RRA)新取向,以期为“破四唯”指导下的我国科研评价实践提供借鉴与参考。[方法/过程]以传统评价体系“唯与责”的背离为切入点,以全球研究理事会(GRC)《2021年RRA报告》、欧盟《研究评价系统改革报告》等典型内容文本为数据源,采用WordSmith提取关键词及词丛,并进行可视化。[结果/结论]分析认为,基于同行评议定性判断与负责任计量相结合的方法,对于多种研究产出、活动的质量与贡献认定成为开放科学环境下科研人员RRA的基本框架与准则,其中,小同行评议与分类评价成为破除“唯论文”、SCI至上等不良学术驱动因素的核心规则和必由之路;元评价则为提高科研人员评价质量、优化指标与方法提供了循证依据。研究指出:此框架将利于纠偏基于产出的价值观,促进早期职业生涯科研人员(ECR)职业道路的差异化与多元化以及研究生态系统功能的最大化,推动包容、健康的研究创新体系的建立,同时为我国科研人员评价改革提供了有益的启示。

[Purpose/Significance]This paper analyzes the new orientation of responsible research assessment(RRA)for researchers in the context of open science,so as to provide references for China’s scientific research evaluation under the guidance of breaking the“siwei”.[Method/Process]With the deviation between“wei”and“ze”in the traditional evaluation system as the starting point,typical relevant content texts,such as RRA:Global Research Council Conference Report 2021 by Global Research Council and Towards a Reform of the Research Assessment System:Scoping Report by European Commission,were used as the data source,and the keyword extraction and co-occurrence visualization were performed by WordSmith as well.[Result/Conclusion]It shows that the combination of peer’s judgment and responsible metrics for the quality and contribution identification in terms of researchers’multiple research outputs and activities,has constituted the basic framework and become the criterion of researchers’RRA under the open science environment.Among these,counterpart peer review and classified evaluation are regarded as the core rules and the necessary ways to break the bad academic driving factors,such as paper only and SCI supremacy,while meta evaluation provides an evidence-based basis for the improvement of researchers’evaluation quality and optimization of indicators and methods.The resulting conclusions point out that the framework will be conducive to correcting output-based value,promoting the differentiation and diversification of early career researchers(ECR)career paths,and maximizing the function of research ecosystem and facilitating the shift toward inclusive and healthy research and innovation system.Meanwhile,it provides inspiration for the reform of researchers’evaluation in China.