开放科学时代学术评价研究的新机遇与新挑战——从系列开放获取宣言/倡议或行动计划谈起

New Opportunities and Challenges for Academic Evaluation Research in Open Science Era:Starting from a Series of Open Declarations/Initiatives/Action Plans

进入21世纪以来,各类开放获取运动的蓬勃发展,促进了开放科学时代的到来,并对科学发展和各项学术研究活动产生了巨大影响和深刻改变。文章主要围绕开放科学时代学术评价研究面临的机遇与挑战展开论述,主要内容包括3个部分:对与学术评价活动密切相关的系列宣言/倡议或行动计划以及政策发布等进行全面调研和梳理分析,首先是开放获取类,其次是替代计量类和评价反省/反思类,以厘清当前学术评价活动所处时代背景及研究环境。对学术评价研究迎来的三大发展机遇进行论述分析,即评价语料的极大丰富及其可获得性的极大提高、评价对象与评价议题的不断拓展创新、评价方法(特别是定量化评价方法)的快速迭代更新。这些新机遇的产生均受益于开放科学运动的持续推动,并为学术评价研究提供了坚实的数据支撑、议题创设和工具/方法保障。在认清开放科学环境和把握研究新机遇的基础上,分别从定性评价与定量评价的有机结合、形式特征评价与内容/语义特征评价的有效平衡、多维度学术评价模型的进一步完善、新型学术评价理论构建4个方面,对当前学术评价研究面临的新问题进行了较为系统性的归纳与阐释,并就问题的解决给出了若干有价值的研究建议或对策。

Rapidly rising of various Open Access movements in the 21th century has contributed to the arrival of Open Science era,and has had a great impact on and profoundly changed the development of science and academic research activities.This paper mainly focuses on the opportunities and challenges of academic evaluation research in this new era,and our discussion includes the following three parts:First,we attempt to give a more clearly understandings about the current research environment of academic evaluation through a comprehensive analysis by investigating a series of declarations,initiatives,action plans,policy releases that are closely related to academic evaluation activities and then subdividing them into open access ones,Altmetrics&evaluation introspection/reflection ones(three types).Second,three major opportunities which deserve to be grasped effectively for academic evaluation research,including great enrichment and high availability of evaluation corpora(covering open full-text,open citation and open data set),new emerging evaluation objects and continuous expansion of evaluation topics/tasks,rapid iteration and updating of evaluation methods and tools(especially quantitative evaluation),are discussed and analyzed respectively.These new opportunities have all benefited from the continuous promotion of Open Science movement,and have also provided solid data support,topic innovation and tools/methods usage for future academic evaluation research.Third,four challenging problems among current academic evaluation research are systematically summarized and explored,such as organic combination of qualitative and quantitative evaluation,effective balance between evaluation using formal features and evaluation based on full-text and its content/semantic features,further refinement for existing multidimensional academic evaluation framework,and construction of new academic evaluation theories.Finally,a number of valuable suggestions are given to solve these problems.