“以刊评文”的局限、本质及其辩证应用研究

Research on the Limitation,Essence and Dialectical Application of"Evaluating Papers by Journals"

[目的/意义]“以刊评文”现象长期根植于我国的科技评价中,在破除“四唯”,回归科学研究本源属性背景下,研究其局限、本质,客观对待“以刊评文”具有重要意义。[方法/过程]在分析“以刊评文”存在的问题与产生原因的基础上,建立期刊级别与研究水平的用户画像,论证了“以刊评文”的本质,并建立论文评价的比较框架,讨论了小样本论文比较、同级别大样本论文比较、同级别小样本与大样本论文比较、大样本下论文跨级别比较问题。[结果/结论]大样本情况下论文发表期刊的平均质量可以代表作者水平;机构评价时应该“以刊评文”为主、同行评议为辅;人才评价应该以同行评议为主、“以刊评文”为辅;“以刊评文”能够评价科研规模而代表作评价只能评价科研质量。

[Purpose/Significance]The phenomenon of"Evaluating papers by journals"has been rooted in China's scientific and technological evaluation for a long time,it is of great significance to study its limitations and essence and to treat it objectively under the background of breaking away from the"four only"and returning to the origin of scientific research.[Method/Process]Based on the analysis of the existing problems and the causes of"Evaluating papers by journals",this paper establishes the user portraits of journal level and research level,demonstrates the essence of it and establishes the comparative framework of paper evaluation.This paper also discusses the comparison of small-sample papers,large-sample papers of the same level,small-sample and large-sample papers of the same level and cross level comparison of large-sample papers.[Result/Conclusion]The results show that the average quality of the journals of the papers can represent the author's level in the case of large-sample.The evaluation of institutions should be based mainly on the evaluation of journals and supplemented by peer review.The personnel evaluation should be based mainly on peer review and supplemented by journal review."Evaluating papers by journals"could evaluate the scale of scientific research,while the representative evaluation can only evaluate the quality of scientific research.