线性学术评价权重失灵及其影响研究

Research on Weight Failure of Linear Academic Evaluation and Its Impact

本文提出了学术评价中隐含的权重失灵问题,即当某些评价指标存在“同增同减”现象时,不管这些指标的权重组合如何变动,这些评价指标的评价结果排序几乎不变,相当于此时权重已经没有作用。本文对权重失灵的形成机制、特点、测度方法、影响因素、后果进行了进一步的分析,并以JCR2019经济学期刊为例进行了仿真实验,研究结果表明:权重失灵是学术评价中的普遍现象,应该引起足够的重视;权重失灵是一把双刃剑,会降低赋权失误和赋权误差的影响,但也会影响评价质量;权重失灵的影响因素包括指标相关、合计权重与评价规模等。本文的研究丰富了情报学的评价理论。

This paper puts forward the problem of weight failure implied in academic evaluation,namely,when some evaluation indexes“increase and decrease at the same time”,no matter how the weight combination of these indexes changes,the ranking of evaluation results is almost unchanged,making the weight almost of no impact.This paper makes a further analysis on the formation mechanism,characteristics,measurement methods,influencing factors and consequences of weight failure,and takes JCR2019 economics journal as an example to carry out simulation experiments.The results show that weight failure is a common phenomenon in academic evaluation,which should be paid enough attention to.Weight failure is a double-edged sword—it can reduce the impact of weight fault and weight error,but also affects the quality of evaluation.The influencing factors of weight failure include index correlation,total weight and evaluation scale.This research enriches the evaluation theory in Information Science.