基于期刊编委指数的科研机构学术影响力评价研究:以地质学为例

Evaluating the Scholarly Impact of Institutes Based on the Journal Editorship Index: Empirical Analysis in Geology

针对科研机构学术影响力评价研究中多维数据难以获取、定量定性结合不强等问题,提出运用期刊编委数据来度量科研机构的学术影响力,既采用了文献数据这一客观信息源,同时也兼顾同行专家的意见。构建期刊编委指数(Journal Editorship Index),综合考虑了期刊等级,编委等级和编委规模的影响,从多个维度来反映科研机构的学术影响力。以地质学为应用对象,在选取的在111种地质学期刊中,共收集整理期刊编委3811名作为研究数据。研究结果表明,期刊编委指数能很好地的刻画科研机构的学术影响力,地质学领域科研机构的编委人数和期刊编委指数得分都呈现出明显的分布不均衡态势。JEI得分与期刊论文数、总被引次数和H指数等指标均有着积极显著的相关关系。评价结果鲁棒性分析表明,考虑编委等级、期刊等级和编委规模等因素的影响,设置相应的权重一定程度会改变原有基于期刊编委数量的评价结果,但是不同权重区分度对评价结果的影响不大。通过计算JEI指数与衍生的指数JEI/JT、JEI/JR和JEI/JE之间的相关性,发现考虑期刊等级后,对机构的编委指数得分以及排序影响最大。

To solve the difficulty in obtaining multidimensional data and the insufficiency of the quantitative and qualitative combination, this paper proposes a Journal Editorship Index （JEI） to assess the scholarly impact of aca- demic institutes based on the journal editorial board data. The editorial board members are responsible in combining an assessment of both quantitative approaches and peer review. The JEI takes into account the influence of the journal rating, editor title, and board size. Experiments are conducted to assess the scholarly impact of geology institutions based on the editorial boards of 111 geology journals （which is comprised of 3811 members） in the Excellence in Research for Australia journal list. The results show that the JEI can well characterize the academic influence of the scientific research institutions. Moreover, the JEI score and editorial board member of the academic institutions in the field of geology show an unequal distribution. The JEI scores have a significant correlation with the number of jour- nal papers, including the total cited times and H indices. The robustness analysis of the evaluation results shows that considering the influence of the factors, such as editorial level, journal grade, and editorial scale, will change the evaluation results. The results also indicate that the different weights of the influence of the factors will generate the same evaluation results. By calculating the correlation between the JEI index and the derived indices, such as JEI/JT, JEI/JR, and JEI/JE, the JEI score of the academic institutes has the greatest impact when the journal rating is consid- ered.