CiteOpinion: Evidence-based Evaluation Tool for Academic Contributions of Research Papers Based on Citing Sentences

Purpose:To uncover the evaluation information on the academic contribution of research papers cited by peers based on the content cited by citing papers,and to provide an evidencebased tool for evaluating the academic value of cited papers.Design/methodology/approach:CiteOpinion uses a deep learning model to automatically extract citing sentences from representative citing papers;it starts with an analysis on the citing sentences,then it identifies major academic contribution points of the cited paper,positive/negative evaluations from citing authors and the changes in the subjects of subsequent citing authors by means of Recognizing Categories of Moves(problems,methods,conclusions,etc.),and sentiment analysis and topic clustering.Findings:Citing sentences in a citing paper contain substantial evidences useful for academic evaluation.They can also be used to objectively and authentically reveal the nature and degree of contribution of the cited paper reflected by citation,beyond simple citation statistics.Practical implications:The evidence-based evaluation tool CiteOpinion can provide an objective and in-depth academic value evaluation basis for the representative papers of scientific researchers,research teams,and institutions.Originality/value:No other similar practical tool is found in papers retrieved.Research limitations:There are difficulties in acquiring full text of citing papers.There is a need to refine the calculation based on the sentiment scores of citing sentences.Currently,the tool is only used for academic contribution evaluation,while its value in policy studies,technical application,and promotion of science is not yet tested.

Construction of an evaluation index system for the innovativeness of nursing papers using the Delphi method

Objective： The goal of this study was to construct an evaluation index system for the innovativeness of nursing papers. Methods： A total of 17 nursing experts were consulted for two rounds, and the reliability and weight of the constructed evaluation index system for the innovativeness of nursing papers were determined. Results： An evaluation system for the innovativeness of nursing papers was constructed, including 3 primary indexes, 8 secondary indexes, 14 tertiary indexes, and 8 quaternary indexes. The 3 primary indexes with their weights were new argument （0.547）, new evidence （0.345）, and new conclusion （0.109）. Conclusions： The representativeness, the enthusiasm for the study, the degree of authority, the degree of coordination, and the convergence of the experts were high： therefore, an evaluation index system for the innovativeness of nursing papers based on the Delphi method can comprehensively and scientifically evaluate the innovativeness of nursing papers.

Evaluation of an Oral Test Paper

This paper is to evaluate an oral test paper for the middle school graduates of Jiangsu Province according to its validity and reliability.And then the advice on how to improve the reliability is given.

CHINA FOUNDRY Outstanding Paper Award Evaluation Results

CHINA FOUNDRY,begun in August 2004,sponsored by Shenyang Research Institute of Foundry,the only foundry research institution in China’s foundry industry,is a peer-revewed and SCI-E-indexed scholarly journal.It is now published jointly by Foundry Journal Agency and Springer in English to a worldwide readership.In order to recognize high quality and highly cited papers,and to enhance the quality and academic level of journal publication,CHINA FOUNDRY journal agency assessed articles published in 2015 and 2016.

Research on Printing Quality Evaluation of Decorative Paper Based on AHPEWM Model

Printing quality evaluation is an important means to check whether prints are qualfied.However,the urrent printing quality evaluation system for gravure decorative paper is not perfect.In order to solve this problem,a method for evaluating quality of decorative paper based on analytical hierarchy process(AHP)and the entropy weight method(EWM)model is proposed in this paper.So as to verify the proposed model,decorative paper of different grades was selected as the experimental objects.Firstly,the data about five indices eflecting printing quality were measured.Secondly,the evaluation model was used to assign weights to the indices,and scores in each index were calculated according to scoring tables.Finally,the evalua tion scores were statistically analyzed.The results of data analysis showed that the 95% confidence intervals and coefficients of variation were small.The average error of the evaluation system was 0.2061.It indicates that the model can stably distinguish decorative paper of diferent grades,accuracy of which is high.The research in this paper can provide reference to the quality improvement of decorative paper and the printing quality evaluation of other paper.

Evaluation and Comparison of Marine Sci-tech Innovation Ability of 11 Coastal Provinces in China: A Case Study of Guangdong

Through building an indicator system for evaluating the marine sci-tech innovation ability of China's coastal provinces,this paper made a comparative analysis on marine sci-tech innovation ability of 11 coastal provinces in 2011-2013 by the principal components analysis( PCA) method. It found these coastal regions can be divided into three levels. Guangdong Province belongs to the first level because its marine sci-tech innovation ability is relatively high. On this basis,it analyzed changes in marine sci-tech innovation ability of 11 coastal provinces with the aid of DEA's Malmquist productivity index model. Results indicate that the overall marine sci-tech innovation ability of 11 coastal provinces is rising,but there is significant difference between provinces and the influence of regional economic development level is not considerable.Technical progress is main driver for promoting marine sci-tech innovation ability of Guangdong Province and major factor influencing ranking of total factor productivity.

Statistical Analysis for Test Papers with Software SPSS

Test paper evaluation is an important work for the management of tests,which results are significant bases for scientific summation of teaching and learning.Taking an English test paper of high students'monthly examination as the object,it focuses on the interpretation of SPSS output concerning item and whole quantitative analysis of papers.By analyzing and evaluating the papers,it can be a feedback for teachers to check the students'progress and adjust their teaching process.

引用评论证据视角下高水平论文遴选研究

论文作为科研成果的重要表现形式,在“破五唯”的大背景下,科学遴选高水平论文至关重要,是保障代表作评价工作落地的基本抓手。引用评论是学术共同体对论文价值最直接的认可,亦是学术评价的实质性关键证据,对其内容进行深入挖掘有助于更科学地发现高水平论文。首先,本文基于学术认同理论和证据特征阐释了模型构建的基本思想;其次,对基于内容语义的引用情感和引用功能进行重新界定和分类,并充分考虑“施引作者可信度”,构建高水平论文遴选综合加权模型;再其次,选取化学领域顶级刊物Angewandte Chemie-International Edition中的相关论文展开实证研究,结果表明,本文提出的模型可以较精准地筛选出“非常重要论文(very important paper,VIP)”;最后,与其他主流评价指标进行比较分析,证实了本文模型具有较高的区分度和鉴别度,在论文学术水平评价中具有显著优越性。

基于主题模型的论文标准化影响力指标研究——一个新的论文标准化影响力指标GTNI

当前学界关于论文的标准化评价指标多从学科角度分类,忽视论文主题的多样性且每一主题概率不同等问题。文章在CNCI(Category Normalized Citation Impact,学科规范化影响力)指标基础上,结合主题模型、引文分析等方法提出构建可横向比较的普适性指标GTNI(General Topic Normalized Citation Impact,基于主题模型的论文标准化影响力),以提高学术论文评价的科学性。GTNI是对论文每一主题被引进行标准化并综合而获得的指标。通过理论分析、指标构建、实证研究和对比检验,表明GTNI指标在论文影响力评价方面具有较好的效果,且具有应用前景。

期刊论文支撑数据FAIR原则的应用评估与案例分析

[目的/意义]FAIR原则在科技期刊的应用有助于增强期刊论文支撑数据的可发现、交互、共享与重用。评估FAIR实施情况有利于其推广实施,以期为我国期刊论文的支撑数据共享与重用提供有益参考。[方法/过程]本文在国外FAIR原则评估模型的基础上,综合考虑各模型的优势和指标设计特点,结合《数据分析与知识发现》期刊论文相关的科学数据特征,构建FAIR原则指标评价体系,基于该体系从4个维度分析调研结果,最后对中文期刊论文的支撑数据FAIR应用提出合理化建议与优化策略。[结果/结论]FAIR原则在期刊论文支撑数据的应用仍需进一步完善,科研人员的数据共享意识及对于FAIR原则的认知度远远不够,建议从宏观和微观两个层面推广FAIR原则及其实施,推动数据更加开放和可重用。

基于Faculty Opinions最新推荐评分的生物医学科技论文评价指标相关性研究

目的/意义分析不同生物医学科技论文数据库中的各类评价指标,挖掘其中隐含关联。方法/过程以Faculty Opinions推荐的文献为基础,分别从Altmetric、Scopus、WOS数据平台获取各类代表性指标,运用SPSS软件进行斯皮尔曼相关性比较分析。结果/结论不同学科类别文章Faculty Opinions最新推荐评分中,RS与WSS的相关度最高,RCR与RS相关度中等,Scopus各指标均与社会计量学各指标高度相关,Scopus与WOS各指标之间的相关度较高。

2016—2020年长江科学院发表的科技论文被SCI、EI和CPCI收录情况分析

利用SCI、EI和CPCI三大索引数据库对2016—2020年长江科学院所发表论文进行检索统计,运用文献计量法,从所收录论文的数量、专业、著者、作者群分布情况包括作者群年龄、学历、职称等方面进行统计、归纳和分析,并与前5 a统计数据比较,从产出论文这一侧面了解和反映长江科学院近几年来科研、专业和人才结构情况:科研实力和国际影响力得到较大增强,在保持传统专业科研实力的同时,新兴专业的科研实力也迅速提升,对外合作加强,拥有较高层次的科研人才队伍且趋于年轻化。研究结果可为长江科学院学科建设和科研绩效评估提供数据参考。

低碳视域下造纸产业绿色供应链运作模式构建与评价研究

传统的制浆造纸产业具有典型的高污染、高能耗特征,对造纸产业供应链进行绿色化改革是该产业应对低碳化发展要求的重要举措之一。基于此,以造纸产业的低碳化发展为基本出发点,对造纸产业绿色供应链的运作模式进行分析并搭建了一种对应的运作模式,基于系统性、全面兼顾重点性、科学兼顾实用性等原则构建了DEA-AHP-Fuzzy评价模型,借助该模型对造纸产业绿色供应链运作模式进行评价。结果表明:该模型可以很好地反映造纸产业绿色供应链水平。

科技论文评价指标体系的研究现状及发展研究

文章梳理了我国科技论文评价指标体系的研究现状,总结研究热点、把握研究趋势,为科技论文评价指标体系的完善和发展提供理论参考。采用CiteSpace R6.1可视化分析工具,围绕与“科技论文评价指标体系”相关的关键词进行了系统分析,旨在深入探讨当前研究的热点问题。研究发现,国内相关论文的研究主题主要包括科技论文评价体系指标、指标体系构建、多维指标、学术创新评价、评价改革等。首先,回顾了学术论文评价指标的起源和发展历程,包括传统的引用次数、影响因子等指标,以及近年来兴起的学术社交网络和科学影响力指数等新型指标。其次,通过对相关文献的分析,总结了当前学术界对于评价指标的研究热点和关注领域,包括学科差异、合作网络、知识转化等方面。最后,展望了未来学术论文评价指标的发展趋势,包括引入多维度评价指标、采用人工智能技术进行评估、推动开放科学运动等。

生成式人工智能分析工具在高考评价中的应用:以Kimi为例

选用Kimi作为生成式人工智能AIGC分析工具,以某市2023年高中学业水平等级性考试历史学科试卷和考生答题卡为分析内容,探讨AIGC在高考评价中的应用。研究表明:Kimi协同工作模式可以优化试卷结构分析,提升考生水平临界分数划定效度,提高评价结果反馈的时效性和针对性;但存在问题判定过分广泛、不能深入推理发现材料之间的关系、有时会给出错误结论或理由、无法明确进行微调等问题。

《情报理论与实践》创刊60周年代表性论文评价研究

[目的/意义]在《情报理论与实践》创刊60周年之际,回顾期刊发展历程,对刊载的学术论文开展科学评价,对于期刊把握未来发展方向具有重要意义。[方法/过程]基于中国知网收录的《情报理论与实践》数据(1980—2024年),综合论文影响力、作者影响力和机构影响力来筛选《情报理论与实践》在不同时期的代表性论文。[结果/结论]形成《情报理论与实践》60篇代表性论文。

医学院校高被引论文多源数据评价指标相关性研究

目的/意义了解医学院校高被引论文在不同数据库中多源评价指标相关性,为文献资源发现、利用、评估提供参考。方法/过程以2013—2023年首都医科大学高被引论文为研究对象,分析其在H1 Connect、Dimensions、ESI、Web of Science、InCites、SciVal数据库中的38个评价指标,对代表性指标,专利、政策引用指标,浏览使用指标,相对指标,期刊指标,被引频次,Altmetric指标分别进行相关性分析。结果/结论各组相似指标具有相对较高相关性,个别指标如加权星级和微博提及数与大多数不同平台指标没有显著相关性。

医学博士学位论文质量与学术论文发表关系的实证研究

目的:了解某大学附属医院2015年至2019年博士学位论文的评阅结果和学术论文的发表情况,分析博士学位论文质量及其与学术论文发表的相关性,为博士质量评价提供参考和建议。方法:采用描述性分析和方差分析等方法对博士学位论文评阅结果和学术论文发表进行分析。结果:博士学位论文质量总体较高,其中“创新成果”指标得分最低。发表SCI论文的博士较多,发表高影响因子论文的博士较少。博士学位论文质量和学术论文发表之间有一定的相关性。结论:要提升博士研究生的科研创新能力,重视但不唯SCI论文,完善博士学位论文盲审评阅制度。

国家重点研发计划“增材制造与激光制造”重点专项2016—2018年项目资助SCIE论文评价研究

基于Web of Science和InCites数据库,从论文产出概况、被引和影响力两个维度,以“增材制造与激光制造”重点专项2016—2018年项目为研究对象,对其产出的SCIE论文质量开展评价研究。研究发现:单一指标显示各项目论文产出差异较大,而多个定量指标的组合能提供论文质量相关的丰富信息。建议在国家重点研发计划项目验收和综合绩效评估工作中,增加论文等相关科研成果的评估报告,并由项目管理机构牵头落实,使现有的以同行评议为主的项目验收和综合绩效评估工作更加完善。研究结果可以为国家重点研发计划项目验收和综合绩效评估工作提供参考。

新一轮审核评估下应用型高校本科生考卷质量问题及对策

教育部新一轮本科教育教学审核评估及应用型大学要求学校以学生为中心,产出为导向,培养学生以服务地方经济社会及解决实际问题的能力为人才培养目标。学业评价是人才培养目标实现不可或缺的环节。考卷质量是影响学业评价的重要因素。本文以某些高校的试卷为案例,分析了本科生学业评价试卷中存在的问题。研究表明,试卷的形式规范,但部分试卷存在题量与难度不当、试卷考核目标单一、试题缺乏贴切的情境材料、教师命题能力有待提高等问题。研究认为,强化教育测评理论学习,夯实教师命题理论根基;整合资源,强化培训,提高教师命题能力;开展试卷评比活动,构建优秀试卷案例库,优化命题观念;以内涵为抓手,优化审核内容,提高试卷质量等是解决问题的有效对策。