Automated writing evaluation(1995-2022):Research trends and implications

Automated writing evaluation is the use of computer programs to evaluate essays written in an educational setting.This study aims to evaluate the state of the art and the trends of automated writing evaluation research.A total of 206 automated writing evaluation-related publications published in 88 journals between 1995 and 2022 were used as the data in our study.Bibliometric methods were employed to identify the publication trends,venues for publication,productive authors,highly cited articles,seminal works,and the most frequently explored topics across the past decades.The findings show that automated writing evaluation has become a fast-growing interdisciplinary area of interest.In addition,this line of research has witnessed a growing interest in topics pertaining to the latest technology,the perception of children,the teachers’feedback,and complex tasks.Implications of our study for future research are also discussed.

Evaluations on social network analysis (SNA) research in China's Mainland:A critical assessment of journal literatures

Social network analysis(SNA) has been introduced to China's Mainland since the end of last century. It is often stated that SNA research has experienced rapid growth in China over these years, but few studies have been conducted to prove the statement. This paper aims at exploring the research status and development of SNA in China by a critical assessment of journal articles. Our findings show that SNA is an evolving and diversified research area which has rich themes and topics, and can be applied to those studies on different levels, context and disciplines, and attract researchers and scholars from various fields and domains. In addition, the information community(Library & Information Science and Information Systems) plays a leading role in the SNA related researches. The paper also points out the research on SNA in China has some limitations, so it proposes several implications for the future development of SNA research from perspectives of information science.

Patent Citations Analysis and Its Value in Research Evaluation： A Review and a New Approach to Map Technology-relevant Research

Purpose： First, to review the state-of-the-art in patent citation analysis, particularly characteristics of patent citations to scientific literature （scientific non-patent references, SNPRs）. Second, to present a novel mapping approach to identify technology-relevant research based on the papers cited by and referring to the SNPRs. Design/methodology/approach： In the review part we discuss the context of SNPRs such as the time lags between scientific achievements and inventions. Also patent-to-patent citation is addressed particularly because this type of patent citation analysis is a major element in the assessment of the economic value of patents. We also review the research on the role of universities and researchers in technological development, with important issues such as universities as sources of technological knowledge and inventor-author relations. We conclude the review part of this paper with an overview of recent research on mapping and network analysis of the science and technology interface and of technological progress in interaction with science. In the second part we apply new techniques for the direct visualization of the cited and citing relations of SNPRs, the mapping of the landscape around SNPRs by bibliographic coupling and co-citation analysis, and the mapping of the conceptual environment of SNPRs by keyword co-occurrence analysis. Findings： We discuss several properties of SNPRs. Only a small minority of publications covered by the Web of Science or Scopus are cited by patents, about 3%-4%. However, for publications based on university-industry collaboration the number of SNPRs is considerably higher, around 15%. The proposed mapping methodology based on a ＂second order SNPR approach＂ enables a better assessment of the technological relevance of research. Research limitations： The main limitation is that a more advanced merging of patent and publication data, in particular unification of author and inventor names, in still a necessity. Practical implications： The proposed mapping methodology enables the creation of a database of technology-relevant papers （TRPs）. In a bibliometric assessment the publications of research groups, research programs or institutes can be matched with the TRPs and thus the extent to which the work of groups, programs or institutes are relevant for technological development can be measured. Originality/value： The review part examines a wide range of findings in the research of patent citation analysis. The mapping approach to identify a broad range of technologyrelevant papers is novel and offers new opportunities in research evaluation practices.

Performance evaluation of best universities in China's Mainland based on ESI

The research performance of top universities in China is revealed in this study and analyzed using the essential science indicators(ESI) database.Different types of bibliometric indicators are applied in this study,including publication output and impact indicators.This study finds that the academic performance of universities in China is advancing rapidly,with many universities coming out near the top of the rankings,especially in terms of quantity of papers.The quantitative performance of universities in China is remarkable.The research results show that there is a considerable gap between quality and quantity of research output at the top universities of China,with research influence concentrated on some specific fields for selected universities.Engineering,Chemistry and Material Science are the fields with relatively outstanding performance in the top universities.

2016—2020年长江科学院发表的科技论文被SCI、EI和CPCI收录情况分析

利用SCI、EI和CPCI三大索引数据库对2016—2020年长江科学院所发表论文进行检索统计,运用文献计量法,从所收录论文的数量、专业、著者、作者群分布情况包括作者群年龄、学历、职称等方面进行统计、归纳和分析,并与前5 a统计数据比较,从产出论文这一侧面了解和反映长江科学院近几年来科研、专业和人才结构情况:科研实力和国际影响力得到较大增强,在保持传统专业科研实力的同时,新兴专业的科研实力也迅速提升,对外合作加强,拥有较高层次的科研人才队伍且趋于年轻化。研究结果可为长江科学院学科建设和科研绩效评估提供数据参考。

学科交叉研究评价:概念、原则与方法

学科交叉研究评价与学科交叉相伴而生,是保证学科交叉融合质量的关键。厘清学科交叉研究评价的核心概念,剖析同行评议、文献计量等传统科研评价方法的内涵与优缺点,进而从方法论视角指出学科交叉研究评价需要遵循整合性、多元性、动态性等原则,在实施学科交叉研究评价时,要对同行评议、文献计量等传统科研评价方法予以修正,同时有必要引入定量与定性相融合的新评价方法,即融合评价。研究有助于深化对学科交叉研究评价的理论认知,为评价实践的运行提供思路启示,促进学科深度交叉融合,助力交叉学科孵化建设。

合著论文作者贡献度评价方法研究综述

[目的/意义]通过文献调研梳理合著论文作者贡献度评价方法,总结研究不足及未来发展方向,为后续开展科技人才评价相关研究提供参考。[研究设计/方法]在Web of Science、Springe Link和CNKI等学术平台检索2010-2023年间发表的合著论文作者贡献度评价方法的研究文献,从传统评价方法、基于作者贡献声明的评价方法和基于科研产出的评价方法三个方面对文献进行归纳梳理。[结论/发现]合著论文作者贡献度评价方法已经取得了丰富的研究成果,但仍存在一些不足之处。未来的研究应从多方面出发考虑,进一步探索作者研究领域、作者学术关键词等学术背景因素对合著论文参与程度的影响,深入挖掘引文语义特征关系,以及加强对新模型及机器学习、深度学习算法的应用。[创新/价值]揭示了合著论文作者贡献度评价方法的发展进程与特点,阐述了合著论文作者贡献度评价方法的未来发展方向。

我国基础研究人才的学科分布与发展趋势研究

基础研究人才是基础学科研究的主体,承担着更新科学知识与创新创造的重要使命。了解和评估基础研究人才的学科分布和发展趋势,是相关政策制定和理论研究的重要依据,对基础研究人才培养和全球重要人才中心建设具有重要意义。本文从科睿唯安InCites数据库抽取文献数据,将被引次数累计百分比处于前10%的文献的作者界定为基础研究人才,以1‰、1%、10%为标线将其划分为A、B、C三个层次,对我国基础研究人才在各学科领域的分布情况与发展趋势进行了大数据分析,为了解我国基础研究人才总体及各层次的发展趋势提供多维度、多层面的分析方法和研究视角,为精准制定人才发展与支持政策提供实证参考。

知识生产视角下的高校科研评价:逻辑遵循与变革路径

高校科学研究作为重要的知识创新活动,受到知识生产模式现代转型广泛而深刻的影响。知识生产模式的现代转型及其复杂样态投射到高校科研评价制度中,体现为学科、情景化、社会化、市场化等多重话语与逻辑的交织。高校科研评价须充分考虑大学学术的特殊性与知识生产的复杂性,超越单一视角,形成系统思维,在时间、技术、制度、价值等多维逻辑中探索变革路径。

基于CiteSpace的焦炭在高炉中性能评价研究进展分析

科学的焦炭评价指标有利于焦炭的原料成本控制以及炼焦煤资源的更合理利用,即焦炭在高炉中的性能评价对于冶炼效率、产量和产品质量至关重要。为了解和统计焦炭在高炉中性能评价领域在1994—2023年的研究方向、热点以及研究进展,以中国知网(CNKI)和Web of Science(WOS)的相关文章为研究材料,运用文献计量分析法对1994—2023年焦炭在高炉中性能评价领域的论文数量、研究学科、研究机构及作者、关键词、研究内容趋势与前沿热点进行分析。研究通过CiteSpace软件绘制焦炭在高炉中性能评价领域的关键词图谱、关键词时间轴图谱以及关键词突现图谱,并利用office软件对相关数据进行分析。结果表明:焦炭在高炉中性能评价领域国内发文量从1994年开始经历了快速上升、动态平衡、稳步上升3个时期,国外发文量在1994—2009年之间发文量为0,从2010年起经历了爆发式增加、稳步上升2个时期;同时焦炭在高炉中性能评价领域的文章涉及多个研究学科,体现了多学科交叉的特点;焦炭在高炉中性能评价研究领域伴随着环境保护重视程度的加重,国内侧重于关注焦炭热性能、光学组织、炼焦煤、微观结构等方面,国外侧重于焦炭在高炉中的反应行为、CO_(2)捕获等方面。因此加强基础研究、技术创新以及多学科交叉互融的全要素格局对提高焦炭在高炉中性能评价的科学性及其应用具有重要的作用,有助于推动冶金工业朝着更加高效、环保和可持续的方向发展。

主观幸福感研究的发展历程与趋向——基于CiteSpace V的文献计量分析

随着新型城镇化和幸福城市建设的推进,国民幸福感的提升成为政府和社会各界的关注焦点,学界也涌现大量学术成果。然而,现有相关综述性文献存在时效性不足、研究尺度过于聚焦等问题。基于Web of Science数据库,利用信息可视化软件CiteSpace V对1990—2023年主观幸福感领域的英语文献进行共现分析、合作分析和聚类分析等,并结合传统文献研究方法,全面客观探析主观幸福感研究的发展脉络和趋向。研究发现:(1)1990年至今,主观幸福感研究经历了学科拓展、微观空间转向、深入研究和多元化发展三个阶段,多学科交叉、微观空间、人本主义为显著特征;(2)高产作者凸显而核心作者群缺乏,作者跨界合作度低,高产作者主要来自美国、西班牙;(3)研究机构合作广泛但强度不足,尚未形成核心研究群,高产机构集中在美国、加拿大、英国等。目前,主观幸福感研究发展已相对成熟,后续研究可着重关注微观邻里空间这一分析单元,以弱势群体为重点研究对象,借助新兴测度工具,不断完善主观幸福感影响机制和效应的理论框架。

国内传统村落活态保护研究热点分析与展望--基于文献可视化

传统村落作为典型的活态遗产,承载着数千年的中华文化和农耕文明,是社会关注的热点话题。运用CiteSpace和VOSviewer软件,借助Pajek网络分析工具对CNKI近年来传统村落活态保护相关研究的高质量文献进行可视化分析处理,发现研究进程受政策导向影响,可分为摸索、推进和增长三个阶段。通过关键词共现图谱和聚类图谱分析,近年来传统村落活态保护研究路径大致有:非物质文化遗产、文化景观、传统民居和乡村振兴等。通过年度重叠的研究热点演变分析,未来传统村落活态保护更多关注村落“人”的活力和动态发展需求,延续村落文脉,从冻结式守护走向活化发展,以乡村产业作为活态保护动力源,实现传统村落生产活态性、生活活跃性和文化活态性的可持续发展。

基于文献计量学的住宅设计评价研究现状及发展趋势分析

随着社会快速发展所带来的住宅需求的变化,全面地理解住宅设计评价标准对于促进设计创新至关重要。以CNKI和Web of Science平台的核心数据库为检索源,运用文献计量方法对国内外住宅设计评价研究现状进行可视化对比分析,旨在通过年度发文量、研究领域、关键词及高被引文献的分析揭示这一研究领域的研究热点、发展动态和国内外差异。研究表明:尽管国内外研究都尝试跨越学科的界限,但在研究内容和研究方法上存在显著差异。国外研究倾向于关注住宅公平性、环境可持续性,反映出对社会问题和文化价值的思考,而国内研究则更多集中于住宅产业化、技术创新和市场需求。通过比较分析揭示了国内外在住宅设计评价研究领域的共性和差异,为未来国内研究提供了新的视角。

国内外乡村建设评价的价值取向、内容体系与技术路径——基于CiteSpace的数据可视化分析

乡村建设是实施乡村振兴战略的重要任务,构建科学有效的乡村建设评价体系是促进乡村建设行动稳步落实的基础性工作与重要内容。本文运用CiteSpace软件,从文献时空分布、研究合作网络、关键词共现等角度,对国内外“乡村建设评价”相关期刊论文进行可视化分析。在此基础上,对国内外乡村建设评价的维度、方法与实践的研究现状进行述评与比较。研究发现:1)价值取向上,国内乡村建设评价研究都经历了从关注物质空间改善过渡到社会与物质空间并重的内涵演化,但国外研究较早地关注人在乡村建设评价中的主体作用;2)内容体系上,国内外乡村建设评价研究经历了从重物质、重绩效的静态评价向多维度多主体主客观协同的过程评价转变;3)技术路径上,研究对于乡村建设评价的工作机制与成效评估缺少系统性分析。最后,从建立具有多维关联效应的评价指标体系、制定适应多功能需求的多元评价标准、完善应用导向的以评促建工作机制3个方面进行展望,以期为我国乡村建设评价的理论与实践提供借鉴参考。

面向老年用户的功能沙发坐姿体压特征研究

本研究面向老年用户,采用体压分布测试技术,探究了在使用功能沙发时,不同坐姿下座面和靠背的体压分布规律。结果显示,随着坐姿变化,沙发座面的体压数据先减小后增大,但仰靠和躺靠的变化幅度较小。在沙发靠背上的体压数据方面,躺靠坐姿下的体压大于仰靠坐姿。根据主观评价分析,老年用户认为躺靠坐姿最舒适,坐姿倾角越大,用户的休息程度越高。综合主客观评价分析表明,老年人应避免长时间保持正坐姿,以减轻大腿的压力,并且设计沙发的腰靠尺寸时应考虑不同用户的体态特征,以满足不同老年用户的需求。

义务教育阶段学生音乐学科素养评价体系的区域研究

本研究以学科核心素养为导向,从“课堂学习、课外活动、音乐特长、阶段测评”四个维度搭建学生音乐学科评价框架,确定音乐基础知识基本技能、音乐审美体验、音乐专项特长三个方面评价内容,依托信息技术平台助力多元评价方式,形成区域化实施方案。引领区域范围内的学校、教师、学生、家长转变学科评价观念,真实全面反映学生音乐学科素养发展的情况。充分发挥试点评价结果的作用,聚焦关键问题,以“教学-评价-分析-改进”的行动路径考查学生的音乐学科素养,反哺课堂教学,提升美育成效。

Co-author Weighting in Bibliometric Methodology and Subfields of a Scientific Discipline

Purpose: To give a theoretical framework to measure the relative impact of bibliometric methodology on the subfields of a scientific discipline, and how that impact depends on the method of evaluation used to credit individual scientists with citations and publications. The authors include a study of the discipline of physics to illustrate the method. Indicators are introduced to measure the proportion of a credit space awarded to a subfield or a set of authors.Design/methodology/approach: The theoretical methodology introduces the notion of credit spaces for a discipline. These quantify the total citation or publication credit accumulated by the scientists in the discipline. One can then examine how the credit is divided among the subfields. The design of the physics study uses the American Physical Society print journals to assign subdiscipline classifications to articles and gather citation, publication, and author information. Credit spaces for the collection of Physical Review Journal articles are computed as a proxy for physics.Findings: There is a substantial difference in the value or impact of a specific subfield depending on the credit system employed to credit individual authors.Research limitations: Subfield classification information is difficult to obtain. In the illustrative physics study, subfields are treated in groups designated by the Physical Review journals. While this collection of articles represents a broad part of the physics literature, it is not all the literature nor a random sample.Practical implications: The method of crediting individual scientists has consequences beyond the individual and affects the perceived impact of whole subfields and institutions. Originality/value: The article reveals the consequences of bibliometric methodology on subfields of a disciple by introducing a systematic theoretical framework for measuring the consequences.

Measuring and Visualizing Research Collaboration and Productivity

Purpose： This paper presents findings of a quasi-experimental assessment to gauge the research productivity and degree of interdisciplinarity of research center outputs. Of special interest, we share an enriched visualization of research co-authoring patterns. Design/methodology/approach： We compile publications by 45 researchers in each of 1） the iUTAH project, which we consider here to be analogous to a ＂research center,＂ 2） CG1-a comparison group of participants in two other Utah environmental research centers, and 3） CG2--a comparison group of Utah university environmental researchers not associated with a research center. We draw bibliometric data from Web of Science and from Google Scholar. We gather publications for a period before iUTAH had been established （2010-2012） and a period after （2014-2016）. We compare these research outputs in terms of publications and citations thereto. We also measure interdisciplinarity using Integration scoring and generate science overlay maps to locate the research publications across disciplines. Findings： We find that participation in the iUTAH project appears to increase research outputs （publications in the After period） and increase research citation rates relative to the comparison group researchers （although CG 1 research remains most cited, as it was in the Before period）. Most notably, participation in iUTAH markedly increases co-authoring among researchers--in general; and for junior, as well as senior, faculty; for men and women： across organizations; and across disciplines. Research limitations： The quasi-experimental design necessarily generates suggestive, not definitively causal, findings because of the imperfect controls. Practical implications： This study demonstrates a viable approach for research assessment of a center or program for which random assignment of control groups is not possible. It illustrates use of bibliometric indicators to inform R＆D program management. Originality/value： New visualizations of researcher collaboration provide compelling comparisons of the extent and nature of social networking among target cohorts.

ESI研究前沿视角下图书情报学学科交叉融合研究

文章以ESI研究前沿为数据来源,以图书情报学为研究内容,采用数据计量分析方法探索学科交叉与融合状态。引入思维导图呈现模式,借助学科分布导图、学科关联导图、主题导图进行可视化分析,辅助评价学科融合产生的相关研究方向和学科热点,拓展学科研究思路。

艺术高校硕士学位论文质量评价实证研究——以北京服装学院为例

基于文献计量学原理,采用形式评价、内容评价、效用评价等方法,从载文量、学科专业、核心导师、研究主题、研究热点、引文、基金及保密论文、研究方法、下载量、被引量等视点多维度对硕士论文质量进行统计分析与研究。基于研究结果,从学科建设、导师队伍建设、产学研合作、学术创新、信息素养与学术规范、过程管理等角度提出研究生教育质量提升的对策与建议,以期助力北京服装学院向艺术高校的转型与发展。