面向教学“测评”的智能教育软件评估指标体系——《2023人工智能促进教育发展报告》节选六

Intelligent Education Software Evaluation Index System for Teaching Evaluation: Excerpt from the 2023 Annual Report on Artificial Intelligence Promoting the Development of Education (Ⅵ)

数智技术方兴未艾,智能教育软件层出不穷,面向教学“测评”的智能教育软件鱼龙混杂。构建面向教学“测评”的智能教育软件评估指标体系是掌握其质量线的关键。基于文献研究、市场调研、专家协商研讨等方法,探讨面向教学“测评”的智能教育软件评价指标体系的构建。该指标体系由二级评估维度和三级评估指标组成。评估维度中包含三个一级维度:考试测试、教师评估、学生评估。其中,考试测试维度包含五个二级维度:智能组卷、智能阅卷、智能考试分析、智能考试管理、在线考试管理;教师和学生评估维度均包含五个二级维度:数据收集、数据处理、评价方案、评价反馈、评估场景。三级评估指标包含三个一级指标:功能实现值、业务契合值、魅力属性值;五个二级指标:功能实现值、功能完整值、场景需求匹配值、功能先进值、业务创新值;若干三级指标。基于所提出的评估指标体系,可同时为深入了解现有面向教学“测评”的智能教育软件的发展水平与特征、挖掘不同类型用户使用智能教育测评软件潜在功能需求、开发新的智能教育测评软件等工作提供科学依据和理论指导。

With the flourishing of digital technology,intelligent educational software is emerging one after another,and intelligent education software for teaching“evaluation”is mixed.Building an intelligent education software evaluation index system for teaching evaluation is the key to mastering its quality line.This study examines the development of an intelligent education software evaluation index system,designed for teaching evaluation,utilizing methods including literature review,market research,and expert consultation.This indicator system includes two levels of dimensions and three levels of indicators.The three primary dimensions are exam testing,teacher evaluation,and student evaluation.The examination and testing dimensions include five secondary dimensions:intelligent paper formation,intelligent grading,intelligent exam analysis,intelligent exam management,and online exam management;Both teacher and student evaluation processes include five secondary indicators:data collection,data processing,evaluation plan,evaluation feedback,and evaluation scenarios.The three primary indicators are:functional implementation value,business fit value,and charm attribute value;The five secondary indicators are:functional implementation value,functional completeness value,scenario requirement matching value,functional advancement value,and business innovation value;In addition,it includes several three-level indicators.Based on the evaluation index system proposed,it can provide scientific basis and theoretical guidance for in-depth understanding of the development level and characteristics of existing intelligent education software for teaching evaluation,exploring the potential functional requirements of different types of users using intelligent education evaluation software,and developing new intelligent education evaluation software.