面向学生过程表现的协作问题解决能力评估研究

Research on Students’ Process Behavior Data-based Collaborative Problem Solving Ability Assessment

立德树人,促进学生全面发展是新时代教育评价改革的宗旨,践行全面发展评价观基于学生全学习过程数据,为此需要借助信息技术实现对过程行为数据的自动采集和分析,提高评估的效率和准确性。该研究以协作问题解决能力为评估对象,探索信息技术创新评估工具的实践路径。在“评估三角”理论的指导下,首先从协作问题解决能力“多维-交互”的本质出发构建三维能力评估框架;其次,依托PSAA平台设计和开发基于过程数据流的协作问题解决能力自动化评估系统,实现集触发行为、采集行为、编码行为、推断能力和报告结果于一体的评估流程,并设计了对过程行为数据特别是会话内容质性特征的自动编码模型;最后,以B市140名初中生为实验对象验证了该评估系统的有效性、有用性和易用性。未来还需不断融合新理论和新技术改进和创新测评方法和工具,助推面向学生过程表现的核心素养评估的落地。

It is the purpose of educational evaluation reform in the new era to foster talents through virtue and promote students’ all-round development, which relies on student’s entire learning process performance. Therefore, in order to improve the efficiency and accuracy of evaluation, it is necessary to realize automatic collection and analysis of process behavior data with information technology. In this study, we explore the practical path of innovating the assessment of collaborative problem solving ability. Firstly,under the guidance of “Assessment Triangle” theory, a three-dimensional ability assessment framework is constructed from the nature of “multi-dimension and interactivity”;Secondly, based on the PSAA platform, we design and develop the automated assessment system of collaborative problem solving based on process stream data, which realizes the integration of triggering behavior, collecting behavior, coding behavior, inferring ability and reporting the results into one system. Specifically, this system achieves the automatic coding of the qualitative characteristics on discourse data;Finally, a quasi-experiment in city B with 140 junior high school students is conducted to verify the validity, usefulness and ease of use of this assessment system. In the future, it is necessary to continuously innovate assessment methods and tools by integrating new theories and technologies, and thus to boost the implementation of core competency assessment rapidly based on students’ process behavior data.