基于学习行为数据的操作系统教学效果量化分析

Quantitative analysis of the teaching effect of operating system courses based on learning behavior data

"系统能力"是计算机专业本科生的核心能力之一,而操作系统课程是培养学生系统能力的关键。传统教学模式存在一些普遍性问题:(1)难以细粒度地区分学生能力差异性,无法提供精细的指导;(2)教学活动设计过于宏观和粗粒度,缺乏学期内和学期间的迭代反馈机制;(3)缺乏细粒度的学习行为数据,无法在微观层次分析和发现能力形成的规律。针对这些问题,设计了一个操作系统实验集成环境,不仅实现了实验发布、提交、评判等工作自动化,同时收集和分析实验过程中学生的行为数据,从而及时发现教学过程中的问题。使用实验集成环境前,在2014年只有38%的学生完成了4个实验,而使用实验集成环境的2015年这个完成率达到了62%。通过分析2015年实验中学习行为数据,发现了代码复制、预备知识不足、代码阅读以及lab2现象等问题。针对这些问题,采取了本学期与长期两方面改进措施。最后,对2015年、2016年和2017年学习行为数据的量化分析表明,教学过程的改进措施取得了明显的效果。

System capability is one of the core capabilities of the students majored in computer science, and the operating system courses are the key to cultivating it. There are some typical problems in the traditional teaching process. Firstly, it is difficult to distinguish the ability gap among students in a fine grained manner, so we cannot provide the students detailed guidance. Secondly, teaching activity design is too general and coarse-grained, and there is lack of iterative feedback mechanism during and after each semester. Thirdly, without fine-grained learning behavior data, the rules of competence acquisition cannot be analyzed and discovered at the micro level. We design an integrated experiment environment for operating systems, which can not only realize automatic experiment releasing, code committing and evaluation, but also collect and analyze the behavior data of students during the experimentation process. Thus, we can discover the problems in the teaching process in time. Only 38% of students completed at least 4 labs before the experiment environment came into use in 2014, which reached 62% in 2015. However, by analyzing the learning behavior data in 2015, we found problems such as code copying, lack of preliminary knowledge, inadequate code reading and the lab2 phenomenon. In response to these problems, we take measures both in the current semester and in the long-term period. Finally, quantitative analysis of learning behavior data for 2015, 2016 and 2017 shows that, these improvement measures achieved significant effect.