基于深度学习的学生课堂学习状态监测系统设计

Design of classroom learning state monitoring system for students based on deep learning

现阶段,学生课堂学习状态的研究大多集中在单人的在线监测,对于多人且环境复杂的线下课堂的监测还处于探索阶段。该研究针对线下教育设计了学生课堂学习状态监测系统,对学生课堂出勤情况及学生面部出现的疲劳状态进行实时监测。首先,使用DSFD人脸检测算法结合ResNet深度残差网络对学生进行人脸识别,记录学生出勤情况;然后,使用ERT回归树集合算法结合头部姿态估计对打哈欠和低头瞌睡的疲劳行为进行检测;再使用加入CBAM模块改进的YOLOv5目标检测算法对学生闭眼行为进行检测;最后,形成一套完整的集合出勤、疲劳检测的学生课堂学习状态监测系统。该系统在实际课堂的测试环境下,可以准确的对学生的出勤进行统计,并且可以实时的监测学生面部出现的打哈欠、低头瞌睡、闭眼的疲劳状态,检测的准确率均超过90%,检测速度约为14.1 fps,证明该系统具有重要的使用价值。

At present,most of the research on students’classroom learning status focus on single-person online monitoring,and the monitoring of offline classroom with multiple students and complex environment is still in the exploratory stage.A monitoring system for students’classroom learning status was designed for offline education to monitor students’classroom attendance and fatigue state of students’faces in real time.First,DSFD face detection algorithm combined with ResNet deep residual network was used to recognize students’faces and record students’attendance.Then,ERT regression tree set algorithm combined with head pose estimation was used to detect the fatigue behavior of yawning and drowsiness.Then,the improved YOLOv5 object detection algorithm added CBAM module was used to detect students’closed eyes behavior.Finally,a complete set of integrated attendance,fatigue detection of student classroom learning state monitoring system is formed.In the actual classroom test environment,the system can accurately calculate the students’attendance,and can real-time monitor the fatigue state of yawning,lower head and closed eyes on the face of the students.The detection accuracy rate is more than 90%,and the detection speed is about 14.1 fps,which proves that the system has important use value.