基于会话代理的协作问题解决能力测评工具设计与效果验证

Design and Effect Verification Study of Collaborative Problem Solving Ability Assessment Tool based on Conversational Agent

当今社会,知识和技术的转型,使得不同领域和专业的人之间的协作更加频繁,协作问题解决能力也成为21世纪人才必备的核心技能之一。受限于协作问题解决活动复杂多变的影响因素,目前对协作问题解决能力的研究,只关注于对活动情境的测评,却难以了解学生的真实协作活动和问题解决情况。依据PISA 2015协作问题解决能力测评框架构建的测评模型,能够基于计算机会话代理技术,实现协作问题解决能力测评系统原型,并验证会话代理测评的有效性。该测评模型实现了对个体的协作问题解决行为逻辑的记录分析,这为开展协作问题解决能力的评价,提供了参考,也给基于会话代理的人机互动发展,提供了新方向。

Nowadays, the transformation of knowledge and technology makes the collaboration between people in different fields and majors more frequent. Collaborative problem-solving ability has become one of the essential core skills for talents in the21 st century. Limited by the complex and variable factors of collaborative problem-solving activities, the current assessment method for collaborative problem-solving ability only focuses on the evaluation of the activity situation, but it is difficult to understand the real situation of students’ collaborative activities and problem-solving activities. Based on the PISA 2015 collaborative problem-solving ability assessment framework, this paper builds an assessment model and combines the computer conversational agent technology to realize the prototype of the collaborative problem-solving ability evaluation system. It also verifies the effectiveness of the conversational agent assessment and explores the individual’s behavioral logic in the collaborative problem-solving activities. It provides a reference for the evaluation of collaborative problem solving ability, and also provides a new direction for the development of humancomputer interaction based on conversational agents.