摘要
多模态学习分析是多模态交互、学习科学、机器学习等领域交叉形成的一个新方向,它利用多模态数据对复杂环境下的学习行为进行分析以优化学习体验。在空间结构上,多模态学习分析以学习机理为核心,以多模态交互、多模态感知、多模态语义理解为技术支撑,形成跨模态、跨空间、跨数据、跨分析的独特体系。在数据分类上,多模态学习分析涵盖学习体征数据、人机交互数据、学习资源数据和学习情境数据,形成以学习者为中心的内外数据链相融合的数据生态。在分析模型上,以传感器捕获、语义解析、机器学习、反馈解释为分析过程,以模式识别、学习分类、预测、行为变化为分析结果。未来多模态学习分析在自动化数据采集、跨空间分析建模、可扩展分析工具、学习计算、数据隐私保护等方面还有进一步的研究空间。
Multimodal learning analytics is a new direction formed by the intersection of multimodal interaction, learning science, machine learning and other fields. It uses multimodal data to analyze learning behaviors in complex environments to optimize learning experience. In terms of spatial structure,multimodal learning analytics takes learning mechanism as its core and multimodal interaction, perception and semantic understanding as its technical support, forming a unique system which is cross-modal, crossspatial, cross-data and cross-analysis. It covers learning signs data, human-computer interaction data,learning resource data and learning context data in terms of data classification, forming a learner-centered data ecology which integrates internal and external data chains. As for the analysis model, sensor acquisition, semantic parsing, machine learning and feedback interpretation are used as analysis processes,and pattern recognition, learning classification, prediction and behavior change are taken as analysis results. There is room for further research on future multimodal learning analysis in areas such as automatic data acquisition, cross-spatial analysis modeling, extensible analysis tools, learning computing,and data privacy protection.
作者
牟智佳
MOU Zhijia(Research Center for Educational Informatization,Jiangnan University,Wuxi Jiangsu 214122)
出处
《电化教育研究》
CSSCI
北大核心
2020年第5期27-32,51,共7页
E-education Research
基金
江苏省社会科学基金青年项目“基于教育大数据的学习风险预警与干预研究”(项目编号:18JYC006)
江苏省教育科学“十三五”规划2018年度重点资助课题“基于学习测评大数据的智能评价工具设计与应用研究”(课题编号:C-a/2018/01/07)。
关键词
多模态学习分析
多模态交互
学习科学
复杂学习环境
学习行为数据
Multimodal Learning Analytics
Multimodal Interaction
Learning Sciences
Complex Learning Environment
Learning Behavior Data