面向探索式搜索的认知结构量化评估

Quantitative Assessment of Cognitive Structure for Exploratory Search

[目的/意义]在探索式搜索情境下,提出一套对用户认知结构进行量化评估体系,用以衡量用户信息吸收与利用的效果。[方法/过程]文章以用户在探索式搜索过程中建构的认知结构为研究对象,基于意义建构理论和层次语义网络模型提出了一套定量评价认知结构的指标量化体系,包括概念节点的丰富性、专业性、有效性以及概念关系的联系性、层次性和探索性6个量化指标,依据相关理论为其赋予不同的权重;并以武汉大学本科生为实证研究对象,设计实验对该量化体系进行验证和评估。[结果/结论]实验结果显示采用该6个量化指标对本科生所做概念图的评估与其学习效果呈显著正相关,文章所提出的量化体系能够较为有效地对用户在探索式搜索中建构的认知结构进行评估。[局限]量化指标的评分难以实现自动生成,部分指标需要人工判定。

[Purpose/significance]In the context of exploratory search,a set of quantitative evaluation system for user cognitive structure is proposed to measure the effect of user information absorption and utilization.[Method/Process]This paper takes the cognitive structure constructed by users in the exploratory search process as the research object.Based on the sense-making theory and the hierarchical semantic network model,the paper proposes a set of quantitative evaluation system for quantitative evaluation of cognitive structure,including 6 quantitative indicators:the richness,professionalism,effectiveness of concept nodes and the linkage,hierarchy and exploratory of the concept relationships.And different weights were given according to relevant theories.Finally,the paper takes Wuhan University undergraduate students as the empirical research object to evaluate the quantitative evaluation system.[Result/conclusion]The experimental results suggest that the evaluation of the conceptual maps of undergraduates by the 6 quantitative indicators is significantly positively correlated with the learning effect.The quantitative system proposed in the paper can effectively evaluate the cognitive structure constructed by users in exploratory search.[Limitations]It is difficult to automatically generate the scores of quantitative indicators,and some indicators need to be manually determined.