TREC人机交互检索评价项目研究

Study of the TREC Interactive IR Evaluation Track

介绍TREC交互项目的研究目标、试验设计、评价结果及其发展归宿。将TREC交互项目的发展划分为4个阶段,介绍各阶段在评价指标、试验课题等方面的变化,其中评价指标包括方面查全率、方面查准率、检索耗费时间及用户满意度等。从中可以发现,信息检索评价领域越来越注重“面向用户”的特征。

This paper introduces the development of TREC interactive track, and the focus of the paper is laid on the goal, design, results and the destiny of the track. By dividing the history of TREC interactive track into four phases, the paper also shows the different evaluation measures used in various phases, which include aspect precision, aspect recall, retrieval time and user satisfaction. The TREC interactive track clearly shows us the ＇ user-oriented＇ trend in the information retrieval evaluation field.