2018机器阅读理解技术竞赛总体报告

Overview of 2018 NLP Challenge on Machine Reading Comprehension

机器阅读理解是自然语言处理和人工智能领域的前沿课题,"2018机器阅读理解技术竞赛"旨在推动相关技术研究和应用的发展。竞赛发布了最大规模的中文阅读理解数据集,提供了先进的开源基线系统,采用改进的自动评价指标,吸引了国内外千余支队伍参与,参赛系统效果提升显著。该文详细介绍技术竞赛的总体情况、竞赛设置、组织流程、评价结果,并对参赛系统结果进行了分析。

Machine Reading Comprehension（MRC）is a challenging task in the field of Natural Language Processing（NLP）and Artificial Intelligence（AI）.2018 NLP Challenge on Machine Reading Comprehension（MRC2018）aims to advance MRC technologies and applications.The challenge releases the largest scale,open-domain,application-oriented Chinese MRC dataset,provides an open sourced baseline systems and adopts improved evaluation metrics.Over one thousand teams registered for this challenge and the overall performance of the participant systems have been greatly promoted.This paper presents an overall introduction to MRC2018,and gives a detailed description of the evaluation task settings,evaluation organization,evaluation results and corresponding result analysis.