分布式XML Twig查询处理方法

Distributed XML Twig query processing method

在单机环境下,难以处理半结构化XML大数据查询,为此分析Twig查询的结构匹配特征,基于MapReduce编程模型,提出TwigMRR算法对XML Twig查询进行分布式处理。对XML数据进行Dewey编码,水平切分后存储于分布式文件系统,通过执行Map-Reduce-Reduce任务对Twig分解后的线性路径查询进行分布式并行计算以取得结果。实验结果验证了该算法的有效性和完整性,与类似算法的比较结果表明了其在处理效率方面的优势。

To deal with the difficulties of large-scale XML query processing in single computer unit,Twig query structure matching features were analyzed,TwigMRR algorithm was proposed for XML Twig queries distributed processing based on MapReduce program model.XML data were stored into distributed file system after encoded using Dewey and partitioned horizontally.Map-Reduce-Reduce tasks were executed to evaluate the linear path queries generated with the divided Twig.The experimental results show that the proposed approach is efficient and scalable,and it is more effective than other related works.