CWI中的分布式图数据存储与查询

Distributed Graph Storage and Query System for CWI

现存的Web分析技术大多基于数据的文本内容,而忽视了数据本身的结构信息。为此,介绍CWI——一种新的海量数据分析和查询工具。作为CWI的一部分,TLGM和TLGM-Ql实现了对于Web数据内容和结构的查询分析,并且在分布式环境下实现了TLGM的图数据存储,实现了TLGM-QL的4个基本算子,实验证明该结构具有良好的平衡性和可扩展性。

Most previous work focuses on analyzing the content of the Web data,while ignores the structural information in the data. This paper introduces a massive data analysis and query tool,CWI. As a part of CWI,TLGM and TLGM-QL implement the analysis of both the content and structure of the Web data. TLGM implemented in a distributed enviorment that adopt the graph to model the Web ,where both the content and structure of the Web data are stored. Based on this storage model,four basic operators and the re-construction of graph are implemented. The experiments domenstrate that our storage framework has good balance and scalability.