面向异构类型的大数据查询优化研究

Research on Query Optimization for heterogeneous types of big data

以大数据查询优化为中心,提出面向结构化数据与非结构化数据的存储方法与查询优化,通过对异构类型的数据进行不同的处理,通过sqoop数据迁移工具将数据统一迁移到分布式数据库HBase中,利用大数据查询的相关算法对海量数据进行快速有效的查询操作,实现对大数据的高效利用。

This paper takes the data query optimization as the center,storage method is proposed for structured data and unstructured data processing and query optimization,based on heterogeneous data types will be different,unified data migration to distributed database HBase through sqoop data migration tools,fast and effective query of massive data using correlation algorithm for large data the query,to achieve efficient use of big data.