基于网格技术的分布式大数据混合云存储方法

Research on Distributed Big Data Hybrid Cloud Storage Based on Grid Technology

为提升分布式大数据的存储能力,实现大数据的定向迁移与应用,提出基于网格技术的分布式大数据混合云存储方法。采用网格技术设计Hadoop型云框架、大数据调度模块、信息互感平台,完成分布式存储结构搭建。在此基础上,通过划分大数据存储关系,定义混合云存储的具体格式,实现分布式大数据混合云存储方法设计。实验结果表明,与传统分级信息存储方法相比,新方法的大数据定向迁移速率达到4.5×10^7T/h,存储容量的上限也明显提升,能够充分满足分布式大数据存储需求。

In order to improve the storage capacity of distributed big data and realize the directional migration and applica-tion of big data,a hybrid cloud storage method based on grid technology is proposed.Using grid technology to design Hadoop cloud framework,big data scheduling module and information mutual inductance platform to complete the construction of distributed storage structure.On this basis,through the division of big data storage relationship,the specific format of hybrid cloud storage is defined to realize the design of hybrid cloud storage method for distributed big data.The experimental results show that compared with the traditional hierarchical information storage method,the directed migration rate of big data of the research method is4.5×10^7 T/h,and the upper limit of storage capacity is also significantly improved,which can fully meet the requirements of distributed big data storage.