基于大数据的分布式文件系统技术研究

Research on distributed file system technology based on big data

随着我国计算机网络水平不断提升,互联网企业也在不断加强数据处理工作,确保可以更好的应对大规模数据处理需求。从当今数据发展现状来看,数据存储量大是十分典型的特征,而传统分布式文件系统已经无法满足海量数据存储、处理工作,这就需要结合大数据技术,加强新型分布式文件系统研究。本文首先提出大数据、clover相关含义,进而提出基于大数据的分布式文件系统方案。

With the continuous improvement of China’s computer network level, Internet enterprises are constantly strengthening the data processing work, to ensure that can better deal with the needs of large-scale data processing. In view of the current status of data development, large data storage is a typical feature, while the traditional distributed file system has been unable to meet the needs of mass data storage and processing, which requires the combination of big data technology to strengthen the research of new distributed file system. Based on this, this paper first proposes the meaning of big data and clover, and then proposes a distributed file system scheme based on big data.