HDFS平台下基于纠删码的一种数据放置策略

A data placement strategy based on erasure code in the platform of HDFS

数据的可靠性一直是云计算领域中的热点问题,副本备份机制作为保证数据可靠性的重要手段应用比较广泛.但随着副本个数的增加,该机制浪费存储空间这一缺陷暴露无遗.为节省存储空间,采用纠删码技术保证数据的可靠性,提出了在HDFS平台下基于纠删码的一种数据放置策略.该策略以HDFS为平台,结合HDFS的副本备份策略和纠删码技术,通过改进HDFS平台下原本的数据放置策略,使改进后的数据放置策略能够适用于基于纠删码和HDFS的云文件系统.

Reliability of data was a hot topic in the field of cloud computing. The mechanism of backup as an important mean to ensure the reliability of data had been used widely, but with the increase of the number of copies, the defect of storage space wasting in this mechanism had been exposed. To save storage space, the technology of erasure codes was used to ensure the reliability of data. It was proposed a data placement strate-gy in the platform of HDFS. This strategy used HDFS as the platform, combining backup strategy of HDFS and technology of erasure code. The improved data placement strategy proposed could be applied to the cloud file system based on erasure code and HDFS by improving the original data storage strategy in the HDFS platform.