P2P环境下存储系统的构架与可靠性分析

Architecture and Reliability Analysis of Storage System in P2P Environment

随着气象业务数据量的日益膨胀,海量数据存储已成为了各气象台站迫切需要解决的问题,同时存储设备出现物理故障后数据的丢失,也常常给气象保障业务带来巨大的损失。为此,文中设计了基于P2P的存储系统的整体构架,通过对完全副本和纠删码两种冗余方式的比较,确定了采用基于Reed-Solomon算法的数据冗余方案,并提出了基于节点可靠性的分层数据存储策略,将一部分数据编码存储在可靠度相对较高的节点上,保证了数据的高可靠性。由于采用P2P技术,系统具有很好的扩展性,相同构架和方法可以复制到其他台站。

With the inflation business data in meteorological observatory day by day, data storage become the problem needed solving urgently in meteorological observatory, meanwhile, the data lose after store equipment break down, often bring enormous loss to meteorological guarantee business too. For this reason, designed the whole framework of storage system based on P2P, through the eomparison of two kinds of redundant ways that the complete copy and erasure code, confirmed the scheme of data storage based on Reed- Solomon algorithm, and proposed that the tactics of data storage based on node dependability, store some data coding on the relatively higher reliability node, have guaranteed the high dependability of the data. The system has a good scalability because of the use P2P technology, the same structure and practices can be copied to other meteorological observatory.