期刊文献+
共找到2篇文章
< 1 >
每页显示 20 50 100
一种纠删码条带化数据的一致性检查方法
1
作者 许亮业 石连星 单蓉胜 《上海交通大学学报》 EI CAS CSCD 北大核心 2024年第4期579-584,共6页
纠删码冗余策略常用于分布式存储系统.在纠删码数据中,条带是一致性检查的基本单元,每个条带包含多份原始数据单元和校验数据单元.为了减少纠删码条带化数据一致性检查的读取开销,提高纠删码数据一致性检查和读后写的效率,在执行纠删码... 纠删码冗余策略常用于分布式存储系统.在纠删码数据中,条带是一致性检查的基本单元,每个条带包含多份原始数据单元和校验数据单元.为了减少纠删码条带化数据一致性检查的读取开销,提高纠删码数据一致性检查和读后写的效率,在执行纠删码条带化数据写入时,为每个条带单元加入自修正数据标签(SCDT),后续对每个条带的一致性检查基于SCDT完成.该方法不需要读取每个条带中所有数据单元即可完成该条带的一致性检查,将一致性检查效率提升了1.7~2.6倍,并且当写入数据更新的条带单元数小于临界值时,可以有效减少写入的输入输出(IO)交互次数.本文方法可以更好地应对条带化数据组的部分更新,同时提高一致性检查效率. 展开更多
关键词 分布式存储系统 条带化数据 一致性检查 数据标签 纠删码
下载PDF
Novel Data Placement Algorithm for Distributed Storage System Based on Fault-Tolerant Domain
2
作者 石连星 王志恒 李小勇 《Journal of Shanghai Jiaotong university(Science)》 EI 2021年第4期463-470,共8页
The 3-replica redundancy strategy is widely used to solve the problem of data reliability in large-scale distributed storage systems. However, its storage capacity utilization is only 33%. In this paper, a data placem... The 3-replica redundancy strategy is widely used to solve the problem of data reliability in large-scale distributed storage systems. However, its storage capacity utilization is only 33%. In this paper, a data placement algorithm based on fault-tolerant domain (FTD) is proposed. Owing to the fine-grained design of the FTD, the data reliability of systems using two replicas is comparable to that of current mainstream systems using three replicas, and the capacity utilization is increased to 50%. Moreover, the proposed FTD provides a new concept for the design of distributed storage systems. Distributed storage systems can take FTDs as the units for data placement, data migration, data repair and so on. In addition, fault detection can be performed independently and concurrently within the FTDs. 展开更多
关键词 data reliability failure domain fault-tolerant domain data placement storage system distributed system
原文传递
上一页 1 下一页 到第
使用帮助 返回顶部