一种均衡视频资源的分布存储方法

A distributed storage method of balancing video resources

随着互联网视频内容日益增多,视频资源的分布式存储受到关注.在分布式存储系统中,如果文件能均衡存储在各个节点会使系统更加健壮,而传统的分布式存储系统通常在失衡发生后再调整,带来了较多的IO开销.对分布式视频文件存储进行研究,提出一种利用哈希和Bloom Filter的高性能存储系统HBF,在文件存入系统时即进行存储平衡.系统具备多个节点,文件分散保存在不同的节点上,系统通过增加或删除节点使容量具备可伸缩性,而且在存储平衡方面进行了改进,使存储节点之间的存储使用量保持相对一致.实验证明,HBF使分布式视频文件存储系统具有高性能并兼顾节点存储平衡,有利于负载均衡和资源的合理利用.

With the increase of internet video contents, the method of distributively storing these videos has attracted much attention. In the distributed storage system, storage balance will make a system more robust. However traditional distributed storage systems always adjust the storage imbalance after it happens, which might cause more IO cost. This study focuses on distributed video file storage and proposes a kind of storage system based on Hash and Bloom Filter, namely HBF. It balances the storage when a file is being stored into the system. The system contains different nodes and the files are distributively stored on these nodes. The ability to easily add and remove nodes makes capacity of the system more scalable. In addition, improvments in storage balance have also been achieved, which keeps the usage of nodes storage relatively consistent. The experiments indicate that HBF achieves a good balance of nodes storage as well as the high performance of the distributed video files storage system. Thus the load balance could be greatly improved, and meanwhile the ultilization of resources would be more reasonable.