期刊文献+

一种云存储服务客户端增量同步算法 被引量:2

Increment Based Data Transmission Technique for Cloud Storage Service
下载PDF
导出
摘要 随着云计算技术的飞速发展,越来越多的用户选择使用云存储服务来保存个人文件.云存储共享与协作技术允许用户之间共享云端文件,支持其他用户通过各种智能终端上的客户端对文件进行读写操作.云存储共享与协作技术带来了文件历史版本大规模共享场景的需求,这对云存储系统的并发I/O性能是极大的考验.针对云存储服务共享场景的特点,挖掘文件历史版本之间的关系,采用基于增量传输的优化技术来提升云存储系统的传输性能.在此基础上,优化算法中强弱校验过程的内存占用和磁盘读写,利用文件历史版本数据优化同步流程,有效的减少数据传输量,并且提高系统的存储性能,适用于带宽有限和网络不稳定和大规模共享同步等极端场景. With the fast development of cloud computing technology, more and more users choose cloud storage to store personal files. Storage and share technique allows users share files and visit others' files with different kinds of client on the cloud. Storage and share technique brings the demand of large-scale share scene for the versioned files. This is a big challenge for the performance of simultaneously I/0. In this paper, according to the characters of the share scene in cloud storage, we try to dig the relationships between the versions of the file and take the increment based data transmission technique. By doing this, we optimized the performance of rolling checksum skill in increment algorithm and reduce the transmission quantity and improve system storage performance. In addition, this technique can help data transmission work in limited bandwidth and network instability scenario and large-scale share-synchronization scenario
出处 《计算机系统应用》 2014年第10期152-157,共6页 Computer Systems & Applications
基金 国家自然科学基金(61202065) 国家高技术研究发展计划(863)(2012AA011204) 国家科技支撑计划(2012BAH14B02)
关键词 同步算法 云存储服务 共享同步 多客户端 并发 synchronization algorithm cloud storage service share-synchronization multi-client simultaneously
  • 相关文献

参考文献9

  • 1赵磊,郭晶,连思思.云存储系统技术综述[J].中国电子商情(通信市场),2013(4):29-33. 被引量:2
  • 2Tridgell A, Mackerras E The Rsync algorithm. Tech. Pep. TR-CS-96-05, Australian National University, 1997.
  • 3Rasch D, Bums RC. In-place Rsync: File synchronization for mobile and wireless devices. USENIX Annual Technical Conference, FREENIX Track. 2003.91-100.
  • 4Andrew T, Barker P, Mackerras P. Rsync in http. Auugn, 1999:31-35.
  • 5Jung HM, et al. Energy efficient file transfer mechanism using deduplication scheme. Convergence and Hybrid Information Technology. Springer Berlin Heidelberg. 2011. 421-428.
  • 6敖莉,舒继武,李明强.重复数据删除技术[J].软件学报,2010,21(5):916-929. 被引量:119
  • 7汤晓迪,马晓旭,宁静,刘晓洁.远程文件差异同步系统的设计与实现[J].计算机工程与设计,2010,31(20):4389-4392. 被引量:8
  • 8胡晓勤,卢正添,刘晓洁,李涛,赵庆华,赵奎.远程文件快速同步方法[J].电子科技大学学报,2008,37(4):594-597. 被引量:7
  • 9Dropbox, Inc. Dropbox Website. http://www, dropbox, com.

二级参考文献69

  • 1马晓旭,胡晓勤,邓洪敏,赵昊汉,何宇平.一种逆向的差异归档方法[J].四川大学学报(工程科学版),2009,41(4):191-195. 被引量:3
  • 2Bhagwat D,Pollack K,Long DDE,Schwarz T,Miller EL,P-ris JF.Providing high reliability in a minimum redundancy archival storage system.In:Proc.of the 14th Int'l Symp.on Modeling,Analysis,and Simulation of Computer and Telecommunication Systems (MASCOTS 2006).Washington:IEEE Computer Society Press,2006.413-421.
  • 3Zhu B,Li K.Avoiding the disk bottleneck in the data domain deduplication file system.In:Proc.of the 6th Usenix Conf.on File and Storage Technologies (FAST 2008).Berkeley:USENIX Association,2008.269-282.
  • 4Bhagwat D,Eshghi K,Mehra P.Content-Based document routing and index partitioning for scalable similarity-based searches in a large corpus.In:Berkhin P,Caruana R,Wu XD,Gaffney S,eds.Proc.of the 13th ACM SIGKDD Int'l Conf.on Knowledge Discovery and Data Mining (KDD 2007).New York:ACM Press,2007.105-112.
  • 5You LL,Pollack KT,Long DDE.Deep store:An archival storage system architecture.In:Proc.of the 21st Int'l Conf.on Data Engineering (ICDE 2005).Washington:IEEE Computer Society Press,2005.804-815.
  • 6Quinlan S,Dorward S.Venti:A new approach to archival storage.In:Proc.of the 1st Usenix Conf.on File and Storage Technologies (FAST 2002).Berkeley:USENIX Association,2002.89-102.
  • 7Sapuntzakis CP,Chandra R,Pfaff B,Chow J,Lam MS,Rosenblum M.Optimizing the migration of virtual computers.In:Proc.of the 5th Symp.on Operating Systems Design and Implementation (OSDI 2002).New York:ACM Press,2002.377-390.
  • 8Rabin MO.Fingerprinting by random polynomials.Technical Report,CRCT TR-15-81,Harvard University,1981.
  • 9Rivest R.The MD5 message-digest algorithm.1992.http://www.python.org/doc/current/lib/module-md5.html.
  • 10U.S.National Institute of Standards and Technology (NIST).Federal Information Processing Standards (FIPS) Publication 180-1:Secure Hash Standard.1995.http://www.itl.nist.gov/fipspubs/fip180-1.htm.

共引文献129

同被引文献10

引证文献2

二级引证文献10

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部