期刊文献+

文件秒传系统在云存储环境下的设计与实现 被引量:7

DESIGN AND IMPLEMENTATION OF FILE SECOND TRANSMISSION SYSTEM IN CLOUD STORAGE ENVIRONMENT
下载PDF
导出
摘要 针对云存储环境下用户数据上传速度慢的问题,设计一个文件秒传系统FSTS(File Second Transmission System)。该系统基于云存储服务器充足的数据资源,建立元数据资源库,通过将文件设计为资源共享的方式实现数据秒传,元数据资源库将云存储服务器上的数据通过唯一标识数据内容的字段组织起来,以此来保证该资源库中没有重复的数据。用户在上传数据到云存储服务器时,如果该数据的唯一标识已经存在于元数据资源库,那么只需要增加该记录的引用计数即可完成用户数据的上传,而无需通过网络传输数据的任何内容,即实现了文件的逻辑上传,并且保证了对数据的后续操作都是正常的。实验结果表明,该文件秒传系统可以很好地提高数据的上传速度以及提高云存储服务器存储空间的利用率,该方案在云存储环境下是可行的、有效的。 To solve the problem of slow speed in uploading user's data to server in cloud storage environment,this paper designs a file second transmission system. The system sets up the metadata resource library based on sufficient data resource in cloud storage servers,and implements data second transmission by designing the files to a mode of resource sharing. The metadata resource library organises the data in cloud storage server by the unique field which marks the content of data so as to ensure in the resource library there are no duplicate data.When user upload data to cloud storage server,if the unique identity of this data can be found in metadata resource system,then the system can complete user's upload operations by just increasing the reference count of the record,but not transmitting any data through internet.That is to say,it implements the logical files upload,and ensures that the following operations on the data are all normal. Experimental result indicates that the file second transmission system designed in the paper can improve the data upload speed well,and can improve the use ratio of cloud storage server space,the scheme is feasible and effective in cloud storage environment.
作者 胡渝苹
出处 《计算机应用与软件》 CSCD 2016年第4期329-333,共5页 Computer Applications and Software
关键词 文件秒传 云存储 元数据 引用计数 File second transmission Cloud storage Metadata Reference count
  • 相关文献

参考文献11

二级参考文献158

  • 1冯幼乐,朱六璋.CEPH动态元数据管理方法分析与改进[J].电子技术(上海),2010(9):1-3. 被引量:6
  • 2熊劲,范志华,马捷,唐荣锋,李晖,孟丹.DCFS2的元数据一致性策略[J].计算机研究与发展,2005,42(6):1019-1027. 被引量:11
  • 3Zhou MQ, Zhang R, Zeng DD, Qian WN, Zhou AY. Join optimization in the MapReduce environment for column-wise data store. In: Fang YF, Huang ZX, eds. Proc. of the SKG. Ningbo: IEEE Computer Society, 2010.97-104. [doi: 10.1109/SKG.2010.18].
  • 4Afrati FN, Ullman JD. Optimizing joins in a Map-Reduce environment. In: Manolescu I, Spaecapietra S, Teubner J, Kitsuregawa M, Leger A, Naumann F, Ailamaki A, Ozcan F, eds. Proc. of the EDBT. Lausanne: ACM Press, 2010. 99-110. [doi: 10.1145/ 1739041.1739056].
  • 5Sandholm T, Lai K. MapReduce optimization using regulated dynamic prioritization. In: Douceur JR, Greenberg AG, Bonald T, Nieh J, eds. Proc. of the SIGMETRICS. Seattle: ACM Press, 2009. 299-310. [doi: 10.1145/1555349.1555384].
  • 6Hoefler T, Lumsdaine A, Dongarra J. Towards; efficient MapReduce using MPI. In: Oster P, ed. Proc. of the EuroPVM/MPI. Berlin: Springer-Verlag, 2009. 240-249. [doi: 10.100'7/978-3-642-03770-2_30].
  • 7Nykiel T, Potamias M, Mishra C, Kollios G, Koudas N. MRShare: Sharing across multiple queries in MapReduce. PVLDB, 2010, 3(1-2):494-505.
  • 8Kambatla K, Rapolu N, Jagannathan S, Grama A. Asynchronous algorithms in MapReduce. In: Moreira JE, Matsuoka S, Pakin S, Cortes T, eds. Proc. of the CLUSTER. Crete: IEEE Press, 2010. 245-254. [doi: 10.1109/CLUSTER.2010.30].
  • 9Polo J, Carrera D, Becerra Y, Torres J, Ayguad6 E, Steinder M, Whalley I. Performance-Driven task co-scheduling for MapReduce environments. In: Tonouchi T, Kim MS, eds. Proc. of the 1EEE Network Operations and Management Symp. (NOMS). Osaka: IEEE Press, 2010. 373-380. [doi: 10.1109/NOMS.2010.5488494].
  • 10Zaharia M, Konwinski A, Joseph AD, Katz R, Stoica I. Improving MapReduce performance in heterogeneous environments. In: Draves R, van Renesse R, eds. Proc. of the ODSI. Berkeley: USENIX Association, 2008.29-42.

共引文献509

同被引文献58

引证文献7

二级引证文献9

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部