期刊文献+

一种海量大数据云存储系统框架设计 被引量:6

Designing a Cloud Storage System of Massive Data
下载PDF
导出
摘要 随着数据爆炸性增长,传统的存储方式已经不再满足海量数据的存储需求,云存储技术的飞速发展,使得云存储成为了一种新型的数据存储解决方案。文章在分析Hadoop分布式文件系统HDFS的基础上,提出了一种新的基于云计算环境的海量大数据存储设计方法,主要给出了文件存储方案设计以及副本方案设计等,为云计算海量数据存储与管理提供了一种可行的关键技术方案。 With the explosion of data,traditional storage methods no longer meet the massive data storage requirements. The rapid development of cloud storage technology makes cloud storage become a new type of data storage solution. Based on the Hadoop Distributed File System( HDFS),this paper puts forward a new type of distributed cloud storage solution for massive data,providing the persistence of high availability of data storage. This paper proposes a framework of storage and management of massive data,and analyzes key techniques that we need to implement the proposed framework.
出处 《常州工学院学报》 2014年第3期38-42,共5页 Journal of Changzhou Institute of Technology
基金 常州市2012年科技局应用基础研究计划项目(CJ20120009) 常州工学院2013年度校级科研基金项目(YN1316)
关键词 海量大数据 云存储系统 HDFS massive data cloud storage system HDFS
  • 相关文献

参考文献10

  • 1沈志荣,易乐天,舒继武.大规模数据中心的数据存储可靠性[J].中国计算机学会通讯,2012,8(10):8-16.
  • 2Dean J, Ghemawat S. MapReduce:Simplified Data Processing on Large Clusters[ J], Communications of the ACM,2008,51 (1) : 107 - 113.
  • 3Ghemawat S, Gobioff H, Leung Shun-Tak. The Google File Sys- tem[ J ]. ACM SIGOPS Operating Systems Review, 2003,37 (5) :29 -43.
  • 4Chang F, Dean J, Ghemawat S, et al. Bigtable : A Distributed Storage System for Structured Data [ J ]. ACM Transactions on Computer Systems (TOCS) ,2008,26(2) : 4.
  • 5武海平,余宏亮,郑纬民,周德铭.联网审计系统中海量数据的存储与管理策略[J].计算机学报,2006,29(4):618-624. 被引量:15
  • 6崔杰,李陶深,兰红星.基于Hadoop的海量数据存储平台设计与开发[J].计算机研究与发展,2012,49(S1):12-18. 被引量:141
  • 7刘树仁,宋亚奇,朱永利,王德文.基于Hadoop的智能电网状态监测数据存储研究[J].计算机科学,2013,40(1):81-84. 被引量:51
  • 8Zeng Wenying,Zhao Yuelong,Ou Kairi ,et al. Research on Cloud Storage Architecture and Key Technologies [ C ]//Proceedings of the 2rid International Conference on Interaction Sciences: Infor- mation Technology,Culture and Human. ACM,2009.
  • 9Robert G L, Gu Yuhong, Sabala N, et al. Compute and Storage Clouds Using Wide Area High performance Networks[ J]. Future Generation Computer Systems,2009,25 (2) : 179 - 183.
  • 10Storer M W, Greenan K, Long D D E, et al. Secure Data Dedu- plication [ C ]//4th Internation Workshop on StorageSS'08, Vir- ginia: Fairfax ,2008 : 1 - 10.

二级参考文献22

  • 1李建中.并行数据库的查询处理并行化技术和物理设计方法[J].软件学报,1994,5(10):1-10. 被引量:32
  • 2舒继武,薛巍,李必刚,郑纬民.一种高可扩展存储网络系统TH-MSNS的研究与实现[J].计算机学报,2005,28(3):326-333. 被引量:5
  • 3Watson R.W,Coyne R.A..The parallel I/O architecture of the high-Performance storage system (HPSS).In:Proceedings of the 14th IEEE Symposium on Mass Storage Systems,Monterey,CA,1995,9~27
  • 4Ball M,Cifuentes C,Bairagi D..Partitioning of Code for a Massively Parallel Machine.Menlo Park,CA:SUN Microsystems,2004
  • 5Stonebraker M..The case for shared nothing.Database Engineering,1986,9(1):17~24
  • 6Graefe G..Encapsulation of parallelism in the volcano query processing system.In:Proceeding of the ACM SIGMOD' 90.Baltimore,USA,1990,102~111
  • 7International Business Machines Corporation.IBM DB2 universal database application development guide:Programming server applications.IBM Publications Center:CT17UNA,2002
  • 8Newman A, Li Y F, Hunter J. Scalable Semantics-the Silver Lin- ing of Cloud [C]//IEEE Forth International Conference on eScience. 2008.
  • 9Gaggero M, Leo S, Mance S. Parallelizing bioinfomatics applica- tions with MapReduce[OL]. www. cca08, org/papers/Posterl0 Simone-Leo. pdf.
  • 10White T.Hadoop权威指南(第二版)[M].北京:清华大学出版社,2011:43—44.

共引文献201

同被引文献28

引证文献6

二级引证文献28

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部