期刊文献+
任意字段
题名或关键词
题名
关键词
文摘
作者
第一作者
机构
刊名
分类号
参考文献
作者简介
基金资助
栏目信息

一种数据网格存储模型与并行下载调度算法 被引量：2

A storage model and its corresponding parallel download scheduling algorithm for data grid systems
下载PDF
导出
摘要 针对在数据网格中创建多副本虽可有效提升下载速度、降低网络流量,但多副本创建会带来大量存储开销和网络流量开销,以及基于GridFTP协议的各种并行下载算法虽可进一步提升下载速度,但仍不能解决多副本对存储空间和网络流量的影响的问题,提出了一个能保证数据的完整性、存储的可靠性和降低存储空间的数据网格存储模型,并基于该存储模型和GridFTP协议,提出了一个并行下载调度算法。实验表明,该算法只需要较少的冗余便可达到现有的针对全副本的并行下载算法可达到的理想下载速度,取得较好的效果,实现并行快速传输、节约存储空间和降低网络流量的目标。 To solve the problems that creating a number of copies in data grid systems can bring great overheads in data storage and network traffic and a variety of parallel download algorithms based on the GridFTP protocol can not eliminate the influence of multi-copy on the storage space and network traffic, the paper puts forward a storage model for data grid systems to guarantee data integrity, storage reliability and reduce storage space, and presents a parallel download scheduling algorithm based on the model and the GridFTP protocol. The experimental results show that the proposed algorithm can achieve a better effect in fast parallel transmitting, storage space saving and network traffic reducing.
作者 曲明成 吴翔虎 廖明宏 杨孝宗 左德承
机构地区 哈尔滨工业大学计算机科学与技术学院 厦门大学软件学院
出处 《高技术通讯》 EI CAS CSCD 北大核心 2010年第1期26-32,共7页 Chinese High Technology Letters
基金 国家自然科学基金(60533110)资助项目
关键词 数据网格 存储模型 并行下载调度算法 GRIDFTP data grid, storage model, parallel download scheduling algorithm, GridFTP
分类号 TP393.06 [自动化与计算机技术—计算机应用技术]
  • 相关文献

参考文献9

  • 1陈磊,李三立.数据网格中一种填空式副本分配算法[J].电子学报,2006,34(11):1951-1954. 被引量：3
  • 2Liu P F,Wu J J.Optimal replica placement strategy for hierarchical data grid systems.In:Proceedings of the 6th IEEE International Symposium on Cluster Computing and the Grid.Washington D.C.,USA:IEEE Computer Society,2006.1-4.
  • 3Tim H,David A.A unified data grid replication framework.In:Proceedings of the 2nd IEEE International Conference on e-Science and Grid Computing.Washington D.C.,USA:IEEE Computer Society,2006.1-8.
  • 4Feng J,Cui L L,Glenn W,et al.Toward seamless grid data access:design and implementation of GridFTP on.NET.In:Proceedings of the 6th IEEE/ACM International Workshop.Washington D.C.,USA:IEEE Computer Society,2005.1-8.
  • 5Vazhkudai S.Enabling the co-allocation of grid data transfers.In:Proceedings of the 4th International Workshop on Grid Computing.Washington D.C.,USA:IEEE Computer Society,2003.1-8.
  • 6William A,John B,Rajkumar K,et al.The globus striped GridFTP framework and server.In:Proceedings of the 2005 ACM/IEEE SC/05 Conference.Washington D.C.,USA:IEEE Computer Society,2005.1-11.
  • 7Bhuvaneswaran R S,Yoshiaki K,Naohisa T.Dynamic co-allocation scheme for parallel data transfer in grid environment.In:Proceedings of the 1st International Conference on Semantics,Knowledge,and Grid.Washington D.C.,USA:IEEE Computer Society,2006.1-6.
  • 8Vazhkudai S.Distributed downloads of bulk,replicated grid data.Journal of Grid Computing,2004,2:31-42.
  • 9Gaurav K,Umit C,Tahsin K,et al.A dynamic scheduling approach for coordinated wide-area data transfers using GridFTP.In:Proceedings of the 22nd IEEE International Parallel and Distributed Processing Symposium (IPDPS 2008),Miami,Florida,USA,2008.1-12.

二级参考文献11

  • 1陈磊,顾雷,李三立.医学数据网格中数据一致性问题研究及实现[J].小型微型计算机系统,2006,27(5):813-817. 被引量：2
  • 2陈磊,李三立.网格数据复本管理的动态自适应软件体系结构[J].软件学报,2006,17(6):1436-1447. 被引量：3
  • 3A Chervenak,I Foster,C Kesselman,C Salisbury,S Tuecke.The data grid:towards an architecture for the distributed management and analysis of large scientific data sets[J].Journal of Network and Computer Applications,2001,23:187-200.
  • 4W Hoschek,F J Jaen-Martinez,A Samar,H Stockinger,K Stockinger.Data management in an international data grid project[A].Proceedings of the First IEEE/ACM International Workshop on Grid Computing[C].London,UK Springer-Verlag.2000.77-90.
  • 5C Baru,R Moore,A Rajasekar,M Wan.The SDSC storage resource broker[A].Proceedings of the 1998 Conference of the IBM Centre for Advanced Studies on Collaborative Research (CASCON'98)[C].Toronto,Canada.IBM Press.1998.5-16.
  • 6O Frieder,H T Siegelmann.Multiprocessor document allocation:A genetic algorithm approach[J].IEEE Transactions on Knowledge and Data Engineering,1997,9(4):640-642.
  • 7I Foster,C Kesselman.A data grid reference architecture[R].GriPhyN-2001-12,http://www.griphyn.org,2001.
  • 8J Bester,I Foster,C Kesselman,J Tedesco,S Tuecke.GASS:a data movement and access service for wide area computing systems[A].Proceedings of the Sixth Workshop on I/O in Parallel and Distributed Systems[C].Atlanta,Georgia,United States:ACM Press.1999.78-88.
  • 9C A Steed.J E Braud,K A Koehler.VGRID:a generic,dynamic HDF5 storage model for geo referenced grid data[A].Proc of MTS/IEEE OCEANS2002[C].Biloxi,Mississippi,USA:Marine Technology Society.2002.900-907.
  • 10L C Hu.S X Sun.ADS-a handle-based storage architecture under grid computing[A].Proc of the IEEE 18th Annual Workshop on Computer Communications (CCW 2003)[C].Dana Point,California,USA:IEEE Communications Society,2003.187-193.

共引文献2

同被引文献21

  • 1陈兰香,许力.云存储服务中可证明数据持有及恢复技术研究[J].计算机研究与发展,2012,49(S1):19-25. 被引量：28
  • 2Pacitti E, Valduriez P, Mattoso M. Grid data manage- ment: open problems and new issues. Journal of GridComputing, 2007, (5) :273 - 281.
  • 3Ho T, Abramson D. A unified data grid replication frame- work. In: Proceedings of the 2nd IEEE International Conference on e-Science and Grid Computing, Washing- ton, D.C., USA,2006. 1-8.
  • 4Liu P F, Wu J J. Optimal replica placement strategy for hierarchical data grid systems. In : Proceedings of the 6th IEEE International Symposium on Cluster Computing and the Grid, Singapore, 2006. 1-4.
  • 5Allcock W, Bresnahan J, Kettimuthu R, et al. The glo- bus striped GridFTP framework and server. In: Proceed- ings of the 2005 ACM/IEEE Supercomputing Conference, Seattle, USA, 2005.1-11.
  • 6Feng J, Cui L L, Wasson G, et al. Toward seamless grid data access: design and implementation of GridFTP on NET. In : Proceedings of the 6th IEEE/ACM Internation- al Workshop on Grid Computing, Seattle, USA , 2005.
  • 7Liu W T, Kettimuthu R, Tieman B, et al. GridFl'P GUI: an easy and efficient way to transfer data in grid. Social- lnformatics and Telecommunications Engineering, 2010, 25:57-66.
  • 8Bhuvaneswaran R S, Katayama Y, Takahashi N. Dynam- ic co-allocation scheme for parallel data transfer in grid environment. In: Proceedings of the 1st International Conference on Semantics, Knowledge, and Grid, Bei- jing, China, 2006. 1-6.
  • 9Khanna G, Catalyurek U, Kurc T, et al. A dynamic scheduling approach for coordinated wide-area data trans- fers using GridFTP. In:Proceedings of the IEEE Interna- tional Symposium on Parallel and Distributed Processing, Sydney, Australia, 2008. t-12.
  • 10Vazhkudai S. Distributed downloads of bulk, replicated grid data. Journal of Grid Computing, 2004, (2) : 31-42.

引证文献2

高技术通讯
2010年 第1期

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部