期刊文献+
任意字段
题名或关键词
题名
关键词
文摘
作者
第一作者
机构
刊名
分类号
参考文献
作者简介
基金资助
栏目信息

数据网格中一种填空式副本分配算法 被引量：3

A Calking Dynamic Replication Distribution Algorithm in Data Grid
下载PDF
导出
摘要 在数据网格应用中,数据会由于性能和可用性等原因进行复制.如何使数据复本合理分布以降低通信开销是数据网格系统需要解决的重要问题.本文针对一种简化的数据网格环境,考虑存储资源代理对数据的访问频率和代理间的网络性能,提出一种填空式数据副本分配算法(CDRDA).通过该算法得到的数据副本分配,构成多级虚拟存储架构.数据副本根据被存储资源代理访问的频率分布在访问开销小的节点上,从而使系统的整体访问效率达到近似最优. Data replication is a general mechanism to improve performance and availability for data grid applications. Distributing data replica reasonably in large scale data grid systems can decrease communication cost and improve its performances. This paper proposes a new Calking Dynamic Replication Distribution Algorithm （CDRDA） considering the communication cost among storage resource brokers and the characteristic of data accessing. By the algorithm, data replica will be distributed as a multi-level virtual cache and saved at the node in which applications can acquires the average lower communication cost. At last, the performance of the algorithm and its applications are also introduced.
作者 陈磊 李三立
机构地区 清华大学计算机科学与技术系北京
出处 《电子学报》 EI CAS CSCD 北大核心 2006年第11期1951-1954,共4页 Acta Electronica Sinica
基金 上海高校网格e-研究院项目
关键词 数据网格 数据副本 通信开销 填空式 data grid data replica cost of communication calking
分类号 TP393 [自动化与计算机技术—计算机应用技术]
  • 相关文献

参考文献11

  • 1A Chervenak,I Foster,C Kesselman,C Salisbury,S Tuecke.The data grid:towards an architecture for the distributed management and analysis of large scientific data sets[J].Journal of Network and Computer Applications,2001,23:187-200.
  • 2W Hoschek,F J Jaen-Martinez,A Samar,H Stockinger,K Stockinger.Data management in an international data grid project[A].Proceedings of the First IEEE/ACM International Workshop on Grid Computing[C].London,UK Springer-Verlag.2000.77-90.
  • 3C Baru,R Moore,A Rajasekar,M Wan.The SDSC storage resource broker[A].Proceedings of the 1998 Conference of the IBM Centre for Advanced Studies on Collaborative Research (CASCON'98)[C].Toronto,Canada.IBM Press.1998.5-16.
  • 4O Frieder,H T Siegelmann.Multiprocessor document allocation:A genetic algorithm approach[J].IEEE Transactions on Knowledge and Data Engineering,1997,9(4):640-642.
  • 5陈磊,顾雷,李三立.医学数据网格中数据一致性问题研究及实现[J].小型微型计算机系统,2006,27(5):813-817. 被引量：2
  • 6I Foster,C Kesselman.A data grid reference architecture[R].GriPhyN-2001-12,http://www.griphyn.org,2001.
  • 7J Bester,I Foster,C Kesselman,J Tedesco,S Tuecke.GASS:a data movement and access service for wide area computing systems[A].Proceedings of the Sixth Workshop on I/O in Parallel and Distributed Systems[C].Atlanta,Georgia,United States:ACM Press.1999.78-88.
  • 8C A Steed.J E Braud,K A Koehler.VGRID:a generic,dynamic HDF5 storage model for geo referenced grid data[A].Proc of MTS/IEEE OCEANS2002[C].Biloxi,Mississippi,USA:Marine Technology Society.2002.900-907.
  • 9L C Hu.S X Sun.ADS-a handle-based storage architecture under grid computing[A].Proc of the IEEE 18th Annual Workshop on Computer Communications (CCW 2003)[C].Dana Point,California,USA:IEEE Communications Society,2003.187-193.
  • 10王新军,洪晓光,王海洋,孟祥旭.网格计算中一种启发式数据分配算法的讨论[J].电子学报,2004,32(4):648-650. 被引量：2

二级参考文献15

  • 1First results and future perspectives of the European DataGrid project[EB/OL].http://www.hoise.com/primeur/02/articles/weekly/AE-PR-04-02-22.html.
  • 2H T Siegelmann,O Frieder.Document Allocation In Multiprocessor Information Retrieval Systems[R].Advanced Database Systems,LNCS 759 Springer,1993.289-310.
  • 3Wolfgang Hoschek, Javier Jaen-Martinez. Data management in an international data grid project[C]. In:ACM Int'l Work shop on Grid Computing (Grid'2000). Bangalore, India, 2000, 17-20.
  • 4W Allcock, A Chervenak, I Fosteretal. The data grids towards an architecture for the distributed management and analysis of large scientific datasets[J]. Journal of Network and Computer Applications, 2000, 23 (3):187-200.
  • 5Rajasekar A, Wan M. 2002. SRB & SRBRack - components of a virtual data grid architecture[S]. Advanced Simulation Technologies Conference (ASTC02) San Diego, 2002,15-17.
  • 6Matthias Nicola, Matthias Jarke. Increasing the expressiveness of analytical performance models for replicated databases[C].International Conference on Database Theory (ICDT'99),Jerusalem, January 1999.
  • 7Objectivity Inc[EB/OL]. http://www.objectivity.com.
  • 8Oraele[EB/OL]. http://www. oracle.com.
  • 9Foster I, Kesselman C, Tuecke S, The anatomy of the grid: enabling scalable virtual organizations, international[J]. Supercomputer Applications, 2001,15 (3).
  • 10The Data Grid:Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. A.Chervenak, I. Foster, C. Kesselman, C. Salisbury, S. Tuecke [J], Journal of Network and Computer Applications, 2001,23:187-200.

共引文献4

同被引文献30

  • 1Yu Xiangzhan, Wu Guanjun, et al. An disaster tolerance model based on dataflow replication [ A ]. Proceedings of the 2008 IEEE International Conference on Information Automation[ C ]. ZhangJiaJie, China: IEEE Computer Society, 2008. 1590 - 1594.
  • 2Mikko Pitkanen, Rim Moussa, et al. Erasure codes for increasing the availability of grid data storage[ A]. International Conference on Intemet and Web Applications and Services -AICT/ ICIW' 06[ C]. Guadeloupe, France: IEEE Computer Society, 2006.1 - 10.
  • 3Richard S. Wilkins, Xing Du, et al. Disaster tolerant Wolfpack geo-clusters[ A ]. Proceedings of the 2002 IEEE International Conference on Cluster Computing[ C ]. Chicago, USA: IEEE Computer Society 2002,12.1 - 6.
  • 4Yanlong Wang, PZhanhuai Li, et al. RWAR: A resilient Window-consistent asynchronous replication protocol[ A ]. Proceedings of the The SecO International Conference Availability,Reliability and Security[C]. Vienna, Austria: IEEE Computer Society, 2007.499 - 505.
  • 5Jun Feng, Lingling Cui, et al. Toward seamless grid data access: design and implementation of GridFTP on . NET[ A ]. The 6th IEEE/ACM International Workshop[ C ]. Vienna University of Technology, Auslria: IEEE. Computer Society ,2005.1 - 8.
  • 6Sudharshan, Vazhkudai. Enabling the co-allocation of Grid Data transfers[ A] .Proceedings of the Fourth International Workshop on Grid Computing[ C ]. Phoenix, Arizona, USA: IEEE Computer Society, 2003. 1 - 8.
  • 7R. S. Bhuvaneswaran, Yoshiaki Katayama, et al. Dynamic coallocation scheme for parallel data wansfer in Grid environment [ A]. Proceedings of the First International Conference on Semantics, Knowledge, and Grid [ C ]. Beijing, China: IEEE Computer Society, 2006.1 - 6.
  • 8William Allcock, John Bresnahan, et al. The globus striped GridFIP framework and server[ A ]. Proceedings of the 2005 ACM/IEEE SC 105 Conference[ C ]. Seattle, WA, USA: IEEE Computer Society, 2005.1 - 11.
  • 9Sudharshan, Vazhkudai. Distributed Downloads of Bulk, Replicated Grid Data[ J ]. Journal of Grid Computing, 2004,2 ( 1 ) : 31 - 42.
  • 10Gaurav Khanna, Umit Catalyurek, et al. A dynamic scheduling approach for coordinated wide-area data transfers using GridFTP[ A]. Proceedings of the 22nd IEEE. International Parallel and Distributed Processing Symposium [ C ]. Miami, Florida, USA: IEEE Computer Society,2008.1 - 12.

引证文献3

二级引证文献12

电子学报
2006年 第11期

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部