期刊文献+

一种集群计算系统中并行I/O文件存储分配策略 被引量:2

KKFDA:a New Approach of File Stored Assignment for Parallel I/O on Cluster Computing System
下载PDF
导出
摘要 现代计算机系统性能已经由受限于CPU转变为受限于I/ O,近年来研究人员对高性能计算中的并行I/ O问题进行了深入研究.本论文的主要工作是对集群计算中的并行I/ O子系统进行研究,提出一种文件拆分与存储分配的新策略,即:已知知识的文件拆分与分配方法(KKFDA) ,该方法保证文件存储方式与访问方式的一致性,达到了提高文件访问时的本地命中率、缩短访盘响应时间的目的.算法设计与实验证明了方法的有效性. The technologies of processor and network develop quickly and that of I/O subsystem is much slower. Based on such fact, a new strategy named Knowledge Known File Declustering and Access (KKFDA) is proposed especially aimed to the limitation about high performance computing. The main idea about the strategy is that the file access way will be known firstly before the big file is declustered and stored on disks in distributed way. The strategy uses the access information and ensures the consistency way among file declustering, storage and access. At last, the result of the higher hits in local disks, low traffic in network, and rapid response time is reachable. The designed algorithm and corresponding experiments have testified the validity of KKFDA.
出处 《小型微型计算机系统》 CSCD 北大核心 2005年第5期873-876,共4页 Journal of Chinese Computer Systems
基金 高等学校博士学科点专项基金项目 (2 0 0 40 5 3 3 0 3 6)资助 湖南省自然科学基金 (0 3 JJY40 5 4)资助
关键词 集群计算系统 并行I/O 文件拆分 数据分配 cluster computing system parallel I/O file declustering file block allocation
  • 相关文献

参考文献9

  • 1龙翔,李忠泽,高小鹏,李未.提高可扩展并行机群并行I/O效率的一个方法[J].计算机研究与发展,2000,37(6):650-656. 被引量:11
  • 2RajkumarBuyya 郑纬民 石威 江东升译.高性能集群计算:结构与系统(第一卷)[M].北京:电子工业出版社,2001..
  • 3Abawajy J H. Performance analysis of parallel I/O scheduling approaches on cluster computing systems [J]. Proceedings of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid(CCGRID'03):724-729.
  • 4Ruemmler C, Wilkes J. An introduction to disk drive modeling[J]. IEEE Computer, 1994,27(3):17-29.
  • 5Hu Yi-ming, Yang Qing. DCD-Disk caching disk: a new approach for boosting I/O performance[C]. In: Annual International Symposium on Computer Architecture, 1996: 169-178.
  • 6Michelle Y Kim. Synchronized disk interleaving [J]. IEEE Transactions on Computers, 1986,35 (11):978-988.
  • 7Lin-wen Lee, Peter Scheuermann. File assignment in parallel I/O systems with minimal variance of service time [J]. IEEE Transactions on Computers, 2000, 49(2):127-140.
  • 8Chen Fang-yu, Shikharesh Majumdar. Performance of parallel I/O scheduling strategies on a network of workstations[C]. In:Proceedings of the Eighth International Conference on Parallel and Distributed Systems (ICPADS'01):1-8.
  • 9Michael Stonebraker, Gerhard A Schloss. Distributed RAID- a new multiple copy algorithm[C]. Proceedings of 6th International Conference on Data Engineering, 1990:1-24.

二级参考文献12

  • 11,Bordawekar R,Del Rosario J M,Choudhary A.Improved parallel I/O via a two-phase runtime access strategy.In:Proc of Workshop Input/Output Parallel Computer Systems.1993.56~70
  • 22,DeBenedictis E P,Madams P.Ncube's parallel I/O with Unix capability.In:Sixth Distributed Memory Computing Conf.Los Alamitos,Calif:IEEE Computer Society Press,1991.270~277
  • 33,nCUBE,nCUBE-2 systems:Technical overview.Foster City,CA:nCUBE Corporation,Tech Rep.1992
  • 44,Intel,Touchstone Delta System Description,Intel Advanced Information.Stanta Clara,CA:Intel Corporation,1991
  • 55,Thakur R,Choudhary A,Fox G C.Redistribution of arrays in HPF.In:Proc of the Scalable High Performance Computing Conf.Knoxville,TN,1994.309~318
  • 66,Ramaswamy S,Simons B,Banerjee P.Optimizations for efficient array redistribution on distributed memory multicomputers.Journal of Parallel and Distributed Computing,1996,38(2):217~228
  • 77,Agrawal G,Sussman A,Saltz J.Compiler and runtime support for structured and block structured application.In:Proc of Supercomputing93.Portland,OR,1993.578~587
  • 88,Wakatani A,Wolfe M.A new approach to array redistribution:Strip mining redistribution.In:Proc of Parallel Architectures and Languages.Europe,1994
  • 99,Dongarra J,Prylli L,Randriamaro C et al.Array redistribution in ScaLAPACK using PVM.In:Proc of EuroPVM'95.Lyon,France,1995
  • 1010,Foster I.Designing and Building Parallel Programs.Reading,Mass:Addison-Wesley Pub Company,1995

共引文献11

同被引文献9

引证文献2

二级引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部