期刊文献+

HPPHM:多维数据并行I/O存储新策略及其性能研究 被引量:1

HPPHM:new policy of store for multidimensional dataset of parallel I/O and research of retrieve performance
下载PDF
导出
摘要 针对大型多维数据集合中数据存储访问效率较低的缺陷而进行了相应的研究,通过采用并行I/O技术,将多维数据在分布式系统的多个磁盘之间进行分布存储,通过循环拆分法将已有的数据从适用于二维数据扩展到了多维数据中,并通过对循环法进行理论分析,对多维数据存储访问进行研究,提出了一种新的启发式多维数据循环策略,即基于访问步长值Hi与访问长度M互质的启发式策略(HPPHM),实验表明了新算法在并行度和顽健性等性能方面都具有优越性。 The policy of store and retrieve for large-scale multidimensional dataset was researched. The multidimensional dataset was allocated in the multi-disks among the distributed processing system by using the parallel I/O technology. A new multidimensional data cyclic declustering policy was proposed aiming to data retrieve based on scope by extending existing cyclic policy to multidimensional dataset from adapting to two-dimension, and by using theory analysis on the present method, a new heuristic multidimensional data retrieve policy named HPPHM was proposed. The experimental result has demonstrated the efficiency of new strategy not only in parallel degree but also in robust.
出处 《通信学报》 EI CSCD 北大核心 2007年第4期57-64,共8页 Journal on Communications
基金 国家自然科学基金资助项目(60573127)~~
关键词 多维数据 并行I/O 存储访问 multidimensional dataset parallel I/O store and retrieve
  • 相关文献

参考文献18

  • 1ISAILA F,TICHY W F.Clusterfile:a flexible physical layout parallel file system[A].Concurrency Computat:Pract Exper[C].2003.653-679.
  • 2SUN J H,JIN H,CHEN H,et al.Server scheduling scheme for asynchronous cluster video server[A].Proceedings of the 17th International Conference on Advanced Information Networking and Applications[C].Xi'an,China,2003.509-512.
  • 3SHEN X H,LIAO W K,ALOK C,et al.A high-performance application data environment for large-scale scientific computations[J].IEEE Transactions on Parallel and Distributed Systems,2003,14(12):1262-1274.
  • 4BAJAJ R,AGRAWAL D P.Improving scheduling of tasks in a heterogeneous environment[J].IEEE Transactions on Parallel and Distributed Systems,2004,15(2):107-118.
  • 5YANG C T,CHENG K W,LI K C.An enhanced parallel loop self-scheduling scheme for cluster environments[A].Proceedings of the 19th International Conference on Advanced Information Networking and Applications (AINA'05)[C].2005.207-210.
  • 6ABDEL-GHAFFAR K A S,ABBADI A E.Optimal disk allocation for partial match queries[J].Proc ACM Symp on Transactions of Database Systems,1993,18(1):132-156.
  • 7ABDEL-GHAFFAR K A S,ABBADI A E.Optimal allocation of two-dimensional data[A].Int Conf on Database Theory[C].Delphi,Greece,1997.409-418.
  • 8CHOR B,LEISERSON C E,RIVEST R L,et al.An application of number theory to the organization of raster-graphics memory[J].Journal of the Association for Computing Machinery,1986,33(1):86-104.
  • 9DU H C,SOBOLEWSKI J S.Disk allocation for Cartesian product files on multiple-disk systems[J].ACM Transactions of Database Systems,1982,7(1):82-101.
  • 10FALOUTSOS C,BHAGWAT P.Declustering using fractals[A].Proc of the 2nd Int Conf on Parallel and Distributed Information Systems[C].San Diego,CA,1993.18-25.

同被引文献14

  • 1沈卫超,曹立强,夏芳,宋磊.面向数值模拟数据的HDF5性能优化[J].计算机研究与发展,2012,49(S1):314-318. 被引量:10
  • 2Dongarra J,Foster I,等编著,莫则尧,陈军,等译.并行计算综论[M].北京:电子工业出版社,2005.3-28.
  • 3PAKALAPATI P D . Benchmarking parallel I / O performance for computational fluid dynamics applications[ C]// Proceedings of the 43rd AIAA Aerospace Sciences Meeting and Exhibit. Washington,DC: AIAA, 2005.
  • 4HORNE K, BENSON N. An efficient and flexible parallel I/O im- plementation for the CFD general notation system[ R]. Salt Lake Cit- y: Utah State University, Center for High Performance Computing, 2009.
  • 5RITrER M . Introduction to HDF 5 and F 5 [ D ] . Innsbruck : Leopold-Franzens University of Innsbruck, Institute of Computer Science, 2007.
  • 6YANG M Q, KOZIOL Q. Parallel HDF5 hints[ R] paign: The HDF Group, 2010.
  • 7YANG K. Parallel HDF5 introductory tutorial[ R] paign: The HDF Group, 2008.
  • 8Urbana-Cham- Urbana-Cham- YANG M Q, KOZIOL Q. Using collective IO inside a high per- formance IO software package - HDF5 [ R]. Urbana-Champaign: University of Illinois at Urbana Champaign, National Center for Su- percomputing Applications, 2010.
  • 9CHE Y G, XU C F, WU J P, et al. Optimization and evaluation of a low roach number flow simulator on tianhe-1A supercomputer [ C]//Proceedings of the 23th International Conference on Parallel Computational Fluid Dynamics. Barcelona: IEC, 2011.
  • 10张娟,陆林生.应用层并行I/O效率研究[J].计算机应用,2009,29(1):9-11. 被引量:2

引证文献1

二级引证文献4

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部