期刊文献+
任意字段
题名或关键词
题名
关键词
文摘
作者
第一作者
机构
刊名
分类号
参考文献
作者简介
基金资助
栏目信息

海量存储系统中高可扩展性元数据服务器集群设计 被引量：3

A Design of High Scalable Metadata Cluster in Mass Storage System
下载PDF
导出
摘要 海量存储系统都采用元数据服务器机群的方式来处理文件系统的元数据信息。很多存储系统采用Hash算法来实现文件元数据在元数据机群内的分布,但是这些算法都是针对文件进行Hash。本文提出了一种目录哈希的新算法,针对目录进行Hash,并把一个目录内的元数据集中存储。本算法克服了文件Hash的不足,改善了存储系统的性能,并极大地提高了存储系统的可扩展性。 Most large scale mass storage systems exploit metadata server clusters to handle the metadata of file system. Many storage systems use Hash algorithms to distribute the metadata among metadata server cluster. But the Hash key value of these algorithms is files. This paper proposes a new directory Hash algorithm. It treats directory as Hash key value, and implements a concentrated storage of metadata. This algorithm overcomes the disadvantages of file Hash algorithm. It can improve the performance of the storage system, and enhances the system＇s scalability evidently.
作者 吴伟 谢长生 韩德志 黄建忠
机构地区 华中科技大学计算机学院外存储国家重点实验室 暨南大学计算机系
出处 《计算机科学》 CSCD 北大核心 2007年第7期106-109,共4页 Computer Science
基金 国家"973"重大基础研究项目(编号:2004CB318203) 国家自然科学基金项目(编号:60303031)资助
关键词 海量存储系统 元数据服务器机群 高可扩展性 目录哈希 Mass storage system, Metadata server cluster, High scalability, Directory hash
分类号 TP393.18 [自动化与计算机技术—计算机应用技术]
  • 相关文献

参考文献9

  • 1Pawlowski B, Juszczak C, Staubach P, et al. NFS version 3: Design and implementation. In: Proceedings of the Summer 1994 USENIX Technical Conference, 1994. 137-151
  • 2Satyanarayanan M, Kistler J J, Kumar P, et al. Coda: A highly available file system for a distributed workstation environment. IEEE Transactions on Computers, 1990, 39(4):447-459
  • 3Ousterhout J K, Cherenson A R, Douglis F, et at. The Sprite network operating system. IEEE Computer, 1998, 21(2):23-36
  • 4Corbett P F, Feitelson D G. The Vesta parallel file system. ACM Transactions on Computer Systems, 1996, 14(3):225-264
  • 5Rodeh O, Teperman A. zFS - a scalable distributed file system using object disks. In: Proceedings of the 20th IEEE / 11th NASA Goddard Conference on Mass Storage Systems and Technologies, April 2003. 207-218
  • 6Schwan P. Lustre; Building a file system for 1000-node clusters. In: Proceedings of the 2003 Linux Symposium, July 2003
  • 7Brandt S A, Xue Lan, Miller E L, et al. Efficient metadata management in large distributed file systems. In:Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, April 2003
  • 8Weil S A, Pollack K T, Brandt S A, et al. Dynamic Metadata Management for Petabyte-scale File Systems. In; Proceedings of the 2004 ACM/IEEE Conference on Supercomputing, Nov. 2004
  • 9Yan Jie, Zhu Yao-Long. A design of metadata server cluster in large distributed object-based storage. In: Proceedings of the 21th IEEE/12th NASA Goddard Conference on Mass Storage Systems and Technologies, 2004

同被引文献16

  • 1刘仲,周兴铭.基于目录路径的元数据管理方法[J].软件学报,2007,18(2):236-245. 被引量：21
  • 2[4]Yan Jie,Zhu Yao-Long.A design of metadata server cluster in large distributed object-based storage[C].Proceedings of the 21th IEEE/12th NASA Goddard Conference on Mass Storage Systems and Technologies,2004.
  • 3Weil S A. Ceph: Reliable, Scalable, and High-performance Distri- buted Storage[D]. Santa Cruz, USA: University of California, 2007.
  • 4Roselli D, Lorch J, Anderson T. A Comparison of File System Workloads[C] //Proc. of USENIX Annual Technical Conference. San Diego, USA: [s. n.] , 2000: 41-54.
  • 5Pawlowski B, Shepler S, Beame C, et al. NFS Version 4 Protocol Specification[C] //Proc. of SANE’02. Maastricht, Holland: [s. n.] , 2000: 182-203.
  • 6Braam P J. Lustre: A Scalable, High-performance File Sys- tem[EB/OL]. (2002-05-06). ftp://ftp.uni-duisburg.de/linux/filesys/ Lustre/whitepaper.pdf.
  • 7Rodeh O, Teperman A. zFS——A Scalable Distributed File System Using Object Disks[C] //Proc. of the 11th NASA Goddard Conference on Mass Storage Systems and Technologies. San Diego, USA: [s. n.] , 2003: 207-218.
  • 8Brandt S A, Xue Lan, Miller E L, et al. Efficient Metadata Management in Large Distributed File Systems[C] //Proc. of the 11th NASA Goddard Conf. on Mass Storage Systems and Technologies. San Diego, USA: IEEE Computer Society, 2003: 290-298.
  • 9Weil S A, Pollack K T, Brandt S A, et al. Dynamic Metadata Management for Petabyte-scale File Systems[C] //Proc. of ACM/ IEEE Conference on Supercomputing. Washington D. C., USA: IEEE Computer Society, 2004: 4-15.
  • 10Leonand I. Encyclopedia of PVC [ M]. New York: Marcel Dekler Inc, 1976,1:1.

引证文献3

二级引证文献11

计算机科学
2007年 第7期

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部