期刊文献+

一种服务端驱动的无锁的文件元数据操作方法

A Server-Driven Lockless Method for File Metadata Operations
下载PDF
导出
摘要 当前的大规模存储系统提供大量的聚合I/O带宽,但并没有实现高度的元数据扩展性以管理分布于成千上万存储节点之上的文件。本文提出服务端驱动的无锁元数据操作来改进文件元数据操作的扩展性。服务端驱动技术简化了一致性维护,无锁技术既避免了资源冲突,又增进了元数据操作的并行性。实现了文件创建、删除操作。实验结果表明,该方法能显著提高系统的性能和扩展性。 Current large-scale storage systems provide large amounts of aggregate I/O bandwidth, however, they do not achieve the high degree of metadata scalability required to manage files distributed across thousands of storage nodes. In this paper we suppose the server-driven lock less metadata operations to improve the scalability of file metadata operations. The server-driven technology simplifies the consistency maintenance, and the lock-less technology avoids resources contention and improves the parallelism of metadata operations. We implement the file creation and file removal operations and the experimental results indicate that it significantly improves the performance and the scalability of systems.
出处 《计算机工程与科学》 CSCD 北大核心 2009年第A01期153-156,共4页 Computer Engineering & Science
基金 国家973计划资助项目(2009CB320503) 国家863计划资助项目(2008AA01A325)
关键词 元数据操作 服务端驱动 无锁 扩展性 metadata operation server-driven lock-less scalability
  • 相关文献

参考文献10

  • 1Roselli D, Lorch J, Anderson T. A Comparison of File System Workloads [C]//Proc of the 2000 USEN1X Annual Technical Conf, 2000: 41-54.
  • 2Carns P H, Lang S A, Ross R O, et al. Small-file Access in Parallel File Systems[C]//Proc of Parallel and Distributed Processing Syrup, 2009.
  • 3Well S A, Pollack K T, Brandt S A, ct al. Dynamic Metadata Management for Petabyte-Scale File Systems[C]//Proc of the 2004 ACM/IEEE Conf on Supercomputing, 2004 : 4.
  • 4Braam P J. Scalable Locking and Recovery for Network File Systems[C]//Proc of Petascale Data Storage Workshop, 2007.
  • 5Devulapalli A, Wyckoff P. File Creation Strategies in a Distributed Metadata File System[C]//Proc of Parallel and Distributed Processing Syrup, 2007:1-10.
  • 6Kuhn M, Kunkel J M, Ludwig T. Directory-Based Metadata Optimizations for Small Files in PVFS[C]//Proc of Euro-Par, 2008:90-99.
  • 7Carns P H, Settlemyer B W, Walter I,et al. Using Server-to- server Communication in Parallel File Systems to Simplify Consistency and Improve Performance[C]//Proc of the 2008 ACM/IEEE Conf on Supercomputing, 2008:1-8.
  • 8Weil S A,Brandt S A, Miller E L, et al. Ceph: a Sealable, High-Performance Distributed File System[C]// Proe of the 7th Syrnp on Operating Systems Design and Implementation,2006:307-320.
  • 9Welch B, Unangst M, Abbasi Z, et al. Scalable Performance of the Panasas Parallel File System[C]//Proc of the 6th USENIX Conf on File and Storage Technologies, 2008:1 -17.
  • 10Varga A. The OMNeT+ + Discrete Event Simulation System[C]//Proc of the European Simulation Multleonference, 2001.

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部