期刊文献+

海量信息分级存储数据迁移策略研究 被引量:28

Research on the Data Migration Strategy of Hierarchical Mass Storage System
下载PDF
导出
摘要 以数据为中心的计算模式对存储系统的性能和可靠性提出了新的更高的要求。目前,PB量级的存储系统需要数千甚至上万块磁盘,高并行性、高可靠性和高性价比是海量磁盘存储系统的三项关键要求。本文提出由性能和可靠性不同的两级磁盘阵列组成二级海量存储系统,通过数据自动迁移,可在保证存储系统高性价比的条件下,获得更高的并行访问速率和可靠性。本文基于分级存储管理的思想,提出了FC—SAS和SATAII两级存储模型,设计了FV数据价值评定模型和迁移过程控制策略,实现对数据价值的精确判定,在尽量减小对系统访问性能影响的基础上,实现数据在两级设备间的高效迁移和用户的透明访问。 Data has to be more and more reliable and system has to be much faster because of the data center computing model, current storage system stores petabytes of data on thousands of disks, high parallelism,high reliability and high Performance-to-price ratio are the kernel demands of mass storage system. In this paper, two tiered mass storage system based on different disks is proposed supply much higher I/O performance and reliability by automatic data migration. Based on HSM , we put forward two tiered storage system model named FC--SAS and SATAII , design a file-level valuation model to classify files in disks exactly, and a data migration process control strategy to supply efficient data migration between two tiered disks which can implement transparent accessing based on affecting the system I/O performance as less as possible.
出处 《计算机工程与科学》 CSCD 北大核心 2009年第A01期163-167,共5页 Computer Engineering & Science
基金 十一五国防预研资助项目(51316040301)
关键词 数据迁移 分级存储管理 数据价值 管理模型 data migration hierarchical storage management data value management model
  • 相关文献

参考文献11

  • 1Schroeder B, Gibson G A, Disk Failures in the Real World: What does an MTTF of 1 000 000 Hours Mean to You? [C]//Proc of the 5tb USENIX Conf on File and Storage Technologies, 2007 : 14-16.
  • 2http://www, seagate. com/.
  • 3http://www. costcenter. com.
  • 4万继光,詹玲.一种集群NAS网络备份系统的研究与实现[J].小型微型计算机系统,2005,26(6):905-908. 被引量:6
  • 5Dasgupta K, Ghosal S,Jain R. QoSMig: Adaptive Rate-Controlled Migration of Bulk Data in Storage Systems[C]//Proc of ICDE'05,2005 : 816-827.
  • 6Zhao Xiaonan, Li Zhanhuai, Zeng Leijie.A Hierarchical Storage Strategy Based on Block-Level Data Valuation[C]//Proc of the 4th Int'l Cord on Networked Computing and Advanced Information Management, 2008.
  • 7王迪,舒继武,薛巍,沈美明.基于块级别的SAN系统自适应分级存储[J].高技术通讯,2007,17(2):111-115. 被引量:8
  • 8ILM Definition and Scope an ILM Framework[EB/OL]. [2004-10-18]. http: // www. snia. org/forums/dmf/programs/ilmi/DMF-ILMVision2.4, pdf.
  • 9Vengerov D. A Reinforcement Learning Framework for Online Datamigration in Hierarchical Storage Systems[J].J Supercomput,2008, 43:1-19.
  • 10Sun Microsystems Inc. Sun StorEdge QFS and SAM-FS Software[R]. Technical White Paper, 2004.

二级参考文献17

  • 1Postel J, Reynolds J. File transfer protocol (FTP)[S]. RFC 959, ISI, Oct 1985, 68-74.
  • 2BakBone Software and Falconstor Software. White Paper.SAN/NAS backup & restore: Facing the challenge using IPStor and NetVault[Z]. 2002.
  • 3EMC: Backup technologies for CLARiiON block-oriented storage[Z]. EMC Corporation C841, May 2001, 38-43.
  • 4RajkumarBuyya编.高性能集群计算:结构与系统(第一卷)[M].北京:电子工业出版社,2001,6..
  • 5Garth A Gibson. Network attached storage architecture [J].Communications ofthe ACM, 2000,43(11): 37-45.
  • 6NDMP: White Paper. NAS device backup solutions datalink corporation[Z]. April 5,2002.
  • 7Kaczmarski M, Jiang T, Pease DA. Beyond backup toward storage management[J]. IBM Systems Journal, 2003,42 (2) :332-337.
  • 8J da Silva, Gudmundsson O, Mosse D. Performance of a par-allel network backup manager[C]. In:USENIX Conference Proceedings, 1992, 17-26.
  • 9The essential elements of a storage networking architecture.http://www.brocade.com:Brocade Communications Systems,2001
  • 10North B,Gray R.Storage virtualization:the VERITAS approach.http://www.veritas.com:VERITAS Software Corporation,2001

共引文献12

同被引文献131

引证文献28

二级引证文献113

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部