期刊文献+

日志结构云存储中缓存的设计与实现 被引量:6

The design and implementation of cache in the log-structured cloud storage platform
下载PDF
导出
摘要 日志结构分布式文件系统(HDFS-based Log-structured File System,HLFS)是基于Hadoop分布式文件系统(Hadoop Distributed File System,HDFS)构建的云存储平台,为了提高其数据读写性能,结合HLFS客户端与后台存储集群相分离的特点,利用最近最久未使用算法作为缓存策略,在HLFS客户端内存中设计并实现HLFS缓存,并采用固定时间间隔刷新缓存的策略来保证数据一致性。在集群系统上对所设计的缓存进行了数据读写测试,结果表明,该设计能够有效地降低HLFS与后台集群的交互频率,减少用户感知的数据读写时间。 In order to enhance the overall I/O performance of the distributed cloud storage plat- form HLFS(HDFS-based Log-structured File System), cache module is proposed and implemen- ted in the HLFS client RAM by making use of LRU algorism due to the characteristic of HLFS of which client is separated with the back-end storage cluster. To ensure the data consistence, the data stored in the cache is designed to be written back at fixed time intervals. The cache module is tested in a cluster by reading and writing data to HLFS. The test results shows that, by enabling the cache module, HLFS can decrease the interaction frequency with the back-end cluster, there- by improving the I/O performance effectively.
出处 《西安邮电大学学报》 2013年第5期76-80,共5页 Journal of Xi’an University of Posts and Telecommunications
基金 陕西省教育厅自然科学基金资助项目(11JK1069)
关键词 分布式文件系统(DFS) 缓存技术 日志结构文件系统(LFS) distributed file system(DFS), cache technology, log-structured file system(LFS)
  • 相关文献

参考文献3

  • 1Mitake H,Stores B.Object Cache,and Disk Cache[].https://githubcom/collie/sheepdog/wiki/Backend-Stores%C-Object-Cache-and-Disk-Cache.2012
  • 2Dean H,Lee W,Peter H.Large files,small writes,and pNFS[].Proceedings of the International Conference on Supercomputing.2006
  • 3Mendel Rosenblum,John K. Ousterhout.The design and implementation of a log-structured file system[J].ACM Transactions on Computer Systems (TOCS).1992(1)

同被引文献37

  • 1董新华,李瑞轩,周湾湾,王聪,薛正元,廖东杰.Hadoop系统性能优化与功能增强综述[J].计算机研究与发展,2013,50(S2):1-15. 被引量:69
  • 2Daniel P.Bovet,Marco Cesati.深入理解LINUX内核[M].北京:中国电力出版社,2004.
  • 3赵德平,史桂颖.基于Linux网络块设备和软RAID技术的网络镜像[J].计算机工程,2007,33(18):87-89. 被引量:4
  • 4WolfgangMauerer.深入1Anux内核架构[M].郭旭,译.北京:人民邮电出版社,2010:520-581.
  • 5曹风兵.基于Hadoop的云计算模型研究与应用[D].重庆:重庆大学,2011.
  • 6Jonathan E Cook. A Highly Effective Partition Selec- tion Policy for Object Database Garbage Collection[J]. IEEE Transaction on Knowledge and Data Engineer- ing, 1998,10(1) : 153-172.
  • 7Li Shaobo,Jia Xiaohui. Research and Application of Transparent Encrypting File System Based on Windows Kernel[A].Wuhan:IEEE,2010.1-4.
  • 8Lee Jacheung,Heo Junyoung,Park Jaemin. Buffer cache level encryption for embedded secure operating system[A].EUC Taipei,Taiwan:IFIP International Federation for Information Processing,2007.346-355.
  • 9Xie Liling. Research and Application of theTransparent Docunment Encryption Gataway in Information Leakage Prevention[A].Wuhan:IEEE,2010.1-3.
  • 10谭文;杨潇;邵坚磊.寒江独钓:Windows内核安全编程[M]北京:电子工业出版社,2009163-280.

引证文献6

二级引证文献9

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部