期刊文献+
任意字段
题名或关键词
题名
关键词
文摘
作者
第一作者
机构
刊名
分类号
参考文献
作者简介
基金资助
栏目信息

Capability-Aware Data Placement for Heterogeneous Active Storage Systems

Capability-Aware Data Placement for Heterogeneous Active Storage Systems
原文传递
导出
摘要 By moving computations from computing nodes to storage nodes, active storage technology provides an efficient for data-intensive high-performance computing applications. The existing studies have neglected the heterogeneity of storage nodes on the performance of active storage systems. We introduce CADP, a capability-aware data placement scheme for heterogeneous active storage systems to obtain high-performance data processing. The basic idea of CADP is to place data on storage nodes based on their computing capability and storage capability, so that the load-imbalance among heterogeneous servers can be avoided. We have implemented CADP under a parallel I/O system. The experimental results show that the proposed capability-aware data placement scheme can improve the active storage system performance significantly. By moving computations from computing nodes to storage nodes, active storage technology provides an efficient for data-intensive high-performance computing applications. The existing studies have neglected the heterogeneity of storage nodes on the performance of active storage systems. We introduce CADP, a capability-aware data placement scheme for heterogeneous active storage systems to obtain high-performance data processing. The basic idea of CADP is to place data on storage nodes based on their computing capability and storage capability, so that the load-imbalance among heterogeneous servers can be avoided. We have implemented CADP under a parallel I/O system. The experimental results show that the proposed capability-aware data placement scheme can improve the active storage system performance significantly.
作者 LI Xiangyu HE Shuibing XU Xianbin WANG Yang
机构地区 School of Computer State Key Laboratory of High Performance Computing School of Computer Science Shenzhen Institute of Advanced Technology
出处 《Wuhan University Journal of Natural Sciences》 CAS CSCD 2016年第3期249-256,共8页 武汉大学学报（自然科学英文版）
基金 Supported by the National Science and Technology Foundation of China(61572377) the Natural Science Foundation of Hubei Province(2014CFB239) the Open Fund from HPCL(201512-02) the Open Fund from SKLSE(2015-A-06) the US National Science Foundation(CNS-1162540)
关键词 active storage parallel I/O system CADP data placement active storage parallel I/O system CADP data placement
分类号 TP393 [自动化与计算机技术—计算机应用技术]
  • 相关文献

参考文献34

  • 1Chen C, Chen Y. Dynamic active storage for high perform- ance I/O [C] //Proceedings of the 41st International Con- ference on Parallel Processing. Washington D C: IEEE Press, 2012: 379-388.
  • 2Kandemir M, Son S W, Karakoy M. Improving I/O per- formance of applications through compiler-directed code re- structuring [C] //Proceedings of the 6th USENIX Confer- ence on File and Storage Technologies, FAST' 08. San Jose: USENIX Association, 2008: 159-174.
  • 3Son S W, Lang S, Cams P, et al. Enabling active storage on parallel I/O software stacks [C]// Proceedings of the IEEE 26th Symposium on Mass Storage Systems and Technolo- gies, MSST. Washington D C: IEEE Press, 2010: 1-12.
  • 4Ma X N, Reddy A L N. MVSS: An active storage architec- ture [J]. IEEE Transactions on Parallel and Distributed Sys- tems, 2003, 14(10): 993 - 1005.
  • 5Acharya A, Uysal M, Saltz J. Active disks: Programming model, algorithms and evaluation [J]. ACM SIGPLAN No-tices, 1998, 33(11): 81-91.
  • 6Riedel E, Gibson G A, Faloutsos C. Active storage for large-scale data mining and multimedia [C] // Proceedings of the 24rd International Conference on Very Large Data Bases, VLDB. New York: Morgan Kaufmann Press, 1998: 62-73.
  • 7Tang H, Gulbeden A, Zhou J, et al. The panasas active scale storage cluster-delivering scalable high bandwidth storage [C]//Proceedings of the ACM/IEEE SC2004 Conference on Supercomputing. Washington D C: IEEE Press, 2004:53-62.
  • 8He S B, Xu X B, Yang Y H. Oasa: An active storage archi- tecture for object-based storage system [J]. International Journal of Computational Intelligence Systems, 2012, 5(6): 1173-1183.
  • 9Xie Y, Muniswamy-Reddy K, Feng D, et al. Design and evaluation of Oasis: An active storage framework based on T 10 OSD standard [C]//Proceedings of the 1EEE 27th Mass Storage Systems and Technologies, MSST. Washington D C: IEEE Press, 2011: 1-12.
  • 10Tiwari D, Boboila S, Vazhkudai S S, et al. Active flash: Towards energy-efficient, in-situ data analytics on ex- treme-scale machines [C]//Proceedings of the 11th USENIX Conference on File and Storage Technologies, FAST' 13. San Jose: USENIX Association, 2013:119-132.
Wuhan University Journal of Natural Sciences
2016年 第3期

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部