摘要
分析比较当前大数据中心典型混合存储架构,针对其不能综合运用存储管理系统和存储设备优势的问题,提出软硬件协同的数据放置策略,同时考虑软件层混合存储管理系统和硬件层混合存储设备的特点,根据应用特性为数据选择合适的存储管理系统和设备。面向不同应用场景,提出运行前规划存储路径的静态放置模式和运行中规划存储路径的动态放置模式。基于存储管理系统和设备性能参数建模,采用仿真方法实现各数据放置策略,并运行实际应用中的三类负载进行实验测试,结果表明采用软硬件协同的数据放置策略相比只考虑存储管理系统和存储设备的数据放置策略,性能可以提高近30%。
The analysis of the existing typical hybrid store architectures in big data center found that they cannot fully take advantage of both hybrid storage management systems and hybrid storage devices.Thus a hardware and software co-design data placement strategy was proposed,which simultaneously considers the hybrid storage management systems at software level and the hybrid storage devices at hardware level,and figures out the trail of data placement on both storage systems and devices regarding application characteristics.Moreover,the static placement pattern before running and the dynamic placement pattern during running were proposed on the basis of different application scenes.An experiment was implemented by running three kinds of workloads on simulated data placement strategies based on the model according to the performance parameters of storage management systems and storage devices.The results show that the proposed design outperforms traditional ones that either consider storage management systems or storage devices separately by up to 30%.
作者
李鸿飞
杜溢墨
曾熠
王磊
LI Hongfei;DU Yimo;ZENG Yi;WANG Lei(Institute of Surveying and Mapping,Information Engineering University,Zhengzhou 450001,China;The PLA Unit 31008,Beijing 100091,China)
出处
《国防科技大学学报》
EI
CAS
CSCD
北大核心
2020年第2期64-71,共8页
Journal of National University of Defense Technology
关键词
大数据
混合存储
非关系型数据库
数据放置
big data
hybrid store
not only structured query language
data placement