异构混合存储的软硬件协同数据放置策略

Software and hardware co-design of data placement in heterogeneous hybrid store

分析比较当前大数据中心典型混合存储架构,针对其不能综合运用存储管理系统和存储设备优势的问题,提出软硬件协同的数据放置策略,同时考虑软件层混合存储管理系统和硬件层混合存储设备的特点,根据应用特性为数据选择合适的存储管理系统和设备。面向不同应用场景,提出运行前规划存储路径的静态放置模式和运行中规划存储路径的动态放置模式。基于存储管理系统和设备性能参数建模,采用仿真方法实现各数据放置策略,并运行实际应用中的三类负载进行实验测试,结果表明采用软硬件协同的数据放置策略相比只考虑存储管理系统和存储设备的数据放置策略,性能可以提高近30%。

The analysis of the existing typical hybrid store architectures in big data center found that they cannot fully take advantage of both hybrid storage management systems and hybrid storage devices.Thus a hardware and software co-design data placement strategy was proposed,which simultaneously considers the hybrid storage management systems at software level and the hybrid storage devices at hardware level,and figures out the trail of data placement on both storage systems and devices regarding application characteristics.Moreover,the static placement pattern before running and the dynamic placement pattern during running were proposed on the basis of different application scenes.An experiment was implemented by running three kinds of workloads on simulated data placement strategies based on the model according to the performance parameters of storage management systems and storage devices.The results show that the proposed design outperforms traditional ones that either consider storage management systems or storage devices separately by up to 30%.