基于新型存储的大数据存储管理

Big data storage management based on new storage

如何高效地存储大数据并支持实时大数据处理与分析是大数据技术发展面临的首要问题。近年来,以相变存储器、闪存等为代表的新型存储为实现高效的大数据存储和管理提供了新思路。以相变存储器为代表的存储级主存技术为切入点,针对大数据存储与管理中的高效存储、实时处理等存在的挑战,讨论了面向新型存储的大数据存储管理研究现状,并对未来基于新型存储的大数据研究进行了展望。

How to efficiently store big data and support real-time big data processing and analysis has been the most critical issue in the development of big data technologies. Recently, new storage media such as phase change memory and flash memory provides new opportunities for developing an efficient framework for big data storage and management. Based on the challenges of efficient storage and real-time processing in big data storage and management, storage class memories were focused, which were represented by phase change memory, and the state of the art of new-storage-based big data storage management was discussed. Finally, some future research directions for new-storage-based big data storage management were proposed.