内存映射技术在大数据存储应用中的研究

Application of Memory Mapping Technology in Big Data Storage

针对无线网络技术研究中对大数据实时存储和国产化需求,在Qt平台下利用内存映射技术,设计实现了一种针对大数据的实时存储方案,可实现对无线网络中频采样数据和解调解码数据的实时存储。并通过设计有效的索引机制,极大的提高了后续离线数据分析时的数据搜索效率。最后通过测试代码对该内存映射文件存储技术进行了实验验证。

Aiming at the demand for real-time storage and localization of big data in the research of wireless network technology,and by using memory mapping technology,a memory real-time storage solution for big data is designed and implemented under the Qt platform,which can realize real-time storage of IF sampling data and demodulation and decoding data in wireless network.By designing an effective indexing mechanism,the efficiency of data search during subsequent offline data analysis is greatly improved.Finally,the memory mapping file storage technology is verified by test code.