基于非关系型数据库的大数据分布式存储技术

Big Data Distributed Storage Technology Based on Non-relational Database

该文提出一种基于非关系型数据库(MongoDB)的大数据分布式存储技术,可以满足快速索引、精确查找的需求。该文首先介绍非关系型数据库的数据存储结构,包括BSON文档系统、GridFS大文件存储系统,随后概述分布式存储系统的2种常见存储模式和自动分片技术,并使用自动分片技术对分布式数据库的查询算法进行优化。实验表明,使用自动分片技术能够显著提高数据索引效率,达到设计预期。

This paper proposes a big data distributed storage technology based on non-relational database(MongoDB),which can meet the needs of fast index and accurate search.This paper first introduces the data storage structure of non-relational database,including BSON document system,GridFS large file storage system.Then,two common storage modes and automatic sharding technology of distributed storage system are summarized,and the query algorithm of distributed database is optimized by using automatic sharding technology.The experiment shows that the automatic sharding technology can significantly improve the efficiency of data indexing,and achieve the design expectation.