基于Sharding-JDBC的海量北斗数据存储方案

Storage Scheme For Huge Beidou Data Based on Sharding-JDBC

随着北斗产业的快速发展,北斗导航技术在各行各业得到了越来越广泛的应用。本文针对北斗位置服务平台业务数量和应用规模的不断扩大,带来的高并发和海量数据读写性能的问题,提出了基于Sharding-JDBC分表的海量北斗数据存储方案设计。分表后,系统不再对所有数据进行操作,而只需要针对其中某个或某几个分表进行操作,以减小了单表的访问压力和磁盘IO占用。最后使用Jmeter测试工具对数据接口进行测试,结果表明,采用有效的分表方案,能在一定程度上缓解并发压力,并显著提高海量数据的读写性能和可维护性。

With the rapid development of the Beidou navigation satellite System(BDS).BDS has been widely used in various fields.For the continuously expansion of the number of Beidou location service platform services and the scale of application,the high-concurrency and huge data read and write performance problems are proposed.The design of huge data from Beidou storage scheme based on Sharding-JDBC is proposed.After the table is divided,the system no longer operates on all the data,but only needs to operate on one or several of the sub-tables to reduce the access pressure and disk IO occupation of the single table.Finally,jmeter is used to test the API.The results show that the effective sub-table scheme can alleviate the concurrency pressure to a certain extent and significantly improve the read/write performance and maintainability of huge data.