摘要
针对传统电子政务平台所采用的关系型数据库在处理海量数据时存在性能瓶颈问题,利用Hadoop分布式平台在处理海量数据方面的优势,结合HDFS分布式文件系统、Map/Reduce并行计算模型和Hive仓库技术,设计关系型数据库与Hadoop相结合的电子政务云平台,两者协同提供海量数据查询操作和存储服务,从而降低了关系型数据库服务器的负载压力,增强电子政务平台的扩展性。通过实验证明,Hadoop能大大提高电子政务云平台的查询效率。进一步分析该设计方案中影响查询效率的因素,为深入研究基于Hadoop构建高效的电子政务云提供参考。
In view of the performance bottleneck in the treatment of massive data of the relational database which is adapted by the traditional electronic government platform,using the advantage of Hadoop distributed platform in mass data processing and combining HDFS distributed file system,Map / Reduce parallel computational mdoel and Hive data warehouse technology,this paper designs an electronic government cloud platform that combines relational database with Hadoop.Both of them collaboratively provide mass data query operation and storage service,so as reduce load pressure of the relational database server and enhance the extensibility of electronic government platform.Through the experiment,it proves that the scheme can greatly enhance the query efficiency of electronic government platform.This paper further analyzes the influence factors of query efficiency of this scheme to provide the reference for further study of building efficient electronic government cloud based on Hadoop.
出处
《计算机与现代化》
2013年第7期164-168,共5页
Computer and Modernization
基金
中国科学院"西部之光"人才培养计划项目(XBBS201018)
