期刊文献+

基于MapReduce的时空数据模型设计方法 被引量:4

Design Method of GIS Spatio-Temporal Data Model Based on MapReduce
下载PDF
导出
摘要 针对时空数据存储与查询问题,传统方法存在硬件成本高,存储效率低等缺点。通过对MapReduce模型和Hadoop框架等云计算核心技术的分析和研究,提出了一种基于Hadoop的时空数据存储模型,并在此模型的基础上,设计了基于MapReduce的时空数据查询并行化框架。该框架通过对时空数据的并行操作,使其适用于海量时空数据的存储与管理。 Using traditional methods to solve the storage and query of the spaio-temporal data exists several disadvantages such as the high cost of hardware and low storage efficiency.After analyzing and researching the MapReduce model,Hadoop framework and other cloud computing core technology,this paper presents a spaio-temporal data storage model based on Hadoop and designs the spaio temporal data query parallelization framework based on MapReduce.The framework based on the parallel operation of spatio-temporal data is applicable for massive spatio-temporal data storage and management.
出处 《测绘与空间地理信息》 2013年第7期41-44,共4页 Geomatics & Spatial Information Technology
基金 广西空间信息重点实验室基金(桂科能1103108-03) 广西科学研究与技术开发计划项目(桂科能2011D39242 1140016-13)资助
关键词 时空数据 HADOOP MAPREDUCE Spatial-Temporal Data Hadoop MapReduce
  • 相关文献

参考文献9

二级参考文献101

  • 1张治木,蔡寅峰.基于TIN和格网的DEM表面建模的比较[J].铜业工程,2005(2):8-10. 被引量:9
  • 2乐小虬,杨崇俊,于文洋.基于空间语义角色的自然语言空间概念提取[J].武汉大学学报(信息科学版),2005,30(12):1100-1103. 被引量:27
  • 3宋玮,王家耀,郭金华.面向对象时空数据模型的研究[J].测绘科学技术学报,2006,23(4):235-238. 被引量:28
  • 4WHITE T.Hadoop,the definitive guide[M].O'Reilly Media,Inc,2009.
  • 5DEAN J,GHEMAWAT S.MapReduee:simplified data processing on large clusters.[C]//Proc of the 6th Symposium on Operating Systems Design and Implementation.San Francisco:Google Inc,2004.
  • 6Hadoop官方文档:http://hadoop.apache.org/common/docs/r0.18.2/cn/mapred_tutorial.html,2008.
  • 7Kriegel H P,Brinkhoff T,Schneider R.Efficient spatial query processing in geographic database systems.Data Engineering Bulletin,1993,16:10-15.
  • 8DeWitt D,Gray J.Parallel database systems:the future of high performance database systems.Communications of the ACM,1992,35:85-98.
  • 9Dittrich J,Seeger B.Data redundancy and duplicate detection in spatial join processing.In:Proceedings of the 16th International Conference on Data Engineering,San Diego,CA,USA,2000.535-546.
  • 10Zhang S,Han J,Liu Z,et al.Parallelizing spatial join with MapReduce.In:Proceedings of the 2009 IEEE International Conference on Cluster Computing,New Orleans,Louisiana,USA,2009.

共引文献137

同被引文献29

  • 1崔杰,李陶深,兰红星.基于Hadoop的海量数据存储平台设计与开发[J].计算机研究与发展,2012,49(S1):12-18. 被引量:141
  • 2陈绍宽,郭谨一,王璇,毛保华.信号交叉口延误计算方法的比较[J].北京交通大学学报,2005,29(3):77-80. 被引量:38
  • 3刘瑞春,邢玉岩,王铁军.基础地理信息建库与出图的一体化方法[J].测绘与空间地理信息,2005,28(4):82-84. 被引量:11
  • 4黄崇超,于刚.交叉口延误函数与实时信号配时优化模型[J].武汉大学学报(工学版),2006,39(5):71-76. 被引量:8
  • 5XUE Y, GARRET S. Oracle in-database Hadoop: When MapRe- duce meets RDBMS[ C]// Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data. New York: ACM, 2012:779 -789.
  • 6ABHISHEK V, UDMILA C, CAMPBELL R H. Two sides of a coin: optimizing the schedule of MapReduce jobs to minimize their makespan and improve cluster performance[ C]//Proceedings of the 20th IEEE International Symposium on Modeling, Analysis and Sim- ulation of Computer and Telecommunication Systems. Washington, DC: IEEE Computer Society, 2012:12 - 18.
  • 7WANG X, SARMA A, OLSTON C. CoScan: cooperative scan sha- ring in the cloud[ C/OL]. [ 2014 -06 -20]. http://paperhub, s3. amazonaws, com/d7c86e6da622b0ffc7fadfSe16241 d3c. pdf.
  • 8KOEHLER M, KANIOVSKYI Y, BENKNER S. An adaptive frame- work for the execution of data-intensive MapReduce applications in the cloud[ C]// Proceedings of the 1st International Workshop on Data Intensive Computing in the Clouds. Piscataway: IEEE, 2011:1122-1131.
  • 9JEFFREY D, SANJAY G. MapReduce: simplified data processing on large clusters[ J]. Communications of the ACM, 2008, 51 (1) : 107 - 113.
  • 10LIAO C, SHIH J, CHANG R. Simplifying MapReduce data pro- cessing[ J]. Journal of Computational Science and Engineering, 2013,8(3): 219 -226.

引证文献4

二级引证文献33

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部