期刊文献+

基于MapReduce的单源最短路径算法研究 被引量:5

Research on the Single Source Shortest Path Algorithm Using MapReduce
下载PDF
导出
摘要 通过对MapReduce模型执行过程的分析,针对单源最短路径算法难以随着云计算的产生和发展而应用及提高搜索效率的问题,本文设计和实现了一种基于MapReduce架构的并行单源最短路径算法。并基于Hadoop平台集群环境进行了研究与实验,结果表明,文中算法可以有效地找出整个图结构中的单源最短路径,且验证了算法性能的优越性。 Via the analysis to implementation process of mapreduce, aimming at the problem that single source shortest path algorithm is hard to be used with the appearance and development of cloud computing and the problem of searching efficiency,a parallel single source shortest path algorithm based on mapreduce framework is designed and implemented .research and experiment are done based on hadoop platform.As shown by the experimental results,the proposed algorithm can search the single source shortest path efficiently in the whole graphic structure,and its good performance is testified.
出处 《微计算机信息》 2011年第12期97-99,101,共4页 Control & Automation
关键词 MAPREDUCE 并行 最短路径 HADOOP MapReduce Parallel Shortest path Hadoop
  • 相关文献

参考文献9

  • 1Dean J, Ghemawat S.MapReduce:Simplified Data Processing on Large Clusters [C]//Proc. of the 6th Symposium on Operating Sys- tems Design and Implementation. San Francisco,U.SA:[s.n.],2004.
  • 2Cutting D.Scalable Computing with MapReduce[C]//Proc. of O' Reilly Open Source Convention. Poland:[s.n.], 2005.
  • 3Tan G Z, Ping X H. A Parallel Algorithm for Computing Shortest Paths In Large-Scale Networks [C]//Proe. of The 5th International Conference on Computational Science. Atlanta,GA,USA: [s.n.], 2005.
  • 4Tan G Z, Li D, Ping X H, et al.Network-Tree Routing Model for Large Scale Networks:Theories and Algorithms//Proc. of The 4th International Conference on Networking.Reunion Island,France: [s. n.],2005.
  • 5Dean J. Experiences with mapreduce,an abstraction for large- scale computation [C]//Proc. of PACT'06. Washington D.C.,USA: [s.n.],2006.
  • 6Yang H C, Dasdan A, Hsiao R L,et al.Map-reduce-merge:sim- plified relational data processing on large clusters [C] //Proc. of 2007 ACM SIGMOD Conference,2007.
  • 7Cohen J. Graph Twiddling in a MapReduce World[J]. Computing in Science & Engineering,2009,11(4):29--41.
  • 8Borthakur D. The Hadoop Distributed File System:Architecture and Design[EB/OL]. http://hadoop.apache.org/common/docs/r0.18.0/ hdfs_design.pdf, 2007.
  • 9杨代庆,张智雄.基于Hadoop的海量共现矩阵生成方法[J].现代图书情报技术,2009(4):23-26. 被引量:13

二级参考文献8

  • 1HDFS Architecture [ EB/OL ]. [ 2008 - 12 - 10 ]. http ://hadoop. apache. org/core/docs/current/hdfs_design. html.
  • 2Hadoop Cluster Setup [ EB/OL]. [ 2008 - 12 - 15 ]. http://hadoop. apache. org/core/docs/current/clustcr_setup. html.
  • 3HadoopMapReduce [ EB/OL]. [ 2008 - 12 - 16 ]. http://wiki. apache. org/hadoop/HadoopMapReduce.
  • 4Distributed Computing with Linux and Hadoop. [ EB/OL]. [2009 - 01 -101. http ://www. ibm. com/developerworks/linux/library/l - hadoop/index. html.
  • 5Hbase [ EB/OL ]. [ 2009 - 01 - 10 ]. http ://hadoop. apache. org/ hbase/.
  • 6Hive[ EB/OL]. [2009 -01 - 15 ]. http://hadoop. apache. org/hive/.
  • 7Pig [ EB/OL ]. [ 2009 - 01 - 15 ]. http ://hadoop. apache. org/pig/.
  • 8CloudBase [ EB/OL ]. [ 2009 - 01 - 16 ]. http ://sourceforge. net/ projects/cloudbase/.

共引文献12

同被引文献30

  • 1章昭辉,闫春钢,丁志军,蒋昌俊.交通信息网格中的最短出行路径并行算法[J].同济大学学报(自然科学版),2006,34(12):1606-1611. 被引量:3
  • 2Plimpton Steven J, Devine Karen D. MapReduce in MPI [or large-scale graph algorithms [J]. Parallel Computing, 2011,37.-610-632.
  • 3McCubbin Christopher, Perozzi Bryan, Levine An- drew, et al. Finding the "Needle': locating interesting nodes using the K-shortest paths algorithm in Ma- pReducep[C // The llth IEEE International Confer- ence on Data Mining Workshops, Vancouver, 2011.
  • 4Kambatla Karthik, Rapolu Naresh, Jagannathan Suresh,et al. Asynchronous algorithms in MapRe- duce[C] // 2010 IEEE International. Conference on Cluster Computing, Heraklion, Crete, Greece, 2010.
  • 5许明军.若干随机性全局优化算法的研究[D].大连:大连理工大学数学科学学院,2004.
  • 6Liu J F, Liu P. Status and key techniques in cloud computing [C ]//Proc of 3rd international conference on advanced computer theory and engineering. [ s. 1. ] : [ s. n. ], 2010:285 -288.
  • 7IBM blue cloud [ EB/OL ]. 2008 - 02 - 02. https ://www. ibm. com/developerworks/cloud/.
  • 8Googleappengine[EB/OL].2012-04-25.http://ap-pengine.google.com.
  • 9Foster I, Zhao Yong. Cloud computing and grid computing 360-degree compared [ C]//Proc of 2008 grid computing environments workshop. Austin, Texas: IEEE,2008.
  • 10Zhan F B.Three Fastest Shortest Path Algorithms on Real Road Networks[J] .Journal of Geographic Inform ation and Decision Analysis,1997,1(1):69-82.

引证文献5

二级引证文献32

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部