期刊文献+

MapReduce模型下的并行线性时间选择算法研究 被引量:2

Research on parallel liner time selection algorithm on MapReduce model
下载PDF
导出
摘要 针对线性时间选择算法随着元素数量的增加,执行效率较低的缺点,提出了MapReduce模型下的并行线性时间选择算法。重新设计了线性时间选择问题的算法,使其符合以key/value数据形式作为输入的MapReduce编程模型。并行计算局部最优解,汇总局部最优解再计算出全局最优解。实验结果表明,在面对大数据情况下,经过改进后的MapReduce模型下的并行线性时间选择算法具有执行效率高,且执行效率随着并行程度的增加而提高的特点。 The execution efficiency of liner time selection algorithm is relatively low with the increased amount of element. A parallel liner time selection algorithm on mapreduce is proposed. The liner time selection algorithm is redesigned to meet the ma- preduce programming model which puts key/value form asits data input. The locally optimal solution is computed in parallel. The locally optimal solution is sunmaaried and the globally optimal solution is gotten. Experiments show that the parallel liner time selection algorithm on mapreduce is with high performance in the face of big data. And the execution efficiency of the algo- rithm is high with more compute units.
出处 《计算机工程与设计》 CSCD 北大核心 2014年第4期1242-1246,共5页 Computer Engineering and Design
基金 国家自然科学基金项目(60903082) 辽宁省教育厅基金项目(L2012113)
关键词 并行计算 MAPREDUCE模型 线性时间选择算法 局部最优解 全局最优解 parallel computing MapReduce model liner time selection algorithm the locally optimal solution the globallyoptimal solution
  • 相关文献

参考文献8

二级参考文献219

  • 1Yong HE,Hao ZHOU,Yi Wei JIANG.Preemptive Semi-online Algorithms for Parallel Machine Scheduling with Known Total Size[J].Acta Mathematica Sinica,English Series,2006,22(2):587-594. 被引量:2
  • 2宁焕生,张瑜,刘芳丽,刘文明,渠慎丰.中国物联网信息服务系统研究[J].电子学报,2006,34(B12):2514-2517. 被引量:151
  • 3周红福,宫学庆,郑凯,周傲英.基于高维空间的在线高效子空间Skyline算法——CSky[J].计算机学报,2007,30(8):1409-1417. 被引量:8
  • 4Dean J,Ghemawat S.MapReduce:Simplified Data Processing on Large Cluster[C] //Proc.of OSDI'04.Boston,MA,USA:[s.n.] ,2004.
  • 5Hadoop Distributed Filesystem[EB/OL].(2008-12-13).http://hadoop.apache.org/hdfs/.
  • 6IBM Research.Cloud Analytics:Do We Really Need to Reinvent the Storage Stack?[Z].2009.
  • 7Apache Hadoop[EB/OL].(2009-09-12).http://hadoop.apache.org/.
  • 8Chomicki J, Godfrey P, Gryz J, et al. Skyline with pre- sorting[C]//Proceedings of the 19th International Confer- ence on Data Engineering (ICDE), Los Alamitos, CA, USA, 2003. Washington, DC, USA: IEEE Computer Society, 2003: 717-719.
  • 9Tan K L, Eng P K, Ooi B C. Efficient progressive Skyline computation[C]//Proceedings of the 27th International Conference on Very Large Data Bases (VLDB), 2001. San Francisco, CA, USA: Morgan Kaufmann, 2001:301-310.
  • 10Kossmann D, Ramsak F, Rost S. Shooting stars in the sky an online algorithm for Skyline queries[C]//Proceedings of the 28th International Conference on Very Large Data Bases (VLDB), Hong Kong, China, 2002. San Francisco, CA, USA: Morgan Kaufmann, 2002: 275-286.

共引文献707

同被引文献15

引证文献2

二级引证文献4

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部