期刊文献+

延迟光照算法对Hadoop集群渲染系统的改进与实现

Improvement and implementation of Hadoop cluster rendering system based on deferred lighting algorithm
下载PDF
导出
摘要 针对集群渲染系统在三维场景文件输出过程中,海量数据处理以及存储的问题,利用Hadoop框架对现有系统进行分布式模型改造,以基于延迟光照算法的处理方式,对分布式存储和计算的业务逻辑结构部署,实现改进Hadoop集群渲染系统对任务的处理策略,提供高容错、可靠的存储和海量计算数据的方式。通过实验证明改进的Hadoop集群渲染系统可以提高系统利用率和任务处理能力。 In view of the problem of massive data processing and storage in 3D scene file output process in cluster rendering system, the distributed model is reconstructed for the existing system by using the Hadoop framework. It uses deferred light- ing algorithm to realize the business logic structure of the deployment of distributed storage and computing. The task process- ing strategies to improve Hadoop cluster rendering system is provided with high fault tolerance, reliable storage and mass data calculation. Experimental results show that the developed Hadoop cluster rendering system can improve system efficiency and tasking ability.
作者 张亭
出处 《河北工业科技》 CAS 2014年第4期337-341,共5页 Hebei Journal of Industrial Science and Technology
关键词 集群渲染系统 延迟光照算法 cluster rendering system Hadoop deferred lighting algorithm
  • 相关文献

参考文献10

  • 1DEKEL. Scalability of the Hadoop Distributed File System [EB/OL]. http://developer, yahoo, com/blogs/hadoop/seal- ability-hadoop-distributed-file-system-452, html, 2010-05-05.
  • 2孙亚萍,陈福民.分布式渲染中动态任务拆分算法的研究[J].微计算机应用,2007,28(1):43-46. 被引量:2
  • 3波恩.数字绘图的光照与渲染技术[M].第2版.杜静芬,译.北京:清华大学出版社,2008.
  • 4KLINT J. Deferred Rendering in Leadwerks Engine [EB/ OL]. http://www, leadwerks, corn/files/deferred_rendering_ in leadwerks_engine, pdf, 2010-12-27.
  • 5Hargreaves. Deferred Shading[EB/OL]. http..//talula, demon. eo. uk/deferredshading, pdf, 2010-12-08.
  • 6王凯,吴泉源,杨树强.一种多用户MapReduce集群的作业调度算法的设计与实现[J].计算机与现代化,2010(10):23-28. 被引量:22
  • 7DEAN J,GHEMAWA S. MapReduce: Simplified data pro- cessing on large dusters[J]. Communications of the ACM, 2008,51(1) :107-113.
  • 8CUTTING D. Scalable computing with MapReduce[A]. OS- CON[C]. Portland: [s. n. ] ,2005. 124-130.
  • 9WHITE T.Hadoop权威指南:The Definitive Guide[M].周敏厅,王晓玲,金澈清,等译.北京:清华大学出版社,2010.
  • 10Lam C.Hadoop实战[M].北京:人民邮电出版社,2011.

二级参考文献20

  • 1Dean J,Ghemawat S.MapReduce:Simplified data processing on large clusters[J].Communications of the ACM,2008,51(1):107-113.
  • 2Isard M,Budiu M,Yu Y,et al.Dryad:Distributed data-parallel programs from sequential building blocks[C] //Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007.Lisbon,Portugal,2007:59-72.
  • 3Apache.Hadoop On Demand[DB/OL].http://hadoop.apache.org/common/docs/r0.17.2/hod.html,2008-08-20.
  • 4Apache.Welcome to Apache Hadoop[DB/OL].http://hadoop.apache.org,2010-05-12.
  • 5Borthakur D.The Hadoop Distributed File System:Architecture and Design[DB/OL].http://hadoop.apache.org/common/docs/r0.17.2/hdfs_design.html,2008-08-20.
  • 6Facebook.Facebook[EB/OL].http://www.facebook.com,2010-08-01.
  • 7Apache.Welcome to Hive[DB/OL].http://hadoop.apache.org/hive/,2010-02-24.
  • 8Thusoo A,Sarma J S.Hive:A warehousing solution over a map-reduce framework[C] //VLDB.2009.
  • 9Wikipedia.Max-Min Fairness[DB/OL].http://en.wikipedia.org/wiki/Max-min_fairness,2010-05-29.
  • 10Isard M,Prabhakaran V,Currey J,et al.Quincy:Fair scheduling for distributed computing clusters[C] //Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles.2009:261-276.

共引文献27

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部