期刊文献+

分布式系统Hadoop平台的视频转码 被引量:16

Distributed Video Transcoding on Hadoop
下载PDF
导出
摘要 在研究了目前主流的视频转码方案基础上,提出了一种分布式转码系统。系统采用HDFS(Hadoop Distributed File System)进行视频存储,利用MapReduce思想和FFMPEG进行分布式转码。详细讨论了视频分布式存储时的分段策略,以及分段大小对存取时间的影响。同时,定义了视频存储和转换的元数据格式。提出了基于MapReduce编程框架的分布式转码方案,即Mapper端进行转码和Reducer端进行视频合并。实验数据显示了转码时间随视频分段大小和转码机器数量不同而变化的趋势。结果表明,相比单机转码,提出的系统在采用8台机器并行转码时,可以节约80%左右的时间。 Based on study of current video transcoding solutions, we proposed a distributed transcoding system. Video resources are stored in HDFS(Hadoop Distributed File System) and transcodod by MapReduce program using FFMPEG In this paper, video segmentation strategy on distributed storage and how they affect accessing time are discussed. We also defined metadata of video formats and transcoding parameters. The distributed transcoding framework is proposed on basis of MapReduce programming model. Segmented source videos are transcoding in map tasks and merged into target video in reduce task. Experimental results show that transcoding time is dependent on segmentation size and trascoding cluster size. Compared with single PC, the proposed distributed video transcoding system implemented on 8 PCs can decrease about 80% of the transcoding time.
作者 杨帆 沈奇威
出处 《计算机系统应用》 2011年第11期80-85,共6页 Computer Systems & Applications
基金 国家杰出青年科学基金(60525110) 国家973计划(2007CB307100 2007CB307103) 国家自然科学基金(61072057 60902051) 中央高校基本科研业务费专项资金(BUPT2009RC0505) 国家科技重大专项(2011ZX03002-001-01 2011ZX03002-002-01)
关键词 视频转码 分布式内容处理 HADOOP FFMPEG video transcoding distributed processing Hadoop FFMPEG
  • 相关文献

参考文献15

  • 1Ahmad I, Wei XH, Sun Y, Zhang YQ. Video Transcoding: An Overview of Various Techniques and Research Issues. IEEE Trans. on Multimedia, 2005,7(5).
  • 2杨戈,廖建新,朱晓民,樊秀梅.流媒体分发系统关键技术综述[J].电子学报,2009,37(1):137-145. 被引量:39
  • 3Barlas G A Taxonomy and DLT-based analysis of Clusterbased Video Trans/Encoding. 14th Euromicro International Conference on Parallel, Distributed, and Network-Based.Processing, PDP 2006,388-395.
  • 4Cardellini V, Colajanni M, Lancellotti R, Yu PS. A distribute1 architecture of edge proxy servers for cooperative trans1 coding. The 3rd IEEE Workshop on Interact Applications, 2003,66-70.
  • 5Guo JN, Bhuyan L. Load Sharing in a Transcoding Cluster. Distributed Computing, 2003,835.
  • 6Sambe Y, Watanabe S, Yu D, Nakamura T..Distributed video transcoding and its application to grid delivery. Proc. ITC-CSCC2003, 2003, 921-924.
  • 7Grio African American Breaking News and Opinion, http:llwww.thegrio.com/.
  • 8Grio African American Breaking News and Opinion, http://www.thegrio.com/.
  • 9Ghemawat S, GobioffH, Leung ST. The Google File System. 19th Symposium on Operating Systems Principles. Lake George, New York, 2003,29,43.
  • 10Hadoop Makes Sense of Lots of Data. http://www.enterp- risestorageforum.com/article.php/3890191/Hadoop-Makes- Sense-of-Lots-of-Data.htm.

二级参考文献58

共引文献38

同被引文献129

引证文献16

二级引证文献39

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部