期刊文献+

基于自台监控系统大数据的存储和分析方案

Big Data's Storage and Analysis Based on Self-Monitoring System in TV Station
下载PDF
导出
摘要 基于大数据的视角,本文针对重庆广播电视技术自台监控系统大数据的存储和分析问题,提出了详细的设计思路和方案。设计方案紧密结合目前流行的数据处理框架,与自台监控系统形成无缝对接。方案能够对自台监控系统的数据进行高效挖掘,发现其中隐藏的规律和知识。最后,针对大数据的挖掘和分析在整个广播电视行业的意义和应用进行了思考和探讨。 Based on the perspective of big data, this paper provides an architecture solution for the data of Chongqing Radio and Television Technology Center's self-monitoring system's big data. Combination with the popular data mining framework, this solution can seamlessly integrate with the self-monitoring system. This solution, which analyzes and processes self-monitoring's data automatically and efficiently, can obtain the knowledge and rules behind the data. At last. this paper makes a reflection and discussion about the application of big data in radio and television industry.
出处 《广播与电视技术》 2016年第7期26-32,共7页 Radio & TV Broadcast Engineering
关键词 自台监控 大数据 数据挖掘 HDFS SPARK Self-monitoring system, Big data. Data mining, HDFS, Spark
  • 相关文献

参考文献5

  • 1刘刚,侯宾,翟周伟.Hadoop开源云计算平台[M].北京:北京邮电大学出版社,2011.
  • 2Spark. http://spark.apache.org/docs/latest/index.html.
  • 3Y.Fu, W.zhao, and H.Ma," Research on parallel DBSCAN algorithm design based on Map Reduce," Advanced Materials Research, vol. 301, pp.1133-1138, 2011.
  • 4Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael J. Franklin, Scott Shenker," Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing," Technical Report UCB/EECS-2011-82, EECS Department, University of California, Berkeley, .lul 2011.
  • 5Weka. http://weka, wikispaces.com/.

共引文献15

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部