大数据应用技术探究

Study on Big Data Applied Technologies

根据大数据各个环节处理的不同,对大数据在存储、管理、处理、分析等环节的工程技术进行了简要的概述,介绍了各环节主流技术的实现原理及其特点,探讨了存在的一些问题和缺点。列举并讨论了一些在大数据领域具有代表性的科技企业使用的大数据技术。经过比较认为,大数据主要的技术流派为两种。其一是谷歌公司的大数据三大技术,其二是开源世界的Hadoop,大部分工程应用都采用了基于Hadoop的技术。

According to different processing ways of different stages of big data,some engineering techniques are briefly summarized in the corresponding stages of storage,management,processing,and analysis.In each part the principles of implementation and the characteristics of mainstream technologies are introduced.Meanwhile,the problems and shortcomings of those technologies are also discussed.Then,the big data techniques are listed and discussed which are used in representative science and technology enterprises in the big data field.After comparison,it comes to the conclusion that there are actually two main kinds of big data.One is the three major technologies of big data developed by Google Corporation;the other is Hadoop in open source world.Most of engineering applications are based on Hadoop technology.