基于Hadoop的大数据平台架设探讨

Discussion on the Erection of Large Data Platform Based on Hadoop

Hadoop作为当今大数据时代下最流行的技术之一,对学术的发展和商业模式都产生了深远的影响。首先简单地介绍了Hadoop及其核心组成部分HDFS、Map Reduce的技术原理,然后详细说明了如何在Cent OS系统下安装并搭建Apache Hadoop平台,并在虚拟机中实现Hadoop的完全分布式环境的配置。最后简要地提出了Hadoop的安装配置过程中的常见问题及其解决办法。

As one of the most popular technologies in Big Data Era nowadays, Hadoop has caused a profound impact on the development of academia and business models. First of all, this paper briefly introduces the technical principal of Hadoop and its kernel components, HDFS and Map Reduce, then sufficiently explains the process about deploying Apache Hadoop platform on Cent OS operating system, and finally implements the configuration of Hadoop＇s Fully Distributed Environment in virtual machines. At the end of the paper, the frequently asked questions and solutions in deployment and configuration of Hadoop are briefly put forth.