摘要
文中针对如何从海量数据中提取有用价值信息这一开发应用问题,通过分析现有计算和存储技术,并且结合Hadoop的技术研究,设计了一种海量数据处理模型,该模型是以Hadoop技术为基础的。文中先介绍了分布式系统,然后描述了Hadoop架构,最后介绍了本设计的海量数据处理模型。该模型通过一系列设计可以有效的缓解了网络压力,同时它不需要程序员具有相应专业的经验就可以对超大系统进行整理并且获得所需资源。该模型具有高效率、低成本以及易维护的特性。
In this paper, we design a data processing model based on Hadoop technology, which is based on the analysis of the existing computing and storage technology, and combining with the technology of Hadoop. This paper first introduces the distributed system, then describes the Hadoop architecture, and finally describes the design of mass data processing model.Through a series of design, the model can effectively alleviate the pressure of the network, while it does not need to have the corresponding professional experience with the corresponding professional experience can be a large system to collate and get the required resources. The model has the characteristics of high efficiency, low cost and easy maintenance.
出处
《电子设计工程》
2016年第14期101-103,106,共4页
Electronic Design Engineering
