云计算环境下大规模数据处理技术的研究

Research on Large-scale Data Processing Technology in Cloud Computing Environment

随着技术的发展,云计算技术越来越多地被运用到了各个领域。在大规模数据处理技术中引入云计算技术,能够有效推进大规模计算平台的构建,并建立起具有动态变化、可扩展性和高性价比的系统,从而形成一个以云计算环境为基础的大规模数据处理与分析系统的结构实体建模。文中论述了在这种情况下,如何进行大规模的数据处理,并建立了相应的计算机平台,最终验证了计算机体系结构的可行性。

With the development of technology,cloud computing technology is increasingly applied to various fields.The introduction of cloud computing technology into large-scale data processing technology can effectively promote the construction of large-scale computing platform,and establish a system with dynamic change,scalability and high cost performance,thus forming a structural entity modeling of a large-scale data processing and analysis system based on cloud computing environment.This paper discusses how to deal with large-scale data in this case,and establishes the corresponding computer platform to verify the feasibility of the computer architecture.