摘要
新兴应用对大数据处理技术架构的实时性要求不断提高,这对传统的大数据处理技术架构提出严峻的挑战。必须转变架构满足大数据相关业务的实时性要求。文章介绍Hadoop离线处理架构的瓶颈以及Storm实时处理架构的优点,同时,结合实际项目中变更大数据处理技术架构的经验,阐述在实施架构变更过程中的关键技术,实验结果证明使用变更后的技术架构可以满足业务的实时性要求。
New applications ask more to the real-time requirement of the Big Data processing technical architecture, which gives a severe chalenge to the traditional Big Data processing technical architecture. To satisfy the real-time requirements of Big Data relevant business, we have to change the architecture. This article introduces the bottleneck of Hadoop outline processing architecture and the advantages of Storm real-time processing architecture. Meanwhile, combining the experience of changing Big Data processing technical architecture in actual project simultaneously, it describes the key technology in the process of implementation of architecture transformation. The result shows the technical architecture after changing can satisfy the real-time requirements of our business.
出处
《信息通信技术》
2014年第6期47-51,共5页
Information and communications Technologies
