基于PaaS技术的大数据云化平台分析

Analysis of big data cloud platform based on PaaS technology

移动互联网环境下,对海量用户数据行为的研究,可以提升用户数据的应用价值,促进商业模式的创新。大数据环境下为满足对内对外应用支撑能力以及数据开放共享能力需求,在PaaS技术应用下完成多用户架构,建构相应的大数据云化平台,支撑大数据平台能力开放建设。在PaaS技术下完成大数据云化平台的建构,完成整体架构,实现能力集成、多应用类型的分层调度、多租户及其资源调度管理以及全局优化的YARN调度技术,在完成的平台应用实践分析中发现,这一系统不但满足了相应的技术需求,同时在硬件资源准备时间、开发工具准备时间、数据准备时间、应用部署时间及资源利用率方面也具有显著效果,和传统系统具有明显差异。

In the mobile Internet environment,the research on the behavior of massive user data can enhance the application value of user data and promote the innovation of business model.In order to meet the needs of internal and external application support capacity and data opening and sharing capacity in big data environment,multi⁃user architecture is completed under PaaS technology application,and corresponding big data cloud platform is constructed to support the capacity opening construction of big data platform.Under PaaS technology,the construction of big data cloud platform is completed,the overall architecture is completed,and capability integration,hierarchical scheduling of multi application types,multi tenant and resource scheduling management,and globally optimized YARN scheduling technology are realized,in the completed platform application practice analysis,it is found that this system not only meets the corresponding technical requirements,but also has significant effect in hardware resource preparation time,development tool preparation time,data preparation time,application deployment time and resource utilization,which is significantly different from the traditional system.