混搭型大数据平台的统一资源管控

The Unified Control of Resources for the Mashup Bigdata Platform

针对目前通信行业大数据平台普遍存在的混搭型结构,建立统一资源管控体系,在Hadoop生态圈系统以及ShareNothing MPP数据库方面分别设计并实现了基于Yarn以及CGroup技术的资源隔离管控机制,保证集群的最大资源利用率。

Aiming at the mushup structure for telecom bigdata platform,this paper establishes a unified system of tenants,designs and implements the resource control mechanism based on Yarn for Hadoop ecosystem system,and based on CGroup for ShareNothing MPP database,to ensure the maximum utilization of resources cluster.