基于Storm的自适应弹性资源分配策略组件实现

Component Implementation of Adaptive Elastic Resource Allocation Strategy Based on Storm

针对Storm平台的静态资源分配问题,提出一种分布式自适应弹性资源分配策略,能最优满足应用的资源需求.基于该策略,结合Storm的资源分配机制、应用编程接口和用户界面的参数,实现了一个面向Storm的弹性资源分配组件,支持应用资源的自适应动态调整.实验结果表明,在真实的流数据集上,分布式最优策略与中值式动态资源分配策略和Storm的静态资源分配策略相比,在吞吐量、丢失率和资源利用率上均有优势.同时,该自适应弹性资源分配组件能很好地与Storm系统交互,为其他弹性资源调度组件开发提供了可借鉴的解决方案.

Aiming at the problem of static resource allocation of the Storm platform,we proposed a distributed adaptive elastic resource allocation strategy,which could optimally meet the resource requirements of applications.Based on this strategy,combined with the resource allocation mechanism,application programming interface and user interface parameters of Storm,an elastic resource allocation component deployed in Storm was implemented to support adaptive and dynamic adjustment of application resources.The experimental results show that on the real stream data set,compared with the middle-value dynamic resource allocation strategy and the static resource allocation strategy of Storm,this distributed optimal strategy has advantages in throughput,loss rate and resource utilization.Meanwhile,this adaptive elastic resource allocation component can well interact with the Storm system,providing a reference solution for the development of other elastic resource scheduling components.