基于Hadoop云平台的大数据集群服务运行状态监控及预警研究

Research on Monitoring and Early Warning of Big Data Cluster Service Operation Status Based on Hadoop Cloud Platform

大数据分析平台集成的功能较多,保存的数据规模也非常大,访问次数也非常频繁,因此大数据分析平台运行过程中需要加强状态监控,以便能够实时的分析平台的负载能力,提高平台的资源利用率。本文详细地分析大数据集群服务运行状态监控和预警模式,从操作日志、运行状态等多个方面分析平台状况,以便能够及时的处理突发事件,保证大数据平台安全稳定运行。

The big data analysis platform integrates more functions, the scale of the stored data is very large, and the number of visits is very frequent.Therefore, the status monitoring of the big data analysis platform needs to be strengthened in order to analyze the load capacity of the platform in real time and improve The resource utilization of the platform. This article analyzes the operation status monitoring and early warning mode of the big data cluster service in detail, and analyzes the platform status from various aspects such as operation logs and operation status, so as to be able to deal with emergencies in time and ensure the safe and stable operation of the big data platform.