基于大数据机器学习技术的IT运营分析系统建设

Construction of ITOA system based on big data environment and machine learning

数字化时代,数据分析是原动力,数据中心每日产生的海量监控数据、日志,散落于各运维管理工具、服务器中。本项目旨在借助大数据、机器学习和分布式计算等技术建立IT运营分析系统(简称ITOA),实现PB级运维大数据的准实时处理和探索平台;创新动态基线算法发现历史规律、预测未来趋势,在故障诊断、告警决策和性能评估方面智能辅助运维管理,大大提升监控预警能力、故障处置速度和运维服务质量。

In the digital age,data analysis is the driving force.The data center generates a large amount of monitoring data and logs on a daily basis,which are scattered in the operational management tools and servers.This project is designed to establish the IT analysis system(ITOA)by means of big data,machine learning,distributed computing and other emerging technologies,torealize the real-time processing and data exploration platform of the PB level data;the innovative dynamic baseline algorithm discovers the historical law and predicts the trend of the future,and is intelligent assistance operation and management in the aspects of fault diagnosis,alarm decision and performance evaluation,which greatly improves the monitoring and warningcapability,the speed of troubleshooting,and the quality of the maintenance service.