基于大数据分析技术的计算机网络日志分析系统研究

Research on Computer Network Log Analysis System Based on Big Data Analysis Technology

随着信息化建设的快速发展和电信运营商ICT的快速融合,流量需求迅猛增长,运营商网络中积累了大量的软硬件资源,包括交换机、路由器、防火墙以及服务器等。网络设备承载的负荷越来越大,业务越来越复杂。相关系统持续不断记录了大量的日志,日志文件负责记录系统和用户行为,在监控网络运行情况、调查设备故障以及保护系统安全等方面有着举足轻重的作用。基于此,开展基于大数据分析技术的计算机网络日志分析系统研究。

With the rapid development of informatization and the rapid integration of ICT by telecom operators, the demand for traffic has increased rapidly. A large number of hardware and software resources have been accumulated in the operator’s network, including: switches, routers, firewalls, servers, etc. The load carried by the network equipment is increasing and the services are becoming more and more complex. These devices continuously record a large number of logs. As a recording tool for hardware devices, systems, and user behavior, log files play a pivotal role in monitoring network operation, investigating device failures, and protecting system security.