基于数字图书馆公共资源管理平台的实时日志分析系统的设计与应用

Design and Application of Real-time Log Analysis System based on Digital Library Public Resource Management Platform

数字图书馆作为一种全面、高效、便捷的公共资源管理平台正在得到广泛的应用,随之而来网络用户访问流量的不断增大,让数字图书馆公共资源管理平台面临了巨大的网络安全风险.为解决数字图书馆公共资源管理平台在投入使用过程中遭受网站恶意攻击、网页挂马等系统安全问题,使用Spark Streaming技术设计一个实时日志分析系统,对网站平台进行实时日志分析.该系统具有实时性、功能针对性强、操作简便等特点.经过运行测试,能够对数字图书馆公共资源管理平台的运行起到保驾护航的作用.

As a comprehensive,efficient and convenient public resource management platform,digital library is widely used.With the increase of network users’access flow,digital library public resource management platform is facing a huge network security risk.In order to solve the system security problems of digital library public resource management platform,such as website malicious attack,webpage mount and so on,a real-time log analysis system is designed based on spark streaming website log analysis technology.The system has the characteristics of real-time,function pertinence and easy operation.After running test,it can guarantee the operation of digital library public resource management platform.