基于大数据技术的高校图书馆电子资源访问日志分析

Analysis of Electronic Resource Access Logs in University Libraries Based on Big Data Technology

传统图书馆电子资源访问日志工具采集周期长、处理效率低下,无法支持高校图书馆大规模电子资源的日志采集和分析需求。大数据技术为图书电子资源的访问日志分析提供了值得借鉴的方法和手段。本文研究了一种采用Web日志工具LogStash和Elasticsearch设计实现的高校图书电子资源访问日志的实时采集和快速查询分析方法;给出了日志采集的大数据工具的选择、索引的建立方法,以及日志分析的处理流程,文中采用Kibana工具实现日志可视化分析。

Traditional library electronic resource access log tools have long acquisition cycle,low handlingefficiency,can not support the needs of university library's large-scale electronic resources log acquisition andanalysis.The big data technology provides a valuable method and means for the access log analysis of libraryelectronic resources.This paper studied a real-time acquisition and quick query analysis method for the accesslog of electronic resource in university library using Web access log tools of LogStash and ElasticSearch design.The selection of big data tools for log acquisition,the establishment method of index,and the prodedure of loganalysis were given.Kibana tool was used in the paper to achieve the log visualization analysis.