基于大数据框架的图书馆馆藏资源数据存储与设计实践

Data Storage and Design Practice of Library Collection Resources Based on Big Data

大数据时代图书馆信息资源的整合和价值挖掘是一个非常重要的研究方向。文章通过对图书馆数据管理现状进行分析,提出基于Hadoop技术、微服务框架和k-means聚类算法的图书馆大数据平台构建技术思路,并就系统架构设计、数据存储架构设计、数据采集清洗、数据接口与传输进行了研究并展示。该系统能够全方位接入图书馆管理所涉及的图书信息借阅信息和外部数据库等,数据种类丰富、归纳整洁,为馆藏数据资源的挖掘和利用奠定了一定基础。

The integration and value mining of library information resources in the era of big data is a very important research direction.Based on the analysis of the current situation of library data management,this paper proposes the construction technical ideas of library big data platform based on Hadoop technology,micro-service framework and K clustering algorithm,and studies and demonstrates the system architecture design,data storage architecture design,data collection and cleaning,data interface and transmission.The system can fully access the library management related to the book information,borrowing information,and external database,data types are rich,summed up neatly.For the collection of data resources mining and utilization it has laid a certain foundation.