多源异构检测大数据采集与存储方法研究

Research on Data Acquisition and Storage Methods Based on Multi-Source Heterogeneous Testing Big Data

随着检测行业的不断发展,检测数据也日渐庞大。由于检测设备的多样性,检测数据呈现了数据来源多样化、数据结构差异化的特点,传统的数据采集和存储方法无法有效地支撑多源异构检测大数据的使用需求。该文采用结合关系型数据库和非关系型数据库相结合的方式,搭建集成数采、存储功能于一体的多源异构检测大数据存储架构,解决检测数据信息孤岛问题,提高检测大数据分析与挖掘的效率。

With the continuous development of the testing industry,the testing data is becoming larger and larger.Due to the diversity of testing equipment,the testing data presents the characteristics of diversified data sources and differentiated data structure.The traditional data acquisition and storage methods can not effec tively meet the demands of using multi-source heterogeneous detection big data.This paper combines rela tional database and non relational database to build a big data storage architecture that integrates data acquisition and storage functions.The architecture can solve the problem of information island and improve the efficiency of testing data analysis and mining.