多级转发数据采集任务的关系数据存储方案设计

Design of Relational Data Storage Scheme for Multi-level Forwarding Data Collection Tasks

针对通用数据采集需要采集动态多样的数据,采集任务需要多级转发,采集到的数据需要逐级审核汇总,同时还要确保不同用户数据间的安全隔离等问题,设计了支持多级转发数据采集任务的关系型数据存储方案。通过为数据采集任务动态构建数据字段以及使用序列化LOB,实现了通用数据采集任务的统一关系型数据存储。借助“自关联表”,实现了填表类与追加类两种数据采集方式下数据采集任务的多级转发、追踪与审核汇总。父子任务的状态联动跃迁进一步降低了多级数据采集中状态管理的复杂度。

In response to the need to collect dynamic and diverse data for universal data collection,the collection task requires multi-level forwarding,and the collected data needs to be reviewed and summarized level by level.At the same time,it is necessary to ensure the security isolation between different user data,and other issues.A relational data storage scheme that supports multi-level forwarding data collection tasks has been designed.By dynamically constructing datafields for data collection tasks and using serialized LOBs,unified relational data storage for universal data collection tasks has been achieved.By using the“self association table”,the data collection task can be forwarded,tracked,and reviewed at any level in two types of data collection methods:filling in tables and adding tables.The state linkage transition of parent-child tasks further reduces the complexity of state management in multi-level data collection.