基于云计算的水利枢纽运行多源数据智慧集成方法

Intelligent Integration Method for Multi-Source Data in the Operation of Water Conservancy Hubs Based on Cloud Computing

由于水利枢纽运行多源数据具有异构属性,其集成过程常常面临信息丢失的问题,为此,进行基于云计算的水利枢纽运行多源数据智慧集成方法研究。利用AWS Lambda无服务器云计算平台,将水利枢纽运行的多源数据统一为CSV格式,并转化为AWS Lambda云存储系统数据库中的表格形式。通过为IAM角色赋予函数执行权限,结合数据的权重信息对S3存储桶中的数据进行集成。测试结果表明,采用设计方法进行集成时,各类数据的丢包率并未出现明显波动,整体丢包率始终保持在1.5%以下的较低水平。

Due to the heterogeneous nature of multi-source data in the operation of water conservancy hubs,the integration process often faces the problem of information loss.To address this,an intelligent integration method for multi-source data in the operation of water conservancy hubs based on cloud computing is proposed.Using the AWS Lambda serverless cloud computing platform,the multi-source data from the water conservancy hub operation is standardized into CSV format and converted into table form within the AWS Lambda cloud storage system database.By granting function execution permissions to IAM roles,the data in the S3 storage buckets is integrated using the weight information of the data.Test results show that when using the designed integration method,there is no significant fluctuation in the packet loss rate of various data types,and the overall packet loss rate remains consistently at a low level of below 1.5%.