基于物联网云计算的能源行业电商大数据存储技术优化研究

Research on the Optimization of Big Data Storage Technology for E-Commerce in the Energy Industry Based on the Cloud Computing of the Internet of Things

能源行业存在长工程、跨工序的特点,传统信息管理储存能力不足,制约了企业发展。因此,急需解决能源行业电商数据储存效率与容错率低的问题。文章利用Hadoop分布式文件系统结合哈希算法优化电商数据储存技术,先引入Hadoop分布式文件系统优化数据通信与储存架构,再使用哈希算法优化数据储存分布。设计方法解决了能源行业电商储存文件多、消耗大的问题,提高了文件传输效率与数据处理效率。

The energy industry has the characteristics of long engineering and cross-process process,and the traditional information management and storage capacity is insufficient,which restricts the development of enterprises.Therefore,it is urgent to address the low efficiency and fault tolerance of e-commerce data storage in the energy industry.The article utilizes Hadoop distributed file system combined with hash algorithm to optimize e-commerce data storage technology.Firstly,Hadoop distributed file system is introduced to optimize data communication and storage architecture,and then hash algorithm is used to optimize data storage distribution.The design method has solved the problem of storing too many files and consuming too much in the energy industry e-commerce,improving the efficiency of file transmission and data processing.