基于Hadoop的油田勘探开发云平台数据存储模型研究与应用

Research and Application of Hadoop-based Data Storage Model for Oilfield Exploration and Development Cloud Platform

在物联网、移动互联网、云计算等信息技术的引擎带动下,大数据得到了迅猛的发展,攀升规模让人目不暇接,大数据的挖掘已经成为各个领域的焦点。在云平台开源项目Apache的构建中,Hadoop是重要的功能载体。基于Hadoop框架的应用,计算机集群得以快捷地实现。在油田勘探开发中越来越多的数据被挖掘出来,传统的Javs EE技术严重滞后于现代油田勘探开发功能需要,新的技术整合势在必行。根据分布式文件系统HDFS,依托Hadoop构建云平台数据存储结构模型,在油田勘探开发作业中真正实现了数据存储和查询的统一性,以及超强的灾备和预警能力,不仅显著提高了多表联合查询效率,真正意义上实现了数据资源的共享。

Driven by the engines of information technology such as the Internet of Things,mobile Internet and cloud computing,big data has developed rapidly,climbing to a dizzying scale,and the mining of big data has become the focus of various fields.In the construction of the cloud platform open source project Apache,Hadoop is an important functional carrier.Based on the application of the Hadoop framework,computer clusters can be implemented quickly.As more and more data is mined in oilfield E&P,traditional JavsEE technology is seriously lagging behind the functional needs of modern oilfield E&P and new technology integration is imperative.Based on the distributed file system HDFS,the cloud platform data storage structure model is built based on Hadoop,which truly realises the unity of data storage and query in oilfield E&P operations,as well as superb disaster recovery and early warning capabilities,not only significantly improving the efficiency of multi-table joint query,but also truly realising the sharing of data resources.