分布式地震数据文件系统

Distributed Seismic Data File System

在地震资料处理系统中,对TB级的海量地震数据文件的存取存在严重的I/O瓶颈。针对地震数据文件操作的特点,提出了一个基于集群环境的分布式地震数据文件系统(DSFS)。该系统由数据库节点、地震数据文件节点、计算节点组成。设计了面向地震道集数据的分布式文件架构,该架构以地震道头信息索引数据库为中心,将一个大的地震数据文件分解为多个可独立操作的子文件,建立基于道头字的索引数据表,根据索引表可快速定位道数据所在的子文件及数据块。设计了一组DSFS文件操作和道集数据读写操作,提供了针对虚拟文件按道头字值进行数据查询和输入输出,屏蔽了分布式文件的细节,并提出了文件分布及并行存取策略。DSFS在地震资料处理系统得到应用并具有很高的数据存取效率。

The serious I/O bottleneck was found in seismic data process system to access large seismic data file which size reaches TB grade. Aiming at the futures of accessing seismic data files, a distributed seismic data file system （ DSFS ） based on cluster computer is put forward, that is composed of database node, seismic data file node and computing node. A distributed file architecture facing seismic gather is designed, taking seismic trace indexing database as the center, spliting a large seismic data file into sub files that can be access seismic data separately, a seismic trace indexing table is designed to locate the sub file and data block that a trace data is stored. A set of operators on DSFS file and accessing gather data are designed, providing the data query and input and output data by trace key values in large file, the distributed file details is screened. The strategy for distributed file and parallel I/O is presented. The DSFS has been used in seismic data process system, and has very high I/O efficiency.