期刊文献+

基于MapReduce的地震波形数据并行解压缩算法研究 被引量:1

Research on Parallel Decompressing Algorithm for Seismic Waveform Data Based on Map Reduce
下载PDF
导出
摘要 近年来各省级地震台网SEED文件数据量急增。在数据处理过程中,利用原有的串行解压缩算法批量解压缩地震波形数据时存在操作繁琐、耗时较长的问题。本文引入了MapReduce并行编程模型,根据该编程模型思想结合原有串行解压缩算法,提出了一种并行解压缩地震波形数据的算法,并给出了算法的设计与实现。本文从正确性、运行效率以及可扩展性三个方面进行了对比实验,验证了使用并行算法解压缩数据的效率较高,并且能够一次实现批量地震波形数据的解压缩,且操作简单。 In recent years, the number of SEED files was growing rapidly. In data processing, original algorithm of decompression batch seismic waveform data operated complicatedly and cost much time. In this paper, MapReduce programming model was introduced and a new parallel algorithm based on the thoughts of programming model and original decompression algorithm was presented. Also the design and implementation of this algorithm were given. Comparative experiments were carried out in terms of correctness, efficiency and extensibility. The results showed that the original algorithm spent more time compared to parallel algorithm which implementing decompression rapidly for a large number of seismic waveform data files. Using this method can decompress bulk of seismic waveform data and operate easily.
出处 《震灾防御技术》 CSCD 北大核心 2015年第2期344-352,共9页 Technology for Earthquake Disaster Prevention
基金 河北省重点地区壳幔结构及地震监测预报关键技术研究(13275407D) 河北省教育厅自然科学研究项目(QN20131141) 河北师范大学应用开发基金项目(L2012K01)联合资助
关键词 地震波形数据 解压缩 并行 Seismic waveform data Decompress Parallel MapReduce
  • 相关文献

参考文献10

  • 1李闯,赵长海,晏海华,2010.基于MapReduce的菲涅耳带地震层析成像并行算法.见:2010年全国高性能计算学术年会(HPCChina)论文集,90-96.
  • 2陆秋,程小辉.基于MapReduce的决策树算法并行化[J].计算机应用,2012,32(9):2463-2465. 被引量:19
  • 3王洪体,陈阳,庄灿涛.SEED格式STEIM2数据压缩算法在实时地震数据传输中的应用[J].地震地磁观测与研究,2004,25(4):14-19. 被引量:17
  • 4文必龙,冯翔,左春雪,刘雪飞,汪志群.地震资料分布式存取的效率优化设计[J].计算机与数字工程,2014,42(8):1386-1389. 被引量:2
  • 5赵长海,晏海华,刘晓朋,熊登,史晓华,2012.以实际算法为例评估MapReduce在石油勘探中的应用.通信学报,(Z2):81-89.
  • 6中国地震局,2003.地震波形数据交换格式(DB/T2-2003).北京:地震出版社.
  • 7Dean J., Ghemawat S., 2008. MapReduce: Simplified data processing on large clusters. Comunieations of the ACM, 51 (1): 107--113.
  • 8Ghemawat S., GobioffH., Leung S.T., 2003. The Google file system. ACM SIGOPS Operating Systems Review, 37 (5): 29--43.
  • 9Mauro M., Terje U., 2006. Mini SEED for LISS and data compression using Steiml and Steim2. Norweigian National Seismic Network Technical Report.
  • 10White T., 2012. Hadoop: The definitive guide. CA SebastopoI: O'ReilIy Media, Inc, 2012.

二级参考文献18

  • 1魏红宁.基于SPRINT方法的并行决策树分类研究[J].计算机应用,2005,25(1):39-41. 被引量:18
  • 2崔丽美,谢传节,杨联安,张蕾.基于XML Schema地球系统科学数据的元数据扩展机制[J].测绘学报,2005,34(3):246-251. 被引量:21
  • 3韩松来,张辉,周华平.基于关联度函数的决策树分类算法[J].计算机应用,2005,25(11):2655-2657. 被引量:36
  • 4[3]Federation of Digital Seismographic Network, Incorporated Research Institutions for Seismology, United States Geological Survey, 2002, Standard for the Exchange of Earthquake Data, 1993 Reference Manual[R]
  • 5LIU YANG, LI MAOZHEN, ALHAM N K. HSIM: A MapReduce simulator in enabling cloud computing[ EB/OL]. [ 2012- 01- 20]. http://www. sciencedirect. com/science/article/pii/S0167739X110 00884.
  • 6ALHAM N K, LI MAOZHEN, LIU YANG. A MapReduce-based distributed SVM algorithm of automatic image annotation[ J]. Com- puters and Mathematics with Applications, 2011, 62 (7): 2801 - 2811.
  • 7Tom White.Hadoop..The Definitive Guide[M].America:0'Reilly Media,2009:18-25.
  • 8维基.Hadocp[OL].http://en.wikipedia,org/wiki/Hadoop,2010.
  • 9童明.基于HDFS分布式存储研究与应用[D].武汉:华中科技大学,2012.
  • 10Neven F.Automata,logic,and XML[C]//Proc of the 16th Int'l Workshop Computer Science Logic.CSL,2002:2-26.

共引文献35

同被引文献17

引证文献1

二级引证文献5

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部