随着互联网时代的到来,互联网数据的产生和收集数量呈爆炸式发展。使用金融机构大数据抓取软件系统处理和存储相关数据成为许多商业机构和研究机构的常态化选择,金融机构大数据抓取软件系统可以简化使用者对于信息传输和信息计算的具体...随着互联网时代的到来,互联网数据的产生和收集数量呈爆炸式发展。使用金融机构大数据抓取软件系统处理和存储相关数据成为许多商业机构和研究机构的常态化选择,金融机构大数据抓取软件系统可以简化使用者对于信息传输和信息计算的具体操作,便于提高使用者的使用效率和准确率。本文研究的金融机构大数据抓取软件系统通过Python和Java语言完成,主要包括:金融机构大数据抓取软件系统分析模块、金融机构大数据抓取软件系统优化模块、金融机构大数据抓取软件系统预测模块。在研究的过程当中本文采用了递归随机搜索算法、Java图形界面、Hadoop平台进行设计研究。经过测试,在选用服务器为Intel Atom D510时,金融机构大数据抓取软件系统优化模块在Hadoop集群上开展优化,系统任务执行时间变短,比原来的数据时间缩短了5%以上,优化有效。展开更多
Most traditional ground roll separation methods utilize only the difference in geometric characteristics between the ground roll and the refl ection wave to separate them.When the geometric characteristics of data are...Most traditional ground roll separation methods utilize only the difference in geometric characteristics between the ground roll and the refl ection wave to separate them.When the geometric characteristics of data are complex,these methods often lead to damage of the reflection wave or incompletely suppress the ground roll.To solve this problem,we proposed a novel ground roll separation method via threshold filtering and constraint of seismic wavelet support in the curvelet domain;this method is called the TFWS method.First,curvelet threshold fi ltering(CTF)is performed by using the diff erence of the curvelet coeffi cient of the refl ection wave and the ground roll in the location,scale,and slope of their events to eliminate most of the ground roll.Second,the degree of the local damaged signal or the local residual noise is estimated as the local weighting coeffi cient.Under the constraints of seismic wavelet and local weighting coeffi cient,the L1 norm of the refl ection coeffi cient is minimized in the curvelet domain to recover the damaged refl ection wave and attenuate the residual noise.The local weighting coeffi cient in this paper is obtained by calculating the local correlation coeffi cient between the high-pass fi ltering result and the CFT result.We applied the TFWS method to simulate and fi eld data and compared its performance with that of frequency and wavenumber filtering and the CFT method.Results show that the TFWS method can attenuate not only linear ground roll,aliased ground roll,and nonlinear noise but also strong noise with a slope close to the refl ection events.展开更多
文摘随着互联网时代的到来,互联网数据的产生和收集数量呈爆炸式发展。使用金融机构大数据抓取软件系统处理和存储相关数据成为许多商业机构和研究机构的常态化选择,金融机构大数据抓取软件系统可以简化使用者对于信息传输和信息计算的具体操作,便于提高使用者的使用效率和准确率。本文研究的金融机构大数据抓取软件系统通过Python和Java语言完成,主要包括:金融机构大数据抓取软件系统分析模块、金融机构大数据抓取软件系统优化模块、金融机构大数据抓取软件系统预测模块。在研究的过程当中本文采用了递归随机搜索算法、Java图形界面、Hadoop平台进行设计研究。经过测试,在选用服务器为Intel Atom D510时,金融机构大数据抓取软件系统优化模块在Hadoop集群上开展优化,系统任务执行时间变短,比原来的数据时间缩短了5%以上,优化有效。
基金supported by Scientific Research Foundation of Shandong University of Science and Technology for Recruited Talents(No.2017RCJJ034)the National Natural Science Foundation of China(No.41676039)the National Science and Technology Major Project(2017ZX05049002-005)。
文摘Most traditional ground roll separation methods utilize only the difference in geometric characteristics between the ground roll and the refl ection wave to separate them.When the geometric characteristics of data are complex,these methods often lead to damage of the reflection wave or incompletely suppress the ground roll.To solve this problem,we proposed a novel ground roll separation method via threshold filtering and constraint of seismic wavelet support in the curvelet domain;this method is called the TFWS method.First,curvelet threshold fi ltering(CTF)is performed by using the diff erence of the curvelet coeffi cient of the refl ection wave and the ground roll in the location,scale,and slope of their events to eliminate most of the ground roll.Second,the degree of the local damaged signal or the local residual noise is estimated as the local weighting coeffi cient.Under the constraints of seismic wavelet and local weighting coeffi cient,the L1 norm of the refl ection coeffi cient is minimized in the curvelet domain to recover the damaged refl ection wave and attenuate the residual noise.The local weighting coeffi cient in this paper is obtained by calculating the local correlation coeffi cient between the high-pass fi ltering result and the CFT result.We applied the TFWS method to simulate and fi eld data and compared its performance with that of frequency and wavenumber filtering and the CFT method.Results show that the TFWS method can attenuate not only linear ground roll,aliased ground roll,and nonlinear noise but also strong noise with a slope close to the refl ection events.
