Simultaneous denoising and resolution enhancement of seismic data based on elastic convolution dictionary learning

Enhancing seismic resolution is a key component in seismic data processing, which plays a valuable role in raising the prospecting accuracy of oil reservoirs. However, in noisy situations, existing resolution enhancement methods are difficult to yield satisfactory processing outcomes for reservoir characterization. To solve this problem, we develop a new approach for simultaneous denoising and resolution enhancement of seismic data based on convolution dictionary learning. First, an elastic convolution dictionary learning algorithm is presented to efficiently learn a convolution dictionary with stronger representation capability from the noisy data to be processed. Specifically, the algorithm introduces the elastic L1/2 norm as a sparsity constraint and employs a steepest gradient descent strategy to efficiently solve the frequency-domain linear system with substantial computational cost in a half-quadratic splitting framework. Then, based on the learned convolution dictionary, a weighted convolutional sparse representation paradigm is designed to encode the noisy data to acquire an optimal sparse approximation of the effective signal. Subsequently, a high-resolution dictionary with a broadband spectrum is constructed by the proposed parameter scaling strategy and matched filtering technique on the basis of atomic spectrum modeling. Finally, the optimal sparse approximation of the effective signal and the constructed high-resolution dictionary are used for data reconstruction to obtain the seismic signal with high resolution and high signal-to-noise ratio. Synthetic and field dataset examples are executed to check the effectiveness and reliability of the developed method. The results indicate that this method has a more competitive performance in seismic applications compared with the conventional deconvolution and spectral whitening methods.

Method of Multi-Mode Sensor Data Fusion with an Adaptive Deep Coupling Convolutional Auto-Encoder

To address the difficulties in fusing multi-mode sensor data for complex industrial machinery, an adaptive deep coupling convolutional auto-encoder (ADCCAE) fusion method was proposed. First, the multi-mode features extracted synchronously by the CCAE were stacked and fed to the multi-channel convolution layers for fusion. Then, the fused data was passed to all connection layers for compression and fed to the Softmax module for classification. Finally, the coupling loss function coefficients and the network parameters were optimized through an adaptive approach using the gray wolf optimization (GWO) algorithm. Experimental comparisons showed that the proposed ADCCAE fusion model was superior to existing models for multi-mode data fusion.

Quantitative evaluation of deep convolutional neural network-based image denoising for low-dose computed tomography

To minimize radiation risk,dose reduction is important in the diagnostic and therapeutic applications of computed tomography(CT).However,image noise degrades image quality owing to the reduced X-ray dose and a possible unacceptably reduced diagnostic performance.Deep learning approaches with convolutional neural networks(CNNs)have been proposed for natural image denoising;however,these approaches might introduce image blurring or loss of original gradients.The aim of this study was to compare the dose-dependent properties of a CNN-based denoising method for low-dose CT with those of other noise-reduction methods on unique CT noise-simulation images.To simulate a low-dose CT image,a Poisson noise distribution was introduced to normal-dose images while convoluting the CT unit-specific modulation transfer function.An abdominal CT of 100 images obtained from a public database was adopted,and simulated dose-reduction images were created from the original dose at equal 10-step dose-reduction intervals with a final dose of 1/100.These images were denoised using the denoising network structure of CNN(DnCNN)as the general CNN model and for transfer learning.To evaluate the image quality,image similarities determined by the structural similarity index(SSIM)and peak signal-to-noise ratio(PSNR)were calculated for the denoised images.Significantly better denoising,in terms of SSIM and PSNR,was achieved by the DnCNN than by other image denoising methods,especially at the ultra-low-dose levels used to generate the 10%and 5%dose-equivalent images.Moreover,the developed CNN model can eliminate noise and maintain image sharpness at these dose levels and improve SSIM by approximately 10%from that of the original method.In contrast,under small dose-reduction conditions,this model also led to excessive smoothing of the images.In quantitative evaluations,the CNN denoising method improved the low-dose CT and prevented over-smoothing by tailoring the CNN model.

Hformer:highly efficient vision transformer for low-dose CT denoising

In this paper,we propose Hformer,a novel supervised learning model for low-dose computer tomography(LDCT)denoising.Hformer combines the strengths of convolutional neural networks for local feature extraction and transformer models for global feature capture.The performance of Hformer was verified and evaluated based on the AAPM-Mayo Clinic LDCT Grand Challenge Dataset.Compared with the former representative state-of-the-art(SOTA)model designs under different architectures,Hformer achieved optimal metrics without requiring a large number of learning parameters,with metrics of33.4405 PSNR,8.6956 RMSE,and 0.9163 SSIM.The experiments demonstrated designed Hformer is a SOTA model for noise suppression,structure preservation,and lesion detection.

A multi-scale convolutional auto-encoder and its application in fault diagnosis of rolling bearings

Aiming at the difficulty of fault identification caused by manual extraction of fault features of rotating machinery,a one-dimensional multi-scale convolutional auto-encoder fault diagnosis model is proposed,based on the standard convolutional auto-encoder.In this model,the parallel convolutional and deconvolutional kernels of different scales are used to extract the features from the input signal and reconstruct the input signal;then the feature map extracted by multi-scale convolutional kernels is used as the input of the classifier;and finally the parameters of the whole model are fine-tuned using labeled data.Experiments on one set of simulation fault data and two sets of rolling bearing fault data are conducted to validate the proposed method.The results show that the model can achieve 99.75%,99.3%and 100%diagnostic accuracy,respectively.In addition,the diagnostic accuracy and reconstruction error of the one-dimensional multi-scale convolutional auto-encoder are compared with traditional machine learning,convolutional neural networks and a traditional convolutional auto-encoder.The final results show that the proposed model has a better recognition effect for rolling bearing fault data.

Effective Denoising Architecture for Handling Multiple Noises

Object detection,one of the core research topics in computer vision,is extensively used in various industrial activities.Although there have been many studies of daytime images where objects can be easily detected,there is relatively little research on nighttime images.In the case of nighttime,various types of noises,such as darkness,haze,and light blur,deteriorate image quality.Thus,an appropriate process for removing noise must precede to improve object detection performance.Although there are many studies on removing individual noise,only a few studies handle multiple noises simultaneously.In this paper,we pro-pose a convolutional denoising autoencoder(CDAE)-based architecture trained on various types of noises.We also present various composing modules for each noise to improve object detection performance for night images.Using the exclusively dark(ExDark)Image dataset,experimental results show that the Sequentialfiltering architecture showed superior mean average precision(mAP)compared to other architectures.

Fault Diagnosis for Rolling Bearings with Stacked Denoising Auto-encoder of Information Aggregation

Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rolling bearing faults, a prognostic algorithm consisting of four phases was proposed. Since stacked denoising auto-encoder can be filtered, noise of large numbers of mechanical vibration signals was used for deep learning structure to extract the characteristics of the noise. Unsupervised pre-training method, which can greatly simplify the traditional manual extraction approach, was utilized to process the depth of the data automatically. Furthermore, the aggregation layer of stacked denoising auto-encoder(SDA) was proposed to get rid of gradient disappearance in deeper layers of network, mix superficial nodes’ expression with deeper layers, and avoid the insufficient express ability in deeper layers. Principal component analysis(PCA) was adopted to extract different features for classification. According to the experimental data of this method and from the comparison results, the proposed method of rolling bearing fault classification reached 97.02% of correct rate, suggesting a better performance than other algorithms.

SNP site-drug association prediction algorithm based on denoising variational auto-encoder

Single nucletide polymorphism(SNP)is an important factor for the study of genetic variation in human families and animal and plant strains.Therefore,it is widely used in the study of population genetics and disease related gene.In pharmacogenomics research,identifying the association between SNP site and drug is the key to clinical precision medication,therefore,a predictive model of SNP site and drug association based on denoising variational auto-encoder(DVAE-SVM)is proposed.Firstly,k-mer algorithm is used to construct the initial SNP site feature vector,meanwhile,MACCS molecular fingerprint is introduced to generate the feature vector of the drug module.Then,we use the DVAE to extract the effective features of the initial feature vector of the SNP site.Finally,the effective feature vector of the SNP site and the feature vector of the drug module are fused input to the support vector machines(SVM)to predict the relationship of SNP site and drug module.The results of five-fold cross-validation experiments indicate that the proposed algorithm performs better than random forest(RF)and logistic regression(LR)classification.Further experiments show that compared with the feature extraction algorithms of principal component analysis(PCA),denoising auto-encoder(DAE)and variational auto-encode(VAE),the proposed algorithm has better prediction results.

Simultaneous Denoising and Interpolation of Seismic Data via the Deep Learning Method

Utilizing data from controlled seismic sources to image the subsurface structures and invert the physical properties of the subsurface media is a major effort in exploration geophysics. Dense seismic records with high signal-to-noise ratio(SNR) and high fidelity helps in producing high quality imaging results. Therefore, seismic data denoising and missing traces reconstruction are significant for seismic data processing. Traditional denoising and interpolation methods rarely occasioned rely on noise level estimations, thus requiring heavy manual work to deal with records and the selection of optimal parameters. We propose a simultaneous denoising and interpolation method based on deep learning. For noisy records with missing traces, we adopt an iterative alternating optimization strategy and separate the objective function of the data restoring problem into two sub-problems. The seismic records can be reconstructed by solving a least-square problem and applying a set of pre-trained denoising models alternatively and iteratively.We demonstrate this method with synthetic and field data.

Brief review of image denoising techniques

With the explosion in the number of digital images taken every day,the demand for more accurate and visually pleasing images is increasing.However,the images captured by modern cameras are inevitably degraded by noise,which leads to deteriorated visual image quality.Therefore,work is required to reduce noise without losing image features(edges,corners,and other sharp structures).So far,researchers have already proposed various methods for decreasing noise.Each method has its own advantages and disadvantages.In this paper,we summarize some important research in the field of image denoising.First,we give the formulation of the image denoising problem,and then we present several image denoising techniques.In addition,we discuss the characteristics of these techniques.Finally,we provide several promising directions for future research.

A Hybrid CNN for Image Denoising

Deep convolutional neural networks(CNNs)with strong learning abilities have been used in the field of image denoising.However,some CNNs depend on a single deep network to train an image denoising model,which will have poor performance in complex screens.To address this problem,we propose a hybrid denoising CNN(HDCNN).HDCNN is composed of a dilated block(DB),RepVGG block(RVB),feature refinement block(FB),and a single convolution.DB combines a dilated convolution,batch normalization(BN),common convolutions,and activation function of ReLU to obtain more context information.RVB uses parallel combination of convolution,BN,and ReLU to extract complementary width features.FB is used to obtain more accurate information via refining obtained feature from the RVB.A single convolution collaborates a residual learning operation to construct a clean image.These key components make the HDCNN have good performance in image denoising.Experiment shows that the proposed HDCNN enjoys good denoising effect in public data sets.

Fault diagnosis method of rolling bearing based onthreshold denoising synchrosqueezing transform and CNN

The rolling bearing vibration signal is non-stationary and is easily disturbed by background noise,so it is difficult to accurately diagnose bearing faults.A fault diagnosis method of rolling bearing based on the time-frequency threshold denoising synchrosqueezing transform(TDSST)and convolutional neural network(CNN)is proposed.Since the traditional methods of wavelet threshold denoising and wavelet adjacent coefficient denoising are greatly affected by the estimation accuracy of noise variance,a time-frequency denoising method based on the STFT spectral correlation coefficient threshold optimization is adopted,which is combined with a synchrosqueezing transform.The ability of the TDSST to reduce noise and improve time-frequency resolution was verified by simulated impact fault signals of rolling bearings.Finally,the CNN is utilized to diagnose the time-frequency diagrams obtained by the TDSST.The diagnostic results of the rolling bearing experimental data show that the proposed method can effectively improve the accuracy of diagnosis.When the SNR of the bearing signal is larger than 0 dB,the accuracy is over 95%,even when the SNR reduces to-4 dB,the accuracy is still around 80%.Moreover,the standard deviation of multiple test results is small,which means that the method has good robustness.

Denoising Medical Images Using Deep Learning in IoT Environment

Medical Resonance Imaging(MRI)is a noninvasive,nonradioactive,and meticulous diagnostic modality capability in the field of medical imaging.However,the efficiency of MR image reconstruction is affected by its bulky image sets and slow process implementation.Therefore,to obtain a high-quality reconstructed image we presented a sparse aware noise removal technique that uses convolution neural network(SANR_CNN)for eliminating noise and improving the MR image reconstruction quality.The proposed noise removal or denoising technique adopts a fast CNN architecture that aids in training larger datasets with improved quality,and SARN algorithm is used for building a dictionary learning technique for denoising large image datasets.The proposed SANR_CNN model also preserves the details and edges in the image during reconstruction.An experiment was conducted to analyze the performance of SANR_CNN in a few existing models in regard with peak signal-to-noise ratio(PSNR),structural similarity index(SSIM),and mean squared error(MSE).The proposed SANR_CNN model achieved higher PSNR,SSIM,and MSE efficiency than the other noise removal techniques.The proposed architecture also provides transmission of these denoised medical images through secured IoT architecture.

Image Denoising with GAN Based Model

Image denoising is often used as a preprocessing step in computer vision tasks,which can help improve the accuracy of image processing models.Due to the imperfection of imaging systems,transmission media and recording equipment,digital images are often contaminated with various noises during their formation,which troubles the visual effects and even hinders people’s normal recognition.The pollution of noise directly affects the processing of image edge detection,feature extraction,pattern recognition,etc.,making it difficult for people to break through the bottleneck by modifying the model.Many traditional filtering methods have shown poor performance since they do not have optimal expression and adaptation for specific images.Meanwhile,deep learning technology opens up new possibilities for image denoising.In this paper,we propose a novel neural network which is based on generative adversarial networks for image denoising.Inspired by U-net,our method employs a novel symmetrical encoder-decoder based generator network.The encoder adopts convolutional neural networks to extract features,while the decoder outputs the noise in the images by deconvolutional neural networks.Specially,shortcuts are added between designated layers,which can preserve image texture details and prevent gradient explosions.Besides,in order to improve the training stability of the model,we add Wasserstein distance in loss function as an optimization.We use the peak signal-to-noise ratio(PSNR)to evaluate our model and we can prove the effectiveness of it with experimental results.When compared to the state-of-the-art approaches,our method presents competitive performance.

基于迁移学习的气体泄漏红外图像去噪方法

非制冷型红外相机由于其成本低、寿命长、性能稳定等优势在气体泄漏检测领域有着广泛应用,而良好的图像去噪算法可以有效提升其检测灵敏度与准确性。结合深度学习和迁移学习技术,提出了一种基于深度迁移学习的气体泄漏红外图像去噪方法。首先使用静止场景数据集对卷积神经网络模型进行训练,然后固定部分模型参数,并通过仿真气体数据集对模型再次训练,最终获得适用于气体泄漏红外图像去噪的模型。实验结果表明,该方法可以对非制冷型红外相机拍摄的气体红外图像进行去噪,去噪后的图像具有明显的气体轮廓信息,同时可以分辨出泄漏源的位置。因此,该方法可以帮助非制冷型红外相机更好地完成气体泄漏检测任务。

改进卷积神经网络的医学图像感兴趣区域识别

图像中的噪声会提高图像特征信息提取难度,影响图像识别时的细节保留效果,为此提出改进卷积神经网络的医学图像感兴趣区域识别方法。分析医学图像主要噪声来源,构建噪声模型,利用非局部均值滤波算法计算图像全部像素的加权平均值,完成图像去噪处理;通过图像求反、对比度增加和灰度调节等操作增强图像细节信息;利用局部区域特征提取方法获取图像基础纹理特征,包括灰度、平滑度与熵值等;建立具有卷积层、池化层、全连接层的卷积神经网络模型,引入区域建议网络对其改进,通过该网络确定识别的候选区域,将图像特征作为网络输入,经过不断学习迭代,输出最终感兴趣区域。实验结果表明,所提方法在提高图像质量的基础上,识别出的感兴趣区域较为完整,包含的有用信息更多。

基于数字孪生的建筑物顶升施工安全监控技术

研究基于数字孪生的建筑物顶升施工安全监控技术,能有效监控建筑物顶升施工,确保建筑物顶升施工安全稳定进行。构建基于数字孪生的建筑物顶升施工安全监控技术架构,并从几何、物理、行为、规则4个层面入手,按建筑物顶升施工现场真实施工过程,构建相应的数字孪生虚拟模型,实现建筑物顶升施工物理模型及数字孪生虚拟模型间的实时交互,并把二者所产生的数据,同步发送到云端,生成数字孪生数据平台,由数字孪生数据平台对所获数据实施分类处理,最终在机器学习驱动模块,通过构建基于卷积神经网络的建筑物顶升施工安全监测模型,经数据去噪与输入、模型训练等操作,输出建筑物顶升施工安全监测结果,并通过数字孪生虚拟方式视觉呈现所获结果。实验结果表明:该技术能够实现建筑物顶升施工安全监控,监控后效果较好,在较少epoch次数下,便可收获较为理想的顶升施工安全监测结果。

基于卷积特征提取及深度降噪网络的大规模MIMO系统信号检测

传统多输入多输出(Multiple-Input Multiple-Output,MIMO)信号检测算法受到天线数量和收发天线比例的限制,一般仅适用于少量天线、收发天线比例较低的情况。本文提出一种基于深度学习(Deep Learning,DL)的稀疏连接卷积降噪网络模型,用于大规模MIMO系统上行链路信号检测。首先,通过简化经典的检测网络(Detection Network,DetNet),改进ScNet(Sparsely Connected Neural Network)检测算法,引入卷积神经网络(Convolutional NeuralNetworks,CNN)对三通道输入数据提取特征以减少训练参数,提出一种SConv(SparselyConnected Convolutional Neural Network)检测算法。与DetNet算法相比,该算法可同时降低计算复杂度和提高检测精度。在此基础上,进一步基于CNN构建信号降噪模块,并嵌入SConv网络,提出一种卷积神经降噪(Sparsely Connected Convolutional Denoising,SConv-D)网络辅助的大规模MIMO检测算法。此算法检测过程分为两级,第一级由SConv算法提供初始估计值,再将初始估计值作为降噪过程的输入,并由此构成算法第二级。实验结果表明,本文提出的SConv-D算法适用于QPSK、4QAM及16QAM等多种信号调制模式,在高阶调制模式下获得的性能增益尤为明显。此外,该算法能够适应各种比例的收发天线及数量规模的系统配置,尤其是在收发天线数量相等的情况下亦能获得更优的性能。本文算法还克服了MMNet在高阶调制情况下的性能平台效应,在16QAM调制、收发天线数量相等的情况下,SConv-D在10^(-2)误比特率上能获得接近2 dB的性能增益。

基于残差密集块的激光遥感图像中目标检测方法

为了提高对目标检测的效果,提出基于残差密集块的激光遥感图像中目标检测方法。首先,设计基于残差密集块的卷积神经网络,在设计ReLU激活函数并完成网络训练后,基于含噪激光遥感图像的初步特征提取结果,利用单个卷积展开卷积映射处理,抽取出潜在干净图像。然后,通过聚类处理的方式,得到激光遥感图像中车辆目标的显著图,再利用大律法,通过建立的特征比例关系的方式检测出其中的目标信息。实验结果表明,应用该方法有效滤除激光遥感图像中的噪声,并精准检测出激光遥感图像中的车辆目标。相比于3种传统方法,该方法检测结果均值误差的最小值仅为0.0156,说明该方法有效实现了设计预期。

基于纹理先验的扩张残差注意力相似性去噪网络

目前,大多数基于卷积神经网络的图像去噪模型不能充分利用图像数据的冗余性,这限制了模型的表达能力。而且,为了有效去噪,往往将边缘信息用作先验知识,而纹理信息通常被忽略。针对这些问题,提出一种新的图像去噪网络,该网络首先使用注意力相似性模块提取图像的全局相似性特征,通过平均池化来平滑和抑制注意力相似性模块中的噪声,以进一步提高网络性能;其次使用扩张残差模块来提取图像的局部和全局特征;最后使用全局残差学习增强网络从浅层到深层的去噪效果。此外,还设计一种纹理提取网络从噪声图像中提取局部二值模式以获取纹理信息,利用纹理信息作为先验知识,可在去噪过程中保留演化图像中的细节。实验结果表明,与一些先进的去噪网络相比,新提出的去噪网络在图像视觉上有很大改善、效率更高且峰值信噪比提高了2 dB左右,结构相似性提高了3%左右,更有利于实际应用。