Rockburst Intensity Grade Prediction Model Based on Batch Gradient Descent and Multi-Scale Residual Deep Neural Network

Rockburst is a phenomenon in which free surfaces are formed during excavation,which subsequently causes the sudden release of energy in the construction of mines and tunnels.Light rockburst only peels off rock slices without ejection,while severe rockburst causes casualties and property loss.The frequency and degree of rockburst damage increases with the excavation depth.Moreover,rockburst is the leading engineering geological hazard in the excavation process,and thus the prediction of its intensity grade is of great significance to the development of geotechnical engineering.Therefore,the prediction of rockburst intensity grade is one problem that needs to be solved urgently.By comprehensively considering the occurrence mechanism of rockburst,this paper selects the stress index(σθ/σc),brittleness index(σ_(c)/σ_(t)),and rock elastic energy index(Wet)as the rockburst evaluation indexes through the Spearman coefficient method.This overcomes the low accuracy problem of a single evaluation index prediction method.Following this,the BGD-MSR-DNN rockburst intensity grade prediction model based on batch gradient descent and a multi-scale residual deep neural network is proposed.The batch gradient descent(BGD)module is used to replace the gradient descent algorithm,which effectively improves the efficiency of the network and reduces the model training time.Moreover,the multi-scale residual(MSR)module solves the problem of network degradation when there are too many hidden layers of the deep neural network(DNN),thus improving the model prediction accuracy.The experimental results reveal the BGDMSR-DNN model accuracy to reach 97.1%,outperforming other comparable models.Finally,actual projects such as Qinling Tunnel and Daxiangling Tunnel,reached an accuracy of 100%.The model can be applied in mines and tunnel engineering to realize the accurate and rapid prediction of rockburst intensity grade.

Ash Detection of Coal Slime Flotation Tailings Based on Chromatographic Filter Paper Sampling and Multi-Scale Residual Network

The detection of ash content in coal slime flotation tailings using deep learning can be hindered by various factors such as foam,impurities,and changing lighting conditions that disrupt the collection of tailings images.To address this challenge,we present a method for ash content detection in coal slime flotation tailings.This method utilizes chromatographic filter paper sampling and a multi-scale residual network,which we refer to as MRCN.Initially,tailings are sampled using chromatographic filter paper to obtain static tailings images,effectively isolating interference factors at the flotation site.Subsequently,the MRCN,consisting of a multi-scale residual network,is employed to extract image features and compute ash content.Within the MRCN structure,tailings images undergo convolution operations through two parallel branches that utilize convolution kernels of different sizes,enabling the extraction of image features at various scales and capturing a more comprehensive representation of the ash content information.Furthermore,a channel attention mechanism is integrated to enhance the performance of the model.The combination of the multi-scale residual structure and the channel attention mechanism within MRCN results in robust capabilities for image feature extraction and ash content detection.Comparative experiments demonstrate that this proposed approach,based on chromatographic filter paper sampling and the multi-scale residual network,exhibits significantly superior performance in the detection of ash content in coal slime flotation tailings.

Abnormal Traffic Detection for Internet of Things Based on an Improved Residual Network

Along with the progression of Internet of Things(IoT)technology,network terminals are becoming continuously more intelligent.IoT has been widely applied in various scenarios,including urban infrastructure,transportation,industry,personal life,and other socio-economic fields.The introduction of deep learning has brought new security challenges,like an increment in abnormal traffic,which threatens network security.Insufficient feature extraction leads to less accurate classification results.In abnormal traffic detection,the data of network traffic is high-dimensional and complex.This data not only increases the computational burden of model training but also makes information extraction more difficult.To address these issues,this paper proposes an MD-MRD-ResNeXt model for abnormal network traffic detection.To fully utilize the multi-scale information in network traffic,a Multi-scale Dilated feature extraction(MD)block is introduced.This module can effectively understand and process information at various scales and uses dilated convolution technology to significantly broaden the model’s receptive field.The proposed Max-feature-map Residual with Dual-channel pooling(MRD)block integrates the maximum feature map with the residual block.This module ensures the model focuses on key information,thereby optimizing computational efficiency and reducing unnecessary information redundancy.Experimental results show that compared to the latest methods,the proposed abnormal traffic detection model improves accuracy by about 2%.

Underwater Image Enhancement Based on Multi-scale Adversarial Network

In this study,an underwater image enhancement method based on multi-scale adversarial network was proposed to solve the problem of detail blur and color distortion in underwater images.Firstly,the local features of each layer were enhanced into the global features by the proposed residual dense block,which ensured that the generated images retain more details.Secondly,a multi-scale structure was adopted to extract multi-scale semantic features of the original images.Finally,the features obtained from the dual channels were fused by an adaptive fusion module to further optimize the features.The discriminant network adopted the structure of the Markov discriminator.In addition,by constructing mean square error,structural similarity,and perceived color loss function,the generated image is consistent with the reference image in structure,color,and content.The experimental results showed that the enhanced underwater image deblurring effect of the proposed algorithm was good and the problem of underwater image color bias was effectively improved.In both subjective and objective evaluation indexes,the experimental results of the proposed algorithm are better than those of the comparison algorithm.

Chinese named entity recognition with multi-network fusion of multi-scale lexical information

Named entity recognition(NER)is an important part in knowledge extraction and one of the main tasks in constructing knowledge graphs.In today’s Chinese named entity recognition(CNER)task,the BERT-BiLSTM-CRF model is widely used and often yields notable results.However,recognizing each entity with high accuracy remains challenging.Many entities do not appear as single words but as part of complex phrases,making it difficult to achieve accurate recognition using word embedding information alone because the intricate lexical structure often impacts the performance.To address this issue,we propose an improved Bidirectional Encoder Representations from Transformers(BERT)character word conditional random field(CRF)(BCWC)model.It incorporates a pre-trained word embedding model using the skip-gram with negative sampling(SGNS)method,alongside traditional BERT embeddings.By comparing datasets with different word segmentation tools,we obtain enhanced word embedding features for segmented data.These features are then processed using the multi-scale convolution and iterated dilated convolutional neural networks(IDCNNs)with varying expansion rates to capture features at multiple scales and extract diverse contextual information.Additionally,a multi-attention mechanism is employed to fuse word and character embeddings.Finally,CRFs are applied to learn sequence constraints and optimize entity label annotations.A series of experiments are conducted on three public datasets,demonstrating that the proposed method outperforms the recent advanced baselines.BCWC is capable to address the challenge of recognizing complex entities by combining character-level and word-level embedding information,thereby improving the accuracy of CNER.Such a model is potential to the applications of more precise knowledge extraction such as knowledge graph construction and information retrieval,particularly in domain-specific natural language processing tasks that require high entity recognition precision.

Disease Recognition of Apple Leaf Using Lightweight Multi-Scale Network with ECANet

To solve the problem of difficulty in identifying apple diseases in the natural environment and the low application rate of deep learning recognition networks,a lightweight ResNet(LW-ResNet)model for apple disease recognition is proposed.Based on the deep residual network(ResNet18),the multi-scale feature extraction layer is constructed by group convolution to realize the compression model and improve the extraction ability of different sizes of lesion features.By improving the identity mapping structure to reduce information loss.By introducing the efficient channel attention module(ECANet)to suppress noise from a complex background.The experimental results show that the average precision,recall and F1-score of the LW-ResNet on the test set are 97.80%,97.92%and 97.85%,respectively.The parameter memory is 2.32 MB,which is 94%less than that of ResNet18.Compared with the classic lightweight networks SqueezeNet and MobileNetV2,LW-ResNet has obvious advantages in recognition performance,speed,parameter memory requirement and time complexity.The proposed model has the advantages of low computational cost,low storage cost,strong real-time performance,high identification accuracy,and strong practicability,which can meet the needs of real-time identification task of apple leaf disease on resource-constrained devices.

基于双通道Residual-LSTM的SINS/GNSS组合导航算法

针对全球导航卫星系统信号中断情况下SINS/GNSS组合导航系统无法持续进行误差校正的问题,提出一种基于双通道Residual-LSTM的SINS/GNSS组合导航算法。首先,考虑到SINS经度、纬度误差传播特性不同所导致的模型输入、输出信息之间的非线性相关性差异化,构建具有不同权重系数的双通道长短期记忆神经网络模型结构,并引入遗忘信息共享机制自适应地利用历史导航数据对经度、纬度信息进行拟合预测。其次,针对深层神经网络存在的模型退化和梯度消失问题,在多层双通道LSTM网络之间建立残差高速通道形成Residual-LSTM模型结构,以增加不同网络层次之间的信息传播路径。最后,通过实船数据验证本文所提算法的有效性。实验结果表明,与基于常规智能方法的SINS/GNSS组合导航算法相比,所提组合导航算法在GNSS信号中断期间经度误差降低了51.97%,纬度误差降低了31.45%。

基于多数据融合的短时交通流量预测算法研究

针对单一模型无法分析复杂、非线性交通流数据的问题,在多平台数据融合的基础上提出了一种面向短时交通流量的组合预测算法。对于交通流数据具备的时间性和空间性特征,首先使用径向基函数(RBF)神经网络对相邻节点的空间交通流数据进行分析,然后利用ResNet对RBF神经网络效率低的缺陷加以改进,最后通过双向长短期记忆(LSTM)网络的时间序列分析能力提取交通流数据的时间特征。同时,引入了萤火虫算法对时空模型的参数进行优化。对基于公共数据集获取到的车辆、天气、高速公路等多平台信息进行了试验。相较于对比算法,所提算法的均方根误差(RMSE)、平均绝对误差(MAE)和平均绝对百分比误差(MAPE)指标均最优,预测值与实际流量值最接近。该算法的综合性能较理想,且鲁棒性较强。

Behavior recognition algorithm based on the improved R3D and LSTM network fusion

Because behavior recognition is based on video frame sequences,this paper proposes a behavior recognition algorithm that combines 3D residual convolutional neural network(R3D)and long short-term memory(LSTM).First,the residual module is extended to three dimensions,which can extract features in the time and space domain at the same time.Second,by changing the size of the pooling layer window the integrity of the time domain features is preserved,at the same time,in order to overcome the difficulty of network training and over-fitting problems,the batch normalization(BN)layer and the dropout layer are added.After that,because the global average pooling layer(GAP)is affected by the size of the feature map,the network cannot be further deepened,so the convolution layer and maxpool layer are added to the R3D network.Finally,because LSTM has the ability to memorize information and can extract more abstract timing features,the LSTM network is introduced into the R3D network.Experimental results show that the R3D+LSTM network achieves 91%recognition rate on the UCF-101 dataset.

基于ResNet-LSTM的航空发动机性能异常检测方法

为了实现数据驱动的航空发动机性能异常的智能检测,提出了一种基于残差网络(ResNet)-长短期记忆网络(LSTM)的发动机性能异常检测方法。采用发动机性能数据图像化方法,在数据降维的同时,完备保留数据的关联特征和时序特征;以残差单元构建发动机性能异常检测模型,在加深网络结构的同时,消除深层网络梯度消失问题,提高发动机性能图像空间关联特征的提取能力。同时,引入LSTM,提出基于ResNet-LSTM的发动机性能异常检测模型,通过ResNet与LSTM的融合,强化异常检测模型对时序特征的提取,提升发动机性能异常检测的准确率;通过发动机运行数据进行验证。结果表明:在训练集上,该方法的异常检测准确率为94.95%,比基于ResNet18、ResNet34、ResNet50异常检测模型的分别提高10.87%、8.00%、3.23%;在测试集上,该方法的异常检测准确率为92.15%,比基于ResNet18、ResNet34、ResNet50异常检测模型的分别提高11.81%、9.45%、3.78%。

基于MRSDAE-KPCA结合Bi-LST的滚动轴承剩余使用寿命预测

针对现有滚动轴承剩余使用寿命预测方法在提取数据特征时没有充分考虑数据的内部分布,且在构建健康因子时还需要专家经验进行人工提取等问题,提出一种基于流形正则化堆栈去噪自编码器、核主成分分析并结合双向长短时记忆网络的滚动轴承剩余使用寿命预测方法。首先采用无监督的堆栈去噪自编码器网络对原始振动数据进行深层特征提取,并使用核主成分分析法进一步降维,以提高健康因子的指标稳定性;然后在堆栈去噪自编码器中加入流形正则化,最大程度保留编码器隐藏层内部的数据分布结构,提高模型提取数据特征的有效性。最后使用双向长短时记忆网络预测轴承的剩余使用寿命,并采用AdaMax优化算法对网络模型的超参数进行自适应寻优。分析结果表明,提出的滚动轴承剩余使用寿命预测方法具有更高的精度。

GNSS拒止时基于并行CNN-BiLSTM回归和残差补偿的UAV导航误差校正方法

全球导航卫星系统(GNSS)拒止时,GNSS/惯性导航系统(INS)组合导航系统的性能严重下降,导致无人机集群导航误差快速发散.目前,利用神经网络预测位置与速度代替GNSS导航信息可校正无人机INS误差,但该方法仍存在定位误差较高且在轨迹突变时预测精度急剧下降的问题.因此,提出了一种基于卷积-双向长短时记忆网络联合残差补偿的位置与速度预测方法,用于提高位置与速度预测精度.首先,针对GNSS拒止后GNSS/INS组合导航系统定位误差较高的问题,提出卷积神经网络(CNN)与双向长短时记忆网络(BiLSTM)的融合模型,该模型可建立惯性测量单元(IMU)动力学测量数据与GNSS导航信息之间的关系,实现较准确的位置和速度预测.其次,针对轨迹突变时预测效果急剧下降的问题,提出并行CNNBiLSTM回归架构,在预测位置与速度的同时,挖掘IMU动力学测量数据、预测值与预测残差之间的关系,预测并补偿预测残差,增强模型在轨迹突变时的预测精度.仿真结果表明,所提模型在预测准确性、有效性和稳定性方面都优于CNN-LSTM、LSTM网络模型.

基于ARIMA-LSTM模型的卷烟制丝质量预测研究

为了应对卷烟制丝工艺中的不确定性所带来的质量风险,提出了一种将差分移动平均自回归(ARIMA)模型与深度学习中的长短期记忆单元(LSTM)模型相结合的制丝质量数据预测方法,并用该方法对某卷烟企业制丝工艺中的加热处理(HT)出口温度和叶丝增温增湿的入口水分进行预测,以均方根误差(RMSE)、平均绝对误差(MAE)和平均绝对百分比误差(MAPE)为指标来评估各模型的预测精度。结果表明,相较于单一ARIMA和LSTM模型,所提出的ARIMA-LSTM组合模型的预测值更精准,在对HT出口温度进行预测时,组合模型的RMSE、MAE、MAPE值分别至少降低了60.1%、63.1%和63%;在对叶丝增温增湿的入口水分进行预测时,组合模型的RMSE、MAE、MAPE值分别至少降低了49.5%、49.4%和49.3%,有望为卷烟企业及时制定或调整生产方案提供合理的参考依据。

基于层叠式残差LSTM网络的桥梁非线性地震响应预测

提出了一种基于层叠式残差长短时记忆神经网络(residual long short-term memory neural network,ResLSTM)的数据驱动建模方法,实现桥梁非线性地震响应预测。该方法利用长短时记忆(long short-term memory, LSTM)网络在长序列回归中的优势,并采用残差连接结构降低深度神经网络中的梯度回传难度,提高了有限数据下的深度网络预测性能。同时,通过采用层叠式序列结构,降低深度神经网络隐藏层节点数目,进一步提升深度神经网络的预测精度。随后,通过两跨预应力混凝土连续梁桥与组合梁斜拉桥的数值算例对该方法进行验证。神经网络的训练样本与测试样本均源自桥梁有限元模型的增量动力分析结果。此外,采用该方法成功预测了美国Meloland Overpass桥的地震响应,并与历史监测数据进行对比验证。结果表明:ResLSTM网络是一种鲁棒性良好、计算效率高的非线性地震响应预测方法,能够利用少量数据快速准确地预测桥梁结构在地震作用下的动力响应,在桥梁抗震性能评价中具有重要的应用潜力。

基于时空Inception残差注意力网络的脑电情绪识别

为了提高脑电情绪识别分类精度,最大限度利用脑电信号的空间和时间信息,提出一种Inception残差注意力卷积神经网络与双向长短期记忆(bi-directional long short-term memory, BiLSTM)网络相结合的新型架构时空Inception残差注意力网络。将脑电信号采集电极位置映射到二维矩阵中,采集信号作为通道,构成三维数据;将得到的三维数据输入到时空Inception残差注意力卷积网络之中,提取时空信息;将得到的特征输入到全连接层进行分类;将Inception结构引入脑电情绪识别领域,实现多尺度特征提取,并将电极映射到矩阵之中,保留电极位置信息,使用时空Inception残差注意力网络从时空两个维度获取脑电相关信息。实验表明,使用该模型对DEAP数据集进行情绪四分类可得到93.71%的准确度,相较于对比模型,识别精度提高了10%~20%。提出的模型在脑电信号情绪识别领域具有优良性能。

基于残差神经网络、双向长短期记忆网络和注意力机制的肠鸣音检测方法研究

肠鸣音可以反映胃肠道的运动和健康状况,然而,传统的人工听诊方式存在主观性偏差且耗时耗力。为了更好地辅助医生对肠鸣音的诊断,提高肠鸣音检测的可靠性和高效性,该研究提出了一种结合残差神经网络(ResNet)、双向长短期记忆网络(BiLSTM)和注意力机制的深度神经网络模型。首先使用自主研发的多通道肠鸣音采集系统采集了大量带标签的临床数据,采用多尺度小波分解和重构方法对肠鸣音信号进行预处理,然后提取对数梅尔谱图特征送入网络进行训练,最后通过10折交叉验证和消融实验来评估模型的性能和验证其有效性。实验结果表明,该模型在精确率、召回率和F1分数方面分别达到了83%、76%和79%,能够有效地检测出肠鸣音片段并定位其起止时间,表现优于以往的算法。该算法不仅可以为医生在临床实践中提供辅助信息,还为肠鸣音的进一步分析和研究提供了技术支撑。

基于LSTM人工神经网络的电力系统负荷预测方法

针对电力市场环境下短期电力系统负荷预测准确性较低的问题,提出了一种基于LSTM人工神经网络的组合预测模型。分析了LSTM神经网络和其变体GRU神经网络在进行负荷预测时学习时序特征的独特优势,并以卷积神经网络作为负荷数据的特征提取层,结合GRU网络构建了组合模型,通过建立残差预测模型对结果进行修正。仿真结果表明,具有记忆功能的神经网络预测效果要优于ANN和SVM模型,且所提出残差预测模型的负荷预测平均相对误差约为1.79%,其准确性高于单一算法的负荷预测模型。

基于DRSN-CW-LSTM网络的锂电池荷电状态预测

由于电池荷电状态(state of charge,SOC)无法直接测量,且传统的SOC估算方法精度低。为了提升锂离子电池SOC估算精度,对比了不同深度学习网络模型应用于SOC估算的效果,并提出了一种基于DRSN-CW-LSTM网络的锂离子电池SOC估算方法。该方法基于长短期记忆网络(long-short-term memory,LSTM)和逐通道不同阈值的深度残差收缩网络(deep residual shrinkage networks with channel-wise thresholds,DRSN-CW),利用锂离子电池电压、电流、温度、容量等数据信息在深度残差收缩网路中进行特征提取,通过LSTM进一步拟合时间序列数据趋势,实现锂离子电池在使用周期内SOC的预测。在DRSN-CW网络的残差收缩模块中可以实现自适应噪声数据处理功能,消除锂离子电池数据流质量对SOC预测的负面影响。利用锂电池公共数据集训练所提出的网络,对比了3种神经网络模型在该两组数据集上的预测效果。实验结果表明,所提出的深度学习模型在两组公开数据集上的MAE和RMSE均值都控制在5%以内,相比其他3种深度学习模型有更好的抗噪性能和预测性能,且估算精度高。

基于CNN-BiLSTM和残差注意力的县域水稻产量预测模型

提出一种融合卷积神经网络(CNN)、双向长短期记忆网络(BiLSTM)和残差注意力(RA)机制的县域水稻产量预测模型(CNN-BiLSTM-RA),通过CNN层有效提取县域水稻气象数据中的关键空间特征,利用BiLSTM层深入分析时间序列数据的动态变化,引入RA机制强化对气象数据中关键特征的识别与捕捉,以2015—2017年广西81个县早稻历史产量和气象数据为样本,与CNN、TRANSFORMER、BiLSTM、CNN-BiLSTM、BiLSTM-RA模型进行对比,评价CNN-BiLSTM-RA模型的预测精度和有效性。结果表明,CNN-BiLSTM-RA模型的R~2、MAE、RMSE和MAPE分别为0.9861、0.1219、0.2248、0.8648,模型的预测值与实际值拟合程度较高。CNN-BiLSTM-RA模型充分发挥了CNN的空间特征提取能力、BiLSTM的时间序列数据分析优势和RA机制在增强关键特征捕捉方面的特性,是一种适用于县域水稻产量高精度预测的新方法。

基于改进SE-ResNet-BiLSTM的航空发动机中介轴承故障诊断

针对现阶段航空发动机中介轴承振动信号易受噪声干扰,故障特征难提取导致的故障诊断精度较低的问题,提出一种基于改进残差注意力网络和双向长短期记忆神经网络(BiLSTM)的航空发动机中介轴承故障诊断方法。首先,将原始振动信号作为模型输入,利用一维宽卷积从原始数据中提取局部空间特征并抑制高频噪声;然后,使用结合改进通道注意力的残差网络增强模型对重要特征的关注,减少模型运算量,将处理后的特征输入到BiLSTM中,进一步提取时序相关性特征;最后,将特征输入到Softmax层进行故障分类。使用哈工大航空发动机中介轴承数据集进行实验验证,结果表明,即使在信噪比为-4 dB的高噪声环境,所提模型仍能保持98.64%的诊断精度,优于其他对比模型,证明该模型具有更好的特征提取能力和抗噪性。