Progress in Mechanical Modeling of Implantable Flexible Neural Probes

Implanted neural probes can detect weak discharges of neurons in the brain by piercing soft brain tissue,thus as important tools for brain science research,as well as diagnosis and treatment of brain diseases.However,the rigid neural probes,such as Utah arrays,Michigan probes,and metal microfilament electrodes,are mechanically unmatched with brain tissue and are prone to rejection and glial scarring after implantation,which leads to a significant degradation in the signal quality with the implantation time.In recent years,flexible neural electrodes are rapidly developed with less damage to biological tissues,excellent biocompatibility,and mechanical compliance to alleviate scarring.Among them,the mechanical modeling is important for the optimization of the structure and the implantation process.In this review,the theoretical calculation of the flexible neural probes is firstly summarized with the processes of buckling,insertion,and relative interaction with soft brain tissue for flexible probes from outside to inside.Then,the corresponding mechanical simulation methods are organized considering multiple impact factors to realize minimally invasive implantation.Finally,the technical difficulties and future trends of mechanical modeling are discussed for the next-generation flexible neural probes,which is critical to realize low-invasiveness and long-term coexistence in vivo.

Hybrid model for BOF oxygen blowing time prediction based on oxygen balance mechanism and deep neural network

The amount of oxygen blown into the converter is one of the key parameters for the control of the converter blowing process,which directly affects the tap-to-tap time of converter. In this study, a hybrid model based on oxygen balance mechanism (OBM) and deep neural network (DNN) was established for predicting oxygen blowing time in converter. A three-step method was utilized in the hybrid model. First, the oxygen consumption volume was predicted by the OBM model and DNN model, respectively. Second, a more accurate oxygen consumption volume was obtained by integrating the OBM model and DNN model. Finally, the converter oxygen blowing time was calculated according to the oxygen consumption volume and the oxygen supply intensity of each heat. The proposed hybrid model was verified using the actual data collected from an integrated steel plant in China, and compared with multiple linear regression model, OBM model, and neural network model including extreme learning machine, back propagation neural network, and DNN. The test results indicate that the hybrid model with a network structure of 3 hidden layer layers, 32-16-8 neurons per hidden layer, and 0.1 learning rate has the best prediction accuracy and stronger generalization ability compared with other models. The predicted hit ratio of oxygen consumption volume within the error±300 m^(3)is 96.67%;determination coefficient (R^(2)) and root mean square error (RMSE) are0.6984 and 150.03 m^(3), respectively. The oxygen blow time prediction hit ratio within the error±0.6 min is 89.50%;R2and RMSE are0.9486 and 0.3592 min, respectively. As a result, the proposed model can effectively predict the oxygen consumption volume and oxygen blowing time in the converter.

Review of Artificial Intelligence for Oil and Gas Exploration: Convolutional Neural Network Approaches and the U-Net 3D Model

Deep learning, especially through convolutional neural networks (CNN) such as the U-Net 3D model, has revolutionized fault identification from seismic data, representing a significant leap over traditional methods. Our review traces the evolution of CNN, emphasizing the adaptation and capabilities of the U-Net 3D model in automating seismic fault delineation with unprecedented accuracy. We find: 1) The transition from basic neural networks to sophisticated CNN has enabled remarkable advancements in image recognition, which are directly applicable to analyzing seismic data. The U-Net 3D model, with its innovative architecture, exemplifies this progress by providing a method for detailed and accurate fault detection with reduced manual interpretation bias. 2) The U-Net 3D model has demonstrated its superiority over traditional fault identification methods in several key areas: it has enhanced interpretation accuracy, increased operational efficiency, and reduced the subjectivity of manual methods. 3) Despite these achievements, challenges such as the need for effective data preprocessing, acquisition of high-quality annotated datasets, and achieving model generalization across different geological conditions remain. Future research should therefore focus on developing more complex network architectures and innovative training strategies to refine fault identification performance further. Our findings confirm the transformative potential of deep learning, particularly CNN like the U-Net 3D model, in geosciences, advocating for its broader integration to revolutionize geological exploration and seismic analysis.

Stock Price Prediction Based on the Bi-GRU-Attention Model

The stock market, as one of the hotspots in the financial field, forms a data system with a huge volume of data and complex relationships between various factors, making stock price prediction an area of keen interest for further in-depth mining and research. Mathematical statistics methods struggle to deal with nonlinear relationships in practical applications, making it difficult to explore deep information about stocks. Meanwhile, machine learning methods, particularly neural network models and composite models, which have achieved outstanding results in other fields, are being applied to the stock market with significant results. However, researchers have found that these methods do not grasp the essential information of the data as well as expected. In response to these issues, researchers are exploring better neural network models and combining them with other methods to analyze stock data. Thus, this paper proposes the ABiGRU composite model, which combines the attention mechanism and bidirectional gated recurrent unit (GRU) that can effectively extract data features for stock price prediction research. Models such as LSTM, GRU, and Bi-LSTM are selected for comparative experiments. To ensure the credibility and representativeness of the research data, daily stock price indices of BYD are chosen for closing price prediction studies across different models. The results show that the ABiGRU model has a lower prediction error and better fitting effect on three index-based stock prices, enhancing the learning efficiency of the neural network model and demonstrating good prediction stability. This suggests that the ABiGRU model is highly adaptable for stock price prediction.

Vulnerability Detection of Ethereum Smart Contract Based on SolBERT-BiGRU-Attention Hybrid Neural Model

In recent years,with the great success of pre-trained language models,the pre-trained BERT model has been gradually applied to the field of source code understanding.However,the time cost of training a language model from zero is very high,and how to transfer the pre-trained language model to the field of smart contract vulnerability detection is a hot research direction at present.In this paper,we propose a hybrid model to detect common vulnerabilities in smart contracts based on a lightweight pre-trained languagemodel BERT and connected to a bidirectional gate recurrent unitmodel.The downstream neural network adopts the bidirectional gate recurrent unit neural network model with a hierarchical attention mechanism to mine more semantic features contained in the source code of smart contracts by using their characteristics.Our experiments show that our proposed hybrid neural network model SolBERT-BiGRU-Attention is fitted by a large number of data samples with smart contract vulnerabilities,and it is found that compared with the existing methods,the accuracy of our model can reach 93.85%,and the Micro-F1 Score is 94.02%.

基于CNN-GRU-ISSA-XGBoost的短期光伏功率预测

针对光伏功率随机性及波动性大,单一预测模型往往难以准确分析历史数据波动规律,从而导致预测精度不高的问题,提出一种基于卷积神经网络-门控循环单元(CNN-GRU)和改进麻雀搜索算法(ISSA)优化的极限梯度提升(XGBoost)模型的短期光伏功率预测组合模型.首先去除历史数据中的异常值并对其进行归一化处理,利用主成分分析法(PCA)进行特征选取,以便更好地识别影响光伏功率的关键因素.然后采用CNN网络提取数据的空间特征,再经过GRU网络提取时间特征,针对XGBoost模型手动配置参数困难、随机性大的问题,利用ISSA对模型超参数寻优.最后对两种方法预测的结果用误差倒数法减小误差的同时对权重进行更新,得到新的预测值,从而完成对光伏功率的预测.实验结果表明,所提出的CNN-GRU-ISSA-XGBoost组合模型具有更强的适应性和更高的精度.

基于CEEMDAN-GRU组合模型的碳排放交易价格预测研究

准确的碳价格预测有助于监管部门观测碳交易市场运行状况及投资者进行科学决策,对实现碳达峰和碳中和具有重要作用。但碳价序列具有非线性、非平稳性和高噪声的特性,很难对其进行准确预测。将完全自适应噪声集合经验模态分解(CEEMDAN)方法与门控循环单元(GRU)相结合,构建一个碳排放交易价格预测模型。该模型基于分解、集成思想,利用CEEMDAN将原始碳价序列分解,获得不同频率的本征模函数(IMF)和残差序列,使用GRU神经网络分别为各子序列建立预测模型,最后集成预测结果得到碳价预测值。以湖北省碳交易市场的日度成交价为例进行实证分析,结果表明:相较于其他5种基准模型,CEEMDAN-GRU模型具有更小的预测误差和更高的拟合优度,在碳价格预测上具有一定的优势。

基于迁移学习与GRU神经网络结合的锂电池SOH估计

为解决退役电池梯次利用过程中单体剩余使用寿命估计困难、测试流程复杂与能耗高等问题,提出迁移学习与GRU网络结合的锂离子电池健康状态估计方法;设计的基础模型结构为输入层+GRU层+全连接层+输出层;根据健康因子的得分,选择训练基础模型的数据集、划分电池相似度等级并制定对应的迁移学习策略。实验结果表明:与其他模型相比,分别使用数据集的前40%与前25%训练得到的基础模型与迁移学习模型,两者的精度分别最大提高42.48%与95.28%,而预测稳定性分别最大提高55.38%与93.55%。

基于小波分解和ARIMA-GARCH-GRU组合模型的制造业PMI预测

制造业采购经理人指数(PMI)是反映国家经济运行情况的重要指标,而传统预测模型对该类时序数据预测精度不高。针对制造业PMI指数的非线性、波动性和数据量少的特点,提出一种基于一维离散小波变换进行数据预处理的组合模型。时序数据经过小波变换,由整合移动平均自回归–广义自回归条件异方差模型(ARIMA-GARCH)处理稳态低频数据,门控循环单元(GRU)处理波动性强的高频数据,将各频段预测结果进行融合得到最终预测结果。为验证模型有效性,选取一定数据量的PMI指数进行实验。结果表明,与其他常见模型对比,本文构建的组合模型具有较好的预测精度与性能,平均绝对误差(MAE)、均方根误差(RMSE)、平均绝对百分比误差(MAPE)分别达到0.00329、0.004162、0.65%。

基于Swin Transformer与GRU的低温贮藏番茄成熟度识别与时序预测研究

面向绿熟番茄采后持续转熟特征,适时调温是满足不同成熟度番茄适宜贮运温度需求的关键,而果实成熟度自动识别与动态预测则是实现温度适时调控的基础条件。本文基于Swin Transformer与改进GRU提出了一种番茄成熟度识别与时序动态预测模型,首先通过融合番茄两侧图像获取番茄表观全局红色总占比,构建不同成熟番茄图像数据集,并基于迁移学习优化Swin Transformer模型初始权重配置,实现番茄成熟度分类识别;其次,周期性采集不同储藏温度(4、9、14℃)下番茄图像数据,结合番茄初始颜色特征与贮藏环境信息,构建基于Swin Transformer与GRU的番茄成熟度时序预测模型,并融合时间注意力模块优化模型预测精度;最后,对比分析不同模型预测结果,验证本研究所提模型的准确性与优越性。结果表明,番茄成熟度正确识别率为95.783%,相比VGG16、AlexNet、ResNet50模型,模型正确识别率分别提升2.83%、3.35%、12.34%。番茄成熟度时序预测均方误差(MSE)为0.225,相比原始GRU、LSTM、BiGRU模型MSE最高降低29.46%。本研究为兼顾番茄成熟度实现贮藏温度柔性适时调控提供了关键理论基础。

基于CBAM-CGRU-SVM的Android恶意软件检测方法

随着Android恶意软件的种类和数量不断增多,检测恶意软件以保护系统安全和用户隐私变得越来越重要。针对传统的恶意软件检测模型分类准确率较低的问题,提出一种基于卷积神经网络(CNN)、门控循环单元(GRU)和支持向量机(SVM)的模型CBAM-CGRU-SVM。首先,在CNN中添加卷积块注意力模块(CBAM)以学习更多恶意软件的关键特征;其次,利用GRU进一步提取特征;最后,为了解决图像分类时模型泛化能力不足的问题,使用SVM代替softmax激活函数作为模型的分类函数。实验使用了Malimg公开数据集,该数据集将恶意软件数据图像化作为模型输入。实验结果表明,CBAM-CGRU-SVM模型分类准确率达到94.73%,能够更有效地对恶意软件家族进行分类。

水库水位的VMD-CNN-GRU混合预测模型

水库水位预测为其运营、防洪、水资源调度管理提供了重要决策支持.准确可靠的预测对水资源的优化管理起着至关重要的作用.针对水库水位数据的非线性、不稳定性以及复杂的时空特性,提出一种融合自适应变分模态分解(VMD)、卷积神经网络(CNN)和门控循环单元(GRU)的混合水库水位预测模型.VMD通过对水位序列进行分解消除噪声,CNN用于有效提取水位数据的局部特征,GRU用于提取水位数据的深层时间特征.以葠窝水库日水位为例,与多个相关模型对比分析,结果表明:精度方面,新模型在选取的评价指标上均表现最佳;运算效率方面,本文选择的GRU与长短时记忆网络(LSTM)相比,运算效率显著提高.新模型预测的高精度、高运算效率更能满足实际水库水位实时调度的需求.

基于GRU的密集连接时空图注意力网络的城市交通预测

城市道路拓扑结构的复杂性、交通流量的实时变化以及多元的外部环境等因素给交通预测带来了极大的困难。现有方法对交通路网的时空特征挖掘性不足,缺乏对外部因素的考虑,为此本文提出了一种基于门控循环单元(GRU)的时空图注意力密集连接网络,通过门控循环单元来捕获路网数据的动态规律,并以图注意力密集连接网络来提取路网复杂的空间结构特征,建立城市交通网络对时空的依赖关系。针对外部客观因素,采用独热编码的方式对城市各路段发生的交通事件进行数据建模,增强交通网络的信息属性。以杭州申花路及周围共309个路段为例,对所提出模型的预测能力和可行性进行验证。实验结果表明,模型预测精度最高达到了81.64%,与传统数学模型和主流的神经网络模型对比,预测精度较ARIMA提高了35.42%,较图注意力网络(GAT)和GRU神经网络分别提高了17.45%和3.02%。实验证明该方法可以适应复杂的交通流进行长期的交通预测任务,同时也能增强交通管理能力,减少交通拥堵成本。

基于优化VMD-GRU的滚动轴承剩余使用寿命预测

为了提高滚动轴承剩余使用寿命(RUL)的预测精度,提出了一种变分模态分解(VMD)和门控循环神经网络(GRU)融合算法的滚动轴承RUL预测模型VMD-GRU。首先,该模型通过阿基米德优化算法(AOA)优化的VMD算法对原始振动信号进行分解;然后,利用最小包络熵准则选择最佳模态分量进行退化特征提取;再通过核主成分分析进行特征降维;最后,为保证模型准确率,通过鹈鹕优化算法(POA)优化GRU中的超参数,并根据不同故障类型建立GRU剩余寿命预测模型。使用XJTU-SY标准数据集进行剩余寿命预测验证,实验结果表明:与传统未结合故障类型提取退化特征和建立预测模型方法相比,VMD-GRU模型均方根误差和平均绝对误差分别降低了26.28%和27.17%。

Artificial neural network-based one-equation model for simulation of laminar-turbulent transitional flow

A mapping function between the Reynolds-averaged Navier-Stokes mean flow variables and transition intermittency factor is constructed by fully connected artificial neural network(ANN),which replaces the governing equation of the intermittency factor in transition-predictive Spalart-Allmaras(SA)-γmodel.By taking SA-γmodel as the benchmark,the present ANN model is trained at two airfoils with various angles of attack,Mach numbers and Reynolds numbers,and tested with unseen airfoils in different flow states.The a posteriori tests manifest that the mean pressure coefficient,skin friction coefficient,size of laminar separation bubble,mean streamwise velocity,Reynolds shear stress and lift/drag/moment coefficient from the present two-way coupling ANN model almost coincide with those from the benchmark SA-γmodel.Furthermore,the ANN model proves to exhibit a higher calculation efficiency and better convergence quality than traditional SA-γmodel.

基于GRU和LSTM组合模型的车联网信道分配方法

针对车联网中高通信需求和高移动性造成的车对车链路(Vehicle to Vehicle,V2V)间的信道冲突及网络效用低下的问题,提出了一种基于并联门控循环单元(Gated Recurrent Unit,GRU)和长短期记忆网络(Long Short-Term Memory,LSTM)的组合模型的车联网信道分配算法。算法以降低V2V链路信道碰撞率和空闲率为目标,将信道分配问题建模为分布式深度强化学习问题,使每条V2V链路作为单个智能体,并通过最大化每回合平均奖励的方式进行集中训练、分布式执行。在训练过程中借助GRU训练周期短和LSTM拟合精度高的组合优势去拟合深度双重Q学习中Q函数,使V2V链路能快速地学习优化信道分配策略,合理地复用车对基础设施(Vehicle to Infrastructure,V2I)链路的信道资源,实现网络效用最大化。仿真结果表明,与单纯使用GRU或者LSTM网络模型的分配算法相比,该算法在收敛速度方面加快了5个训练回合,V2V链路间的信道碰撞率和空闲率降低了约27%,平均成功率提升了约10%。

Artificial neural network-based subgrid-scale models for LES of compressible turbulent channel flow

Fully connected neural networks(FCNNs)have been developed for the closure of subgrid-scale(SGS)stress and SGS heat flux in large-eddy simulations of compressible turbulent channel flow.The FCNNbased SGS model trained using data with Mach number Ma=3.0 and Reynolds number Re=3000 was applied to situations with different Mach numbers and Reynolds numbers.The input variables of the neural network model were the filtered velocity gradients and temperature gradients at a single spatial grid point.The a priori test showed that the FCNN model had a correlation coefficient larger than 0.91 and a relative error smaller than 0.43,with much better reconstructions of SGS unclosed terms than the dynamic Smagorinsky model(DSM).In a posteriori test,the behavior of the FCNN model was marginally better than that of the DSM in predicting the mean velocity profiles,mean temperature profiles,turbulent intensities,total Reynolds stress,total Reynolds heat flux,and mean SGS flux of kinetic energy,and outperformed the Smagorinsky model.

基于CNN-BiGRU-Attention的短期电力负荷预测

针对目前电力负荷数据随机性强,影响因素复杂,传统单一预测模型精度低的问题,结合卷积神经网络(Convolutional neural network,CNN)、双向门控循环单元(Bi-directional gated recurrent unit,BiGRU)以及注意力机制(Attention)在短期电力负荷预测上的不同优点,提出一种基于CNN-BiGRU-Attention的混合预测模型。该方法首先通过CNN对历史负荷和气象数据进行初步特征提取,然后利用BiGRU进一步挖掘特征数据间时序关联,再引入注意力机制,对BiGRU输出状态给与不同权重,强化关键特征,最后完成负荷预测。试验结果表明,该模型的平均绝对百分比误差(Mean absolute percentage error,MAPE)、均方根误差(Root mean square error,RMSE)、判定系数(R-square,R~2)分别为0.167%、0.057%、0.993,三项指标明显优于其他模型,具有更高的预测精度和稳定性,验证了模型在短期负荷预测中的优势。

基于EMD-GRU的港口堆场煤炭含水率智能预测与实验研究

针对煤炭港口堆场洒水抑尘需求,提出了基于EMD-GRU的煤炭含水率预测模型并进行了实验验证。通过建立煤炭堆场含水率预测模型,利用实时数据驱动预测煤炭堆垛含水率变化,根据气象数据与含水率变化情况判断煤炭堆垛未来起尘情况并制定相应的洒水策略。实验结果表明,EMD-GRU模型的均方根误差、平均绝对误差、平均绝对百分比误差和决定系数分别为0.768、0.566、9.52%、0.944,与SVR、DTR、RNN、LSTM、GRU等预测模型相比,EMD-GRU预测模型的各误差值均最低,决定系数为最高,且预测精度与拟合效果最好。

A Neural Study of the Fractional Heroin Epidemic Model

This works intends to provide numerical solutions based on the nonlinear fractional order derivatives of the classical White and Comiskey model(NFD-WCM).The fractional order derivatives have provided authentic and accurate solutions for the NDF-WCM.The solutions of the fractional NFD-WCM are provided using the stochastic computing supervised algorithm named Levenberg-Marquard Backpropagation(LMB)based on neural networks(NNs).This regression approach combines gradient descent and Gauss-Newton iterative methods,which means finding a solution through the sequences of different calculations.WCM is used to demonstrate the heroin epidemics.Heroin has been on-growth world wide,mainly in Asia,Europe,and the USA.It is the fourth foremost cause of death due to taking an overdose in the USA.The nonlinear mathematical system NFD-WCM discusses the overall circumstance of different drug users,such as suspected groups,drug users without treatment,and drug users with treatment.The numerical results of NFD-WCM via LMB-NNs have been substantiated through training,testing,and validation measures.The stability and accuracy are then checked through the statistical tool,such asmean square error(MSE),error histogram,and fitness curves.The suggested methodology’s strength is demonstrated by the high convergence between the reference solutions and the solutions generated by adding the efficacy of a constructed solver LMB-NNs,with accuracy levels ranging from 10?9 to 10?10.