Multi-layer perceptron-based data-driven multiscale modelling of granular materials with a novel Frobenius norm-based internal variable

One objective of developing machine learning(ML)-based material models is to integrate them with well-established numerical methods to solve boundary value problems(BVPs).In the family of ML models,recurrent neural networks(RNNs)have been extensively applied to capture history-dependent constitutive responses of granular materials,but these multiple-step-based neural networks are neither sufficiently efficient nor aligned with the standard finite element method(FEM).Single-step-based neural networks like the multi-layer perceptron(MLP)are an alternative to bypass the above issues but have to introduce some internal variables to encode complex loading histories.In this work,one novel Frobenius norm-based internal variable,together with the Fourier layer and residual architectureenhanced MLP model,is crafted to replicate the history-dependent constitutive features of representative volume element(RVE)for granular materials.The obtained ML models are then seamlessly embedded into the FEM to solve the BVP of a biaxial compression case and a rigid strip footing case.The obtained solutions are comparable to results from the FEM-DEM multiscale modelling but achieve significantly improved efficiency.The results demonstrate the applicability of the proposed internal variable in enabling MLP to capture highly nonlinear constitutive responses of granular materials.

Dynamic Multi-Layer Perceptron for Fetal Health Classification Using Cardiotocography Data

Fetal health care is vital in ensuring the health of pregnant women and the fetus.Regular check-ups need to be taken by the mother to determine the status of the fetus’growth and identify any potential problems.To know the status of the fetus,doctors monitor blood reports,Ultrasounds,cardiotocography(CTG)data,etc.Still,in this research,we have considered CTG data,which provides information on heart rate and uterine contractions during pregnancy.Several researchers have proposed various methods for classifying the status of fetus growth.Manual processing of CTG data is time-consuming and unreliable.So,automated tools should be used to classify fetal health.This study proposes a novel neural network-based architecture,the Dynamic Multi-Layer Perceptron model,evaluated from a single layer to several layers to classify fetal health.Various strategies were applied,including pre-processing data using techniques like Balancing,Scaling,Normalization hyperparameter tuning,batch normalization,early stopping,etc.,to enhance the model’s performance.A comparative analysis of the proposed method is done against the traditional machine learning models to showcase its accuracy(97%).An ablation study without any pre-processing techniques is also illustrated.This study easily provides valuable interpretations for healthcare professionals in the decision-making process.

Prediction of flyrock distance induced by mine blasting using a novel Harris Hawks optimization-based multi-layer perceptron neural network

In mining or construction projects,for exploitation of hard rock with high strength properties,blasting is frequently applied to breaking or moving them using high explosive energy.However,use of explosives may lead to the flyrock phenomenon.Flyrock can damage structures or nearby equipment in the surrounding areas and inflict harm to humans,especially workers in the working sites.Thus,prediction of flyrock is of high importance.In this investigation,examination and estimation/forecast of flyrock distance induced by blasting through the application of five artificial intelligent algorithms were carried out.One hundred and fifty-two blasting events in three open-pit granite mines in Johor,Malaysia,were monitored to collect field data.The collected data include blasting parameters and rock mass properties.Site-specific weathering index(WI),geological strength index(GSI) and rock quality designation(RQD)are rock mass properties.Multi-layer perceptron(MLP),random forest(RF),support vector machine(SVM),and hybrid models including Harris Hawks optimization-based MLP(known as HHO-MLP) and whale optimization algorithm-based MLP(known as WOA-MLP) were developed.The performance of various models was assessed through various performance indices,including a10-index,coefficient of determination(R^(2)),root mean squared error(RMSE),mean absolute percentage error(MAPE),variance accounted for(VAF),and root squared error(RSE).The a10-index values for MLP,RF,SVM,HHO-MLP and WOA-MLP are 0.953,0.933,0.937,0.991 and 0.972,respectively.R^(2) of HHO-MLP is 0.998,which achieved the best performance among all five machine learning(ML) models.

Identification of low-resistivity-low-contrast pay zones in the feature space with a multi-layer perceptron based on conventional well log data

In the early exploration of many oilfields,low-resistivity-low-contrast(LRLC)pay zones are easily overlooked due to the resistivity similarity to the water zones.Existing identification methods are model-driven and cannot yield satisfactory results when the causes of LRLC pay zones are complicated.In this study,after analyzing a large number of core samples,main causes of LRLC pay zones in the study area are discerned,which include complex distribution of formation water salinity,high irreducible water saturation due to micropores,and high shale volume.Moreover,different oil testing layers may have different causes of LRLC pay zones.As a result,in addition to the well log data of oil testing layers,well log data of adjacent shale layers are also added to the original dataset as reference data.The densitybased spatial clustering algorithm with noise(DBSCAN)is used to cluster the original dataset into 49 clusters.A new dataset is ultimately projected into a feature space with 49 dimensions.The new dataset and oil testing results are respectively treated as input and output to train the multi-layer perceptron(MLP).A total of 3192 samples are used for stratified 8-fold cross-validation,and the accuracy of the MLP is found to be 85.53%.

Prediction of Logistics Demand via Least Square Method and Multi-Layer Perceptron

To implement the prediction of the logistics demand capacity of a certain region,a comprehensive index system is constructed,which is composed of freight volume and other eight relevant economic indices,such as gross domestic product(GDP),consumer price index(CPI),total import and export volume,port's cargo throughput,total retail sales of consumer goods,total fixed asset investment,highway mileage,and resident population,to form the foundation for the model calculation.Based on the least square method(LSM)to fit the parameters,the study obtains an accurate mathematical model and predicts the changes of each index in the next five years.Using artificial intelligence software,the research establishes the logistics demand model of multi-layer perceptron(MLP)neural network,makes an empirical analysis on the logistics demand of Quanzhou City,and predicts its logistics demand in the next five years,which provides some references for formulating logistics planning and development strategy.

Current Harmonic Estimation in Power Transmission Lines Using Multi-layer Perceptron Learning Strategies

This main contribution of this work is to propose a new approach based on a structure of MLPs （multi-layer perceptrons） for identifying current harmonics in low power distribution systems. In this approach, MLPs are proposed and trained with signal sets that arc generated from real harmonic waveforms. After training, each trained MLP is able to identify the two coefficients of each harmonic term of the input signal. The effectiveness of the new approach is evaluated by two experiments and is also compared to another recent MLP method. Experimental results show that the proposed MLPs approach enables to identify effectively the amplitudes of harmonic terms from the signals under noisy condition. The new approach can be applied in harmonic compensation strategies with an active power filter to ensure power quality issues in electrical power systems.

Digital modulation classification using multi-layer perceptron and time-frequency features

Considering that real communication signals corrupted by noise are generally nonstationary, and timefrequency distributions are especially suitable for the analysis of nonstationary signals, time-frequency distributions are introduced for the modulation classification of communication signals： The extracted time-frequency features have good classification information, and they are insensitive to signal to noise ratio （SNR） variation. According to good classification by the correct rate of a neural network classifier, a multilayer perceptron （MLP） classifier with better generalization, as well as, addition of time-frequency features set for classifying six different modulation types has been proposed. Computer simulations show that the MLP classifier outperforms the decision-theoretic classifier at low SNRs, and the classification experiments for real MPSK signals verify engineering significance of the MLP classifier.

Implementing Semantic Deduction of Propositional Knowledge in an Extension Multi-layer Perceptron

The paper presents an extension multi-laye r p erceptron model that is capable of representing and reasoning propositional know ledge base. An extended version of propositional calculus is developed, and its some properties is discussed. Formulas of the extended calculus can be expressed in the extension multi-layer perceptron. Naturally, semantic deduction of prop ositional knowledge base can be implement by the extension multi-layer perceptr on, and by learning, an unknown formula set can be found.

基于MLP的伪装语音说话人性别鉴定

文中提出了一种基于神经网络的伪装语音说话人识别模型,用以实现从共振峰的中心频率、带宽、音强等参数识别伪装语音说话人的性别。该模型以多层感知机(Multi-Layer Perceptron,MLP)为框架,经全连接的非线性堆叠计算获取识别结果,并在模型的训练阶段采用L-BFGS进行优化参数的求解。实验中采用SoundTouch对男性和女性的自然语音进行伪装,探讨了网络结构与激活函数对该模型的影响,以及该识别模型对不同电子伪装手段的适应能力。实验结果表明,基于MLP的识别模型能高效区分采用不同电子伪装手段伪装后的语音对应的说话人的性别。

SSA-MLP模型在岩质边坡稳定性预测中的应用

岩质边坡的力学参数量化及稳定性分析对岩质边坡灾害的防治具有重要意义。Hoek-Brown(H B)准则是一种用于确定岩体力学参数的经典方法,能反映出边坡岩体变形和位移的非线性破坏特征。在此基础上,首先,提出一种麻雀搜索算法(Sparrow Search Algorithm,SSA)改进多层感知器(Multi-Layer Perceptron,MLP)的神经网络模型,并用于边坡稳定性预测、指标敏感性分析及参数反演。其次,将收集的1085组岩质边坡的几何参数和H B准则参数等作为输入变量,极限平衡理论Bishop法求解的安全系数作为输出变量,对SSA MLP模型进行训练学习和性能评估。最后,将该模型运用于25个边坡实例,验证模型的有效性。结果显示,该模型收敛速度快、精度高,为边坡稳定性分析和参数量化提供了一种新思路。

基于MLP的海上无人跨域协同效能评估系统的设计与实现

针对海上无人协同跨域系统的探测能力效能评估问题,需开展评估指标、评估算法等研究。将机器人自身参数与环境参数结合构建了评价指标计算模型,如探测覆盖率、重复探测率、单位面积上的像素数量、能量等指标和海上无人跨域协同系统探测能力指标评价体系,降低了评估过程中的主观性,采用ADC(availability dependability capability)法结合层次分析法生成训练数据,利用MLP(multilayer perceptron)神经网络法客观地衡量系统的效能,结果表明:生成的数据集规模达到2万,该模型评估误差在3%以下,验证了其有效性和适用性;利用PyQt5框架搭建了评估系统界面,实现了环境建模、数据录入、效能评估的功能。

基于MLP-Bagging的PCB电热耦合建模方法

随着三维集成电路性能的提高和复杂程度的增加,印制电路板(PCB)的散热问题日益突出。研究了PCB在电热多物理场相互作用下各部件的发热情况,提出了基于混合激活函数的多层感知机(MLP)-Bagging多物理参数算法。通过使用ReLU和Sigmoid两个激活函数进行学习和训练,建立了精度更高的MLP模型。之后,结合Bagging算法构建多个并行的MLP模型。所提出的神经网络多物理模型可以快速准确地预测PCB的电热响应。实验结果表明,此方法与有限元法相比,可以节省约97%的计算内存和99%的计算时间,与传统神经网络如随机森林(RF)、长短时记忆(LSTM)网络、MLP相比,该方法表现优良且泛化能力较好,为提高PCB设计效率提供了一种可行方法,为PCB热分析提供了更高效的解决方法。

基于WP-MLP神经网络的VoIP自适应抖动缓冲算法

为解决抖动缓冲区播放延时和丢包之间的矛盾,实现缓冲区的动态调整使延时和丢包达到最优的平衡,提出一种基于WP-MLP神经网络的自适应抖动缓冲算法。首先,对抖动缓冲区的基本原理进行了分析并给出了丢包率与缓冲延时之间的函数关系;其次,提出了WP-MLP神经网络抖动缓冲算法的网络模型并对算法流程进行了分析;最后,通过VoIP网络仿真进行建模对比几种常用抖动缓冲算法,结果表明,本文所提算法能够在播放延时和丢包率之间保持更好的平衡,对缓冲区大小的动态调节表现出更优异的性能。

Recommendation System Based on Perceptron and Graph Convolution Network

The relationship between users and items,which cannot be recovered by traditional techniques,can be extracted by the recommendation algorithm based on the graph convolution network.The current simple linear combination of these algorithms may not be sufficient to extract the complex structure of user interaction data.This paper presents a new approach to address such issues,utilizing the graph convolution network to extract association relations.The proposed approach mainly includes three modules:Embedding layer,forward propagation layer,and score prediction layer.The embedding layer models users and items according to their interaction information and generates initial feature vectors as input for the forward propagation layer.The forward propagation layer designs two parallel graph convolution networks with self-connections,which extract higher-order association relevance from users and items separately by multi-layer graph convolution.Furthermore,the forward propagation layer integrates the attention factor to assign different weights among the hop neighbors of the graph convolution network fusion,capturing more comprehensive association relevance between users and items as input for the score prediction layer.The score prediction layer introduces MLP(multi-layer perceptron)to conduct non-linear feature interaction between users and items,respectively.Finally,the prediction score of users to items is obtained.The recall rate and normalized discounted cumulative gain were used as evaluation indexes.The proposed approach effectively integrates higher-order information in user entries,and experimental analysis demonstrates its superiority over the existing algorithms.

基于变分贝叶斯算法和MLP网络的后非线性混合盲源分离方法研究

传统的后非线性模型往往要求其后非线性函数是可逆的,否则无法进行源信号的分离。然而在实际中,这一要求并不完全满足。针对此不足,结合变分贝叶斯推论和多层感知器网络,提出一种改进的多层感知器后非线性模型,它通过多层感知器来模拟后非线性函数,实现对不可逆后非线性函数混合的盲分离。仿真和实验结果表明该方法是有效的。

基于MLP改进型深度神经网络学习资源推荐算法

针对在线学习过程中出现的知识过载及传统推荐算法中存在的数据稀疏和冷启动问题,提出了一种基于多层感知机(MLP)的改进型深度神经网络学习资源推荐算法。该算法利用多层感知机对非线性数据处理的优势,将学习者特征和学习资源特征进行向量相乘的预测方式转换为输入多层感知机的方式,改进了DN-CBR神经网络推荐模型。为验证模型的有效性,以爱课程在线学习平台数据为样本构建数据集,通过对比实验表明,在该数据集上,改进后模型相较于DN-CBR模型在归一化折损累积增益和命中率指标上分别提升了1.2%和3%,有效地提高了模型的推荐性能。

用于短文本分类的BLSTM_MLPCNN模型

文本表示和文本特征提取是自然语言处理的基础工作,直接影响文本分类的性能。文中提出了以字符级向量联合词向量作为输入的BLSTM_MLPCNN神经网络模型。该模型首先将卷积神经网络(CNN)作用于字符以获取字符级向量,并将字符级向量联合词向量作为预训练词嵌入向量,也即双向长短时记忆网(BLSTM)模型的输入;然后联合BLSTM模型的前向输出、词嵌入向量、后向输出构成文档特征图;最后利用多层感知器卷积神经网络(MLPCNN)进行特征提取。在相关数据集上的实验结果表明:相比于CNN,RNN以及CNN与RNN的组合模型,BLSTM_MLPCNN模型具有更优的分类性能。

MLP training in a self-organizing state space model using unscented Kalman particle filter

Many Bayesian learning approaches to the multi-layer perceptron （MLP） parameter optimization have been proposed such as the extended Kalman filter （EKF）. This paper uses the unscented Kalman particle filter （UPF） to train the MLP in a self- organizing state space （SOSS） model. This involves forming augmented state vectors consisting of all parameters （the weights of the MLP） and outputs. The UPF is used to sequentially update the true system states and high dimensional parameters that are inherent to the SOSS moder for the MLP simultaneously. Simulation results show that the new method performs better than traditional optimization methods.

基于MLP-ANN和SVM方法的多氯代二苯并呋喃光解半衰期QSPR比较研究

多氯代二苯并呋喃(PCDFs)是全球性污染物之一,光化学降解是其主要的环境降解途径。基于分子二维拓扑结构提出的用于表征化合物结构参数的分子电性距离矢量描述子(MEDV),应用多层感知器神经网络(MLP-ANN)和支持向量机(SVM)对PCDFs在云杉针叶和飞灰表面的光解半衰期(t1/2)进行定量结构-性质相关(QSPR)分析,并用交互检验和外部样本对所建模型的稳定性进行了检验。旨在为PCDFs光解机理的QSPR研究提供新思路。结果表明,所建模型均具有良好的稳定性和预测能力,尤以MLP-ANN模型为佳,其建模相关系数(Rcum)、留一法交互检验相关系数(Q LOO)以及外部样本检验相关系数(Q ext)分别为0.850、0.816、0.954(云杉针叶表面)和0.892、0.753、0.897(飞灰表面)。

融合MLP和DBN的光伏发电预测算法

精确的光伏发电预测对提高电力系统稳定性、保证电能质量、优化电网运行具有重大意义。为了解决现存光伏预测算法精度较低、性能较差的问题,同时为了综合利用多层感知器(MLP)解决非线性问题的能力以及深度信念网络(DBN)有效处理大量复杂数据的优势,构建了一种融合MLP和DBN的光伏预测算法(MLP-DBN),其基本思想是先利用MLP模型进行初步预测,再将观测值与预测值的残差输入DBN预测模型进行预测,最后用残差预测值对MLP模型的预测值进行修正。利用光伏发电实测数据仿真,探究了不同学习率下模型的预测性能,并对模型的各参数进行了寻找优化设置。使用均方根误差、平均绝对误差以及决定系数等性能指标评估结果表明,与传统的预测算法支持向量机(SVM)以及具有较高预测精度的深度学习算法长短期记忆网络(LSTM)相比,MLP-DBN算法性能有明显的提升,为光伏发电提供了一种高精度高性能的预测算法,可以有效解决光伏发电预测问题。