Multi-layer perceptron-based data-driven multiscale modelling of granular materials with a novel Frobenius norm-based internal variable

One objective of developing machine learning(ML)-based material models is to integrate them with well-established numerical methods to solve boundary value problems(BVPs).In the family of ML models,recurrent neural networks(RNNs)have been extensively applied to capture history-dependent constitutive responses of granular materials,but these multiple-step-based neural networks are neither sufficiently efficient nor aligned with the standard finite element method(FEM).Single-step-based neural networks like the multi-layer perceptron(MLP)are an alternative to bypass the above issues but have to introduce some internal variables to encode complex loading histories.In this work,one novel Frobenius norm-based internal variable,together with the Fourier layer and residual architectureenhanced MLP model,is crafted to replicate the history-dependent constitutive features of representative volume element(RVE)for granular materials.The obtained ML models are then seamlessly embedded into the FEM to solve the BVP of a biaxial compression case and a rigid strip footing case.The obtained solutions are comparable to results from the FEM-DEM multiscale modelling but achieve significantly improved efficiency.The results demonstrate the applicability of the proposed internal variable in enabling MLP to capture highly nonlinear constitutive responses of granular materials.

Dynamic Multi-Layer Perceptron for Fetal Health Classification Using Cardiotocography Data

Fetal health care is vital in ensuring the health of pregnant women and the fetus.Regular check-ups need to be taken by the mother to determine the status of the fetus’growth and identify any potential problems.To know the status of the fetus,doctors monitor blood reports,Ultrasounds,cardiotocography(CTG)data,etc.Still,in this research,we have considered CTG data,which provides information on heart rate and uterine contractions during pregnancy.Several researchers have proposed various methods for classifying the status of fetus growth.Manual processing of CTG data is time-consuming and unreliable.So,automated tools should be used to classify fetal health.This study proposes a novel neural network-based architecture,the Dynamic Multi-Layer Perceptron model,evaluated from a single layer to several layers to classify fetal health.Various strategies were applied,including pre-processing data using techniques like Balancing,Scaling,Normalization hyperparameter tuning,batch normalization,early stopping,etc.,to enhance the model’s performance.A comparative analysis of the proposed method is done against the traditional machine learning models to showcase its accuracy(97%).An ablation study without any pre-processing techniques is also illustrated.This study easily provides valuable interpretations for healthcare professionals in the decision-making process.

Enhancing Healthcare Data Security and Disease Detection Using Crossover-Based Multilayer Perceptron in Smart Healthcare Systems

The healthcare data requires accurate disease detection analysis,real-timemonitoring,and advancements to ensure proper treatment for patients.Consequently,Machine Learning methods are widely utilized in Smart Healthcare Systems(SHS)to extract valuable features fromheterogeneous and high-dimensional healthcare data for predicting various diseases and monitoring patient activities.These methods are employed across different domains that are susceptible to adversarial attacks,necessitating careful consideration.Hence,this paper proposes a crossover-based Multilayer Perceptron(CMLP)model.The collected samples are pre-processed and fed into the crossover-based multilayer perceptron neural network to detect adversarial attacks on themedical records of patients.Once an attack is detected,healthcare professionals are promptly alerted to prevent data leakage.The paper utilizes two datasets,namely the synthetic dataset and the University of Queensland Vital Signs(UQVS)dataset,from which numerous samples are collected.Experimental results are conducted to evaluate the performance of the proposed CMLP model,utilizing various performancemeasures such as Recall,Precision,Accuracy,and F1-score to predict patient activities.Comparing the proposed method with existing approaches,it achieves the highest accuracy,precision,recall,and F1-score.Specifically,the proposedmethod achieves a precision of 93%,an accuracy of 97%,an F1-score of 92%,and a recall of 92%.

Recommendation System Based on Perceptron and Graph Convolution Network

The relationship between users and items,which cannot be recovered by traditional techniques,can be extracted by the recommendation algorithm based on the graph convolution network.The current simple linear combination of these algorithms may not be sufficient to extract the complex structure of user interaction data.This paper presents a new approach to address such issues,utilizing the graph convolution network to extract association relations.The proposed approach mainly includes three modules:Embedding layer,forward propagation layer,and score prediction layer.The embedding layer models users and items according to their interaction information and generates initial feature vectors as input for the forward propagation layer.The forward propagation layer designs two parallel graph convolution networks with self-connections,which extract higher-order association relevance from users and items separately by multi-layer graph convolution.Furthermore,the forward propagation layer integrates the attention factor to assign different weights among the hop neighbors of the graph convolution network fusion,capturing more comprehensive association relevance between users and items as input for the score prediction layer.The score prediction layer introduces MLP(multi-layer perceptron)to conduct non-linear feature interaction between users and items,respectively.Finally,the prediction score of users to items is obtained.The recall rate and normalized discounted cumulative gain were used as evaluation indexes.The proposed approach effectively integrates higher-order information in user entries,and experimental analysis demonstrates its superiority over the existing algorithms.

A Multilayer Perceptron Artificial Neural Network Study of Fatal Road Traffic Crashes

This paper examines the relationship between fatal road traffic accidents and potential predictors using multilayer perceptron artificial neural network (MLANN) models. The initial analysis employed twelve potential predictors, including traffic volume, prevailing weather conditions, roadway characteristics and features, drivers’ age and gender, and number of lanes. Based on the output of the model and the variables’ importance factors, seven significant variables are identified and used for further analysis to improve the performance of models. The model is optimized by systematically changing the parameters, including the number of hidden layers and the activation function of both the hidden and output layers. The performances of the MLANN models are evaluated using the percentage of the achieved accuracy, R-squared, and Sum of Square Error (SSE) functions.

基于Perceptron建立某车型焊钉及白车身在线检测体系

以北京奔驰汽车有限公司206车型为基础,基于Perceptron就螺柱焊钉位置尺寸、车身尺寸和覆盖件尺寸在线自动检测以及相应的精度控制进行了研究,规划并建立焊钉位置尺寸在线测量点76个,普通测量特征1373个测量点;规划并实施焊钉在线测量方案以及后端、Z1和Z2.3在线测量方案;完成在线检测工位测量工装优化改进,达成了基于Perceptron的V206焊钉及白车身在线检测体系建设,并实现了工时和成本的节约。

基于生成式人工智能的眼动样本生成及识别

目的生成式和传统人工智能模型是信息时代的关键工具。在这些技术的助力下,眼动过程的样本生成与识别显得尤为关键,它已成为深入研究认知机制的重要手段。为了推动生成式人工智能在眼动技术领域的应用发展,解决眼动样本生成及因网络深度增加而导致的不透明性和不可解释性问题,并深入挖掘与幼儿语言发展相关的眼动数据,方法采集4~6岁幼儿理解不同焦点结构的眼动数据,采用生成式人工智能模型-变分自编码器(variational autoencoder,VAE)和传统模型-多层感知器(multi-layer perceptron,MLP)识别眼动模式的发展差异并尝试生成新样本,基于灰色关联分析和混淆矩阵对生成式数据集进行解释。结果结果表明:(1)VAE生成的4岁组、5岁组和6岁组幼儿眼动数据集精度高于MINIST数据集(mixed National Institute of Standards and Technology database),且与MLP分析结果一致,具有准确性、多样性和一定的可解释性;(2)生成式眼动数据及混淆矩阵结果表明,在无焦点结构句式中,幼儿在4~5岁、5~6岁两个阶段理解水平均有提升,而宾语焦点结构和主语焦点结构的眼动特征在4~5岁变化较小,5~6岁变化较大,说明幼儿对焦点结构的理解在5岁是一个关键期,这符合幼儿焦点结构理解发展规律。结论提出的人工智能耦合分析方法,具备有效识别眼动特征发展模式的能力,并能据此生成可靠的新样本。这一方法不仅为生成式人工智能与眼动技术的融合开辟了新的途径,而且为复杂语言理解问题提供了全新的思考方向。

基于多层感知机模型的长三角水稻种植区净生态系统碳通量模拟

中国长江三角洲地区(以下简称长三角地区)是典型的水稻种植区,其碳源汇对区域气候和环境具有重要影响。本文系统地分析了长三角地区净生态系统碳交换量(net ecosystem exchange,NEE)与各个气象因子之间的关系,发现NEE与太阳短波辐射的相关性最强,其次与湿度相关参量(饱和水汽压差、相对湿度)等呈现较强的相关性。同时,NEE与太阳辐射、气温、湿度因子、风速和摩擦速度的相关性呈现明显的昼夜变化。基于上述分析,本文利用NEE和气象观测数据构建了长三角水稻下垫面多层感知机(Multilayer perceptron,MLP)NEE模拟模型,评估了模型的模拟效果及其时空稳定性。构建的MLP模型能较好地拟合NEE,训练集模拟的NEE与观测值的相关系数达到0.88,均方根误差为5.34μmol·m^(-2)·s^(-1);MLP模型在模拟长三角水稻季NEE时表现良好,在东台和寿县站点的模拟NEE结果与观测值的相关系数均高于0.78,模型具有较好的时空稳定性;MLP模型模拟白天平均NEE的效果好于夜间平均NEE的效果。研究结果揭示了影响水稻碳循环的主要气象因子,为认识长三角水稻种植区碳循环时空分布特征提供支撑,对准确评估全球和区域碳通量具有重要意义。

FPGA implementation of bit-stream neuron and perceptron based on sigma delta modulation

To solve the excessive huge scale problem of the traditional multi-bit digital artificial neural network（ANN） hardware implementation methods,a bit-stream ANN hardware implementation method based on sigma delta（ΣΔ） modulation is presented.The bit-stream adder,multiplier,threshold function unit and fully digital ΣΔ modulator are implemented in a field programmable gate array（FPGA）,and these bit-stream arithmetical units are employed to build the bit-stream artificial neuron.The function of the bit-stream artificial neuron is verified through the realization of the logic function and a linear classifier.The bit-stream perceptron based on the bit-stream artificial neuron with the pre-processed structure is proved to have the ability of nonlinear classification.The FPGA resource utilization of the bit-stream artificial neuron shows that the bit-stream ANN hardware implementation method can significantly reduce the demand of the ANN hardware resources.

融合快速边缘注意力的Transformer跟踪算法

针对长期目标跟踪中出现模型退化和跟踪漂移的问题,提出了一种融合快速边缘注意力的Transformer跟踪算法TransFEA(fast edge attention on Transformer)。使用ResNet-50作为Siamese网络的骨干网络,并在其每个残差块后端引入注意力网络进行特征提取,增强目标的关键信息和全局信息;边缘注意力网络(edge attention network,EA)提取模板与搜索区域的特征向量,快速注意力网络(fast attention network,FA)计算注意响应值,确定两个区域的相似度,以此调整目标位置。设计多层感知器预测边界框,避免过多超参数,使跟踪器实现了准确性与轻量化的平衡。实验结果表明,TransFEA在LaSOT数据集上成功率和准确率分别为65.3%、69.1%,运行可以达到90 FPS,提高了长期跟踪的成功率和准确率。

Current Harmonic Estimation in Power Transmission Lines Using Multi-layer Perceptron Learning Strategies

This main contribution of this work is to propose a new approach based on a structure of MLPs （multi-layer perceptrons） for identifying current harmonics in low power distribution systems. In this approach, MLPs are proposed and trained with signal sets that arc generated from real harmonic waveforms. After training, each trained MLP is able to identify the two coefficients of each harmonic term of the input signal. The effectiveness of the new approach is evaluated by two experiments and is also compared to another recent MLP method. Experimental results show that the proposed MLPs approach enables to identify effectively the amplitudes of harmonic terms from the signals under noisy condition. The new approach can be applied in harmonic compensation strategies with an active power filter to ensure power quality issues in electrical power systems.

基于Perceptron的非线性滑模控制

利用Ｐｅｒｃｅｐｔｒｏｎ的两类模式分类特性对非线性滑动模态方程的Ｌｙａｐｕｎｏｖ函数进行训练，以求得非线性系统的切换函数，并进行滑模控制器设计，为非线性滑模控制系统的综合设计提供了一条新的途径，并应用于车削系统中．

简单Perceptron学习算法的收敛性

当输入是无穷集或区域时，通过构造一个上鞅，本文证明了简单Ｐｅｒｃｅｐｔｒｏｎ学习算法的收敛性。

Prediction of flyrock distance induced by mine blasting using a novel Harris Hawks optimization-based multi-layer perceptron neural network

In mining or construction projects,for exploitation of hard rock with high strength properties,blasting is frequently applied to breaking or moving them using high explosive energy.However,use of explosives may lead to the flyrock phenomenon.Flyrock can damage structures or nearby equipment in the surrounding areas and inflict harm to humans,especially workers in the working sites.Thus,prediction of flyrock is of high importance.In this investigation,examination and estimation/forecast of flyrock distance induced by blasting through the application of five artificial intelligent algorithms were carried out.One hundred and fifty-two blasting events in three open-pit granite mines in Johor,Malaysia,were monitored to collect field data.The collected data include blasting parameters and rock mass properties.Site-specific weathering index(WI),geological strength index(GSI) and rock quality designation(RQD)are rock mass properties.Multi-layer perceptron(MLP),random forest(RF),support vector machine(SVM),and hybrid models including Harris Hawks optimization-based MLP(known as HHO-MLP) and whale optimization algorithm-based MLP(known as WOA-MLP) were developed.The performance of various models was assessed through various performance indices,including a10-index,coefficient of determination(R^(2)),root mean squared error(RMSE),mean absolute percentage error(MAPE),variance accounted for(VAF),and root squared error(RSE).The a10-index values for MLP,RF,SVM,HHO-MLP and WOA-MLP are 0.953,0.933,0.937,0.991 and 0.972,respectively.R^(2) of HHO-MLP is 0.998,which achieved the best performance among all five machine learning(ML) models.

Identification of low-resistivity-low-contrast pay zones in the feature space with a multi-layer perceptron based on conventional well log data

In the early exploration of many oilfields,low-resistivity-low-contrast(LRLC)pay zones are easily overlooked due to the resistivity similarity to the water zones.Existing identification methods are model-driven and cannot yield satisfactory results when the causes of LRLC pay zones are complicated.In this study,after analyzing a large number of core samples,main causes of LRLC pay zones in the study area are discerned,which include complex distribution of formation water salinity,high irreducible water saturation due to micropores,and high shale volume.Moreover,different oil testing layers may have different causes of LRLC pay zones.As a result,in addition to the well log data of oil testing layers,well log data of adjacent shale layers are also added to the original dataset as reference data.The densitybased spatial clustering algorithm with noise(DBSCAN)is used to cluster the original dataset into 49 clusters.A new dataset is ultimately projected into a feature space with 49 dimensions.The new dataset and oil testing results are respectively treated as input and output to train the multi-layer perceptron(MLP).A total of 3192 samples are used for stratified 8-fold cross-validation,and the accuracy of the MLP is found to be 85.53%.

A Hybrid Learning Method for Multilayer Perceptrons

A Newton learning method for a neural network of multilayer perceptrons is proposed in this paper. Furthermore, a hybrid learning method id legitimately developed in combination of the backpropagation method proposed by Rumelhart et al with the Newton learning method. Finally, the hybrid learning algorithm is compared with the backpropagation algorithm by some illustrations, and the results show that this hybrid leaming algorithm bas the characteristics of rapid convergence.

The development of a knowledge base in an expert system based on the four-layer perceptron neural network

Owing to continuous production lines with large amount of consecutive controls, various control signals and huge logistic relations, this paper introduced the methods and principles of the development of knowledge base in a fault diagnosis expert system that was based on machine learning by the four-layer perceptron neural network. An example was presented. By combining differential function with not differential function and back propagation of error with back propagation of expectation, the four-layer perceptron neural network was established. And it was good for solving such a bottleneck problem in knowledge acquisition in expert system and enhancing real-time on-line diagnosis. A method of synthetic back propagation was designed, which broke the limit to non-differentiable function in BP neural network.

Classification of frozen soil blastability by using perceptron neural network

Influence factors of frozen soil blastability are analyzed which mainly conclude the strain energy coefficient, tensile strength, compressive strength, longitudinal wave velocity and transverse wave velocity. According to the principle of perceptron neural network, at first the index factors are standardized by the aid of the efficient function theory, then the blastability of frozen sand at -7, -12 and -17 ℃ are classified three categories. Through adjusting the weight value and threshold value, we can obtain that the clay blastability at -7 ℃ is close to the sand blastability at -12 ℃, they belong to the second category, the clay blastability at -12 ℃ is close to the sand blastability at -17 ℃, thus they are divided into the third category.

A Perceptron Algorithm for Forest Fire Prediction Based on Wireless Sensor Networks

Forest fire prediction constitutes a significant component of forestmanagement. Timely and accurate forest fire prediction will greatly reduce property andnatural losses. A quick method to estimate forest fire hazard levels through knownclimatic conditions could make an effective improvement in forest fire prediction. Thispaper presents a description and analysis of a forest fire prediction methods based onmachine learning, which adopts WSN (Wireless Sensor Networks) technology andperceptron algorithms to provide a reliable and rapid detection of potential forest fire.Weather data are gathered by sensors, and then forwarded to the server, where a firehazard index can be calculated.

Prediction of Logistics Demand via Least Square Method and Multi-Layer Perceptron

To implement the prediction of the logistics demand capacity of a certain region,a comprehensive index system is constructed,which is composed of freight volume and other eight relevant economic indices,such as gross domestic product(GDP),consumer price index(CPI),total import and export volume,port's cargo throughput,total retail sales of consumer goods,total fixed asset investment,highway mileage,and resident population,to form the foundation for the model calculation.Based on the least square method(LSM)to fit the parameters,the study obtains an accurate mathematical model and predicts the changes of each index in the next five years.Using artificial intelligence software,the research establishes the logistics demand model of multi-layer perceptron(MLP)neural network,makes an empirical analysis on the logistics demand of Quanzhou City,and predicts its logistics demand in the next five years,which provides some references for formulating logistics planning and development strategy.