Multi-layer perceptron-based data-driven multiscale modelling of granular materials with a novel Frobenius norm-based internal variable

One objective of developing machine learning(ML)-based material models is to integrate them with well-established numerical methods to solve boundary value problems(BVPs).In the family of ML models,recurrent neural networks(RNNs)have been extensively applied to capture history-dependent constitutive responses of granular materials,but these multiple-step-based neural networks are neither sufficiently efficient nor aligned with the standard finite element method(FEM).Single-step-based neural networks like the multi-layer perceptron(MLP)are an alternative to bypass the above issues but have to introduce some internal variables to encode complex loading histories.In this work,one novel Frobenius norm-based internal variable,together with the Fourier layer and residual architectureenhanced MLP model,is crafted to replicate the history-dependent constitutive features of representative volume element(RVE)for granular materials.The obtained ML models are then seamlessly embedded into the FEM to solve the BVP of a biaxial compression case and a rigid strip footing case.The obtained solutions are comparable to results from the FEM-DEM multiscale modelling but achieve significantly improved efficiency.The results demonstrate the applicability of the proposed internal variable in enabling MLP to capture highly nonlinear constitutive responses of granular materials.

Dynamic Multi-Layer Perceptron for Fetal Health Classification Using Cardiotocography Data

Fetal health care is vital in ensuring the health of pregnant women and the fetus.Regular check-ups need to be taken by the mother to determine the status of the fetus’growth and identify any potential problems.To know the status of the fetus,doctors monitor blood reports,Ultrasounds,cardiotocography(CTG)data,etc.Still,in this research,we have considered CTG data,which provides information on heart rate and uterine contractions during pregnancy.Several researchers have proposed various methods for classifying the status of fetus growth.Manual processing of CTG data is time-consuming and unreliable.So,automated tools should be used to classify fetal health.This study proposes a novel neural network-based architecture,the Dynamic Multi-Layer Perceptron model,evaluated from a single layer to several layers to classify fetal health.Various strategies were applied,including pre-processing data using techniques like Balancing,Scaling,Normalization hyperparameter tuning,batch normalization,early stopping,etc.,to enhance the model’s performance.A comparative analysis of the proposed method is done against the traditional machine learning models to showcase its accuracy(97%).An ablation study without any pre-processing techniques is also illustrated.This study easily provides valuable interpretations for healthcare professionals in the decision-making process.

A flexible ultra-broadband multi-layered absorber working at 2 GHz-40 GHz printed by resistive ink

A flexible extra broadband metamaterial absorber(MMA)stacked with five layers working at 2 GHz–40 GHz is investigated.Each layer is composed of polyvinyl chloride(PVC),polyimide(PI),and a frequency selective surface(FSS),which is printed on PI using conductive ink.To investigate this absorber,both one-dimensional analogous circuit analysis and three-dimensional full-wave simulation based on a physical model are provided.Various crucial electromagnetic properties,such as absorption,effective impedance,complex permittivity and permeability,electric current distribution and magnetic field distribution at resonant peak points,are studied in detail.Analysis shows that the working frequency of this absorber covers entire S,C,X,Ku,K and Ka bands with a minimum thickness of 0.098λ_(max)(λ_(max) is the maximum wavelength in the absorption band),and the fractional bandwidth(FBW)reaches 181.1%.Moreover,the reflection coefficient is less than-10 dB at 1.998 GHz–40.056 GHz at normal incidence,and the absorptivity of the plane wave is greater than 80%when the incident angle is smaller than 50°.Furthermore,the proposed absorber is experimentally validated,and the experimental results show good agreement with the simulation results,which demonstrates the potential applicability of this absorber at 2 GHz–40 GHz.

A Well Productivity Model for Multi-Layered Marine and Continental Transitional Reservoirs with Complex Fracture Networks

Using the typical characteristics of multi-layered marine and continental transitional gas reservoirs as a basis,a model is developed to predict the related well production rate.This model relies on the fractal theory of tortuous capillary bundles and can take into account multiple gas flow mechanisms at the micrometer and nanometer scales,as well as the flow characteristics in different types of thin layers(tight sandstone gas,shale gas,and coalbed gas).Moreover,a source-sink function concept and a pressure drop superposition principle are utilized to introduce a coupled flow model in the reservoir.A semi-analytical solution for the production rate is obtained using a matrix iteration method.A specific well is selected for fitting dynamic production data,and the calculation results show that the tight sandstone has the highest gas production per unit thickness compared with the other types of reservoirs.Moreover,desorption and diffusion of coalbed gas and shale gas can significantly contribute to gas production,and the daily production of these two gases decreases rapidly with decreasing reservoir pressure.Interestingly,the gas production from fractures exhibits an approximately U-shaped distribution,indicating the need to optimize the spacing between clusters during hydraulic fracturing to reduce the area of overlapping fracture control.The coal matrix water saturation significantly affects the coalbed gas production,with higher water saturation leading to lower production.

Optimization Design of the Multi-Layer Cross-Sectional Layout of An Umbilical Based on the GA-GLM

Marine umbilical is one of the key equipment for subsea oil and gas exploitation,which is usually integrated by a great number of different functional components with multi-layers.The layout of these components directly affects manufacturing,operation and storage performances of the umbilical.For the multi-layer cross-sectional layout design of the umbilical,a quantifiable multi-objective optimization model is established according to the operation and storage requirements.Considering the manufacturing factors,the multi-layering strategy based on contact point identification is introduced for a great number of functional components.Then,the GA-GLM global optimization algorithm is proposed combining the genetic algorithm and the generalized multiplier method,and the selection operator of the genetic algorithm is improved based on the steepest descent method.Genetic algorithm is used to find the optimal solution in the global space,which can converge from any initial layout to the feasible layout solution.The feasible layout solution is taken as the initial value of the generalized multiplier method for fast and accurate solution.Finally,taking umbilicals with a great number of components as examples,the results show that the cross-sectional performance of the umbilical obtained by optimization algorithm is better and the solution efficiency is higher.Meanwhile,the multi-layering strategy is effective and feasible.The design method proposed in this paper can quickly obtain the optimal multi-layer cross-sectional layout,which replaces the manual design,and provides useful reference and guidance for the umbilical industry.

Recommendation System Based on Perceptron and Graph Convolution Network

The relationship between users and items,which cannot be recovered by traditional techniques,can be extracted by the recommendation algorithm based on the graph convolution network.The current simple linear combination of these algorithms may not be sufficient to extract the complex structure of user interaction data.This paper presents a new approach to address such issues,utilizing the graph convolution network to extract association relations.The proposed approach mainly includes three modules:Embedding layer,forward propagation layer,and score prediction layer.The embedding layer models users and items according to their interaction information and generates initial feature vectors as input for the forward propagation layer.The forward propagation layer designs two parallel graph convolution networks with self-connections,which extract higher-order association relevance from users and items separately by multi-layer graph convolution.Furthermore,the forward propagation layer integrates the attention factor to assign different weights among the hop neighbors of the graph convolution network fusion,capturing more comprehensive association relevance between users and items as input for the score prediction layer.The score prediction layer introduces MLP(multi-layer perceptron)to conduct non-linear feature interaction between users and items,respectively.Finally,the prediction score of users to items is obtained.The recall rate and normalized discounted cumulative gain were used as evaluation indexes.The proposed approach effectively integrates higher-order information in user entries,and experimental analysis demonstrates its superiority over the existing algorithms.

Detecting Phishing Using a Multi-Layered Social Engineering Framework

As businesses develop and expand with a significant volume of data,data protection and privacy become increasingly important.Research has shown a tremendous increase in phishing activities during and after COVID-19.This research aimed to improve the existing approaches to detecting phishing activities on the internet.We designed a multi-layered phish detection algorithm to detect and prevent phishing applications on the internet using URLs.In the algorithm,we considered technical dimensions of phishing attack prevention and mitigation on the internet.In our approach,we merge,Phishtank,Blacklist,Blocklist,and Whitelist to form our framework.A web application system and browser extension were developed to implement the algorithm.The multi-layer phish detector evaluated ten thousandURLs gathered randomly from the internet(five thousand phishing and five thousand legitimate URLs).The system was estimated to detect levels of accuracy,true-positive and false-positive values.The system level accuracy was recorded to be 98.16%.Approximately 49.6%of the websites were detected as illegitimate,whilst 49.8%were seen as legitimate.

Target Controllability of Multi-Layer Networks With High-Dimensional Nodes

This paper studies the target controllability of multilayer complex networked systems,in which the nodes are highdimensional linear time invariant(LTI)dynamical systems,and the network topology is directed and weighted.The influence of inter-layer couplings on the target controllability of multi-layer networks is discussed.It is found that even if there exists a layer which is not target controllable,the entire multi-layer network can still be target controllable due to the inter-layer couplings.For the multi-layer networks with general structure,a necessary and sufficient condition for target controllability is given by establishing the relationship between uncontrollable subspace and output matrix.By the derived condition,it can be found that the system may be target controllable even if it is not state controllable.On this basis,two corollaries are derived,which clarify the relationship between target controllability,state controllability and output controllability.For the multi-layer networks where the inter-layer couplings are directed chains and directed stars,sufficient conditions for target controllability of networked systems are given,respectively.These conditions are easier to verify than the classic criterion.

Enhancing Healthcare Data Security and Disease Detection Using Crossover-Based Multilayer Perceptron in Smart Healthcare Systems

The healthcare data requires accurate disease detection analysis,real-timemonitoring,and advancements to ensure proper treatment for patients.Consequently,Machine Learning methods are widely utilized in Smart Healthcare Systems(SHS)to extract valuable features fromheterogeneous and high-dimensional healthcare data for predicting various diseases and monitoring patient activities.These methods are employed across different domains that are susceptible to adversarial attacks,necessitating careful consideration.Hence,this paper proposes a crossover-based Multilayer Perceptron(CMLP)model.The collected samples are pre-processed and fed into the crossover-based multilayer perceptron neural network to detect adversarial attacks on themedical records of patients.Once an attack is detected,healthcare professionals are promptly alerted to prevent data leakage.The paper utilizes two datasets,namely the synthetic dataset and the University of Queensland Vital Signs(UQVS)dataset,from which numerous samples are collected.Experimental results are conducted to evaluate the performance of the proposed CMLP model,utilizing various performancemeasures such as Recall,Precision,Accuracy,and F1-score to predict patient activities.Comparing the proposed method with existing approaches,it achieves the highest accuracy,precision,recall,and F1-score.Specifically,the proposedmethod achieves a precision of 93%,an accuracy of 97%,an F1-score of 92%,and a recall of 92%.

Multi-layer network embedding on scc-based network with motif

Interconnection of all things challenges the traditional communication methods,and Semantic Communication and Computing(SCC)will become new solutions.It is a challenging task to accurately detect,extract,and represent semantic information in the research of SCC-based networks.In previous research,researchers usually use convolution to extract the feature information of a graph and perform the corresponding task of node classification.However,the content of semantic information is quite complex.Although graph convolutional neural networks provide an effective solution for node classification tasks,due to their limitations in representing multiple relational patterns and not recognizing and analyzing higher-order local structures,the extracted feature information is subject to varying degrees of loss.Therefore,this paper extends from a single-layer topology network to a multi-layer heterogeneous topology network.The Bidirectional Encoder Representations from Transformers(BERT)training word vector is introduced to extract the semantic features in the network,and the existing graph neural network is improved by combining the higher-order local feature module of the network model representation network.A multi-layer network embedding algorithm on SCC-based networks with motifs is proposed to complete the task of end-to-end node classification.We verify the effectiveness of the algorithm on a real multi-layer heterogeneous network.

Dynamic interwell connectivity analysis of multi-layer waterflooding reservoirs based on an improved graph neural network

The analysis of interwell connectivity plays an important role in the formulation of oilfield development plans and the description of residual oil distribution. In fact, sandstone reservoirs in China's onshore oilfields generally have the characteristics of thin and many layers, so multi-layer joint production is usually adopted. It remains a challenge to ensure the accuracy of splitting and dynamic connectivity in each layer of the injection-production wells with limited field data. The three-dimensional well pattern of multi-layer reservoir and the relationship between injection-production wells can be equivalent to a directional heterogeneous graph. In this paper, an improved graph neural network is proposed to construct an interacting process mimics the real interwell flow regularity. In detail, this method is used to split injection and production rates by combining permeability, porosity and effective thickness, and to invert the dynamic connectivity in each layer of the injection-production wells by attention mechanism.Based on the material balance and physical information, the overall connectivity from the injection wells,through the water injection layers to the production layers and the output of final production wells is established. Meanwhile, the change of well pattern caused by perforation, plugging and switching of wells at different times is achieved by updated graph structure in spatial and temporal ways. The effectiveness of the method is verified by a combination of reservoir numerical simulation examples and field example. The method corresponds to the actual situation of the reservoir, has wide adaptability and low cost, has good practical value, and provides a reference for adjusting the injection-production relationship of the reservoir and the development of the remaining oil.

Target layer state estimation in multi-layer complex dynamical networks considering nonlinear node dynamics

In many engineering networks, only a part of target state variables are required to be estimated.On the other hand,multi-layer complex network exists widely in practical situations.In this paper, the state estimation of target state variables in multi-layer complex dynamical networks with nonlinear node dynamics is studied.A suitable functional state observer is constructed with the limited measurement.The parameters of the designed functional observer are obtained from the algebraic method and the stability of the functional observer is proven by the Lyapunov theorem.Some necessary conditions that need to be satisfied for the design of the functional state observer are obtained.Different from previous studies, in the multi-layer complex dynamical network with nonlinear node dynamics, the proposed method can estimate the state of target variables on some layers directly instead of estimating all the individual states.Thus, it can greatly reduce the placement of observers and computational cost.Numerical simulations with the three-layer complex dynamical network composed of three-dimensional nonlinear dynamical nodes are developed to verify the effectiveness of the method.

Multi-layer phenomena in petawatt laser-driven acceleration of heavy ions

Laser-accelerated high-flux-intensity heavy-ion beams are important for new types of accelerators.A particle-in-cell program(Smilei) is employed to simulate the entire process of Station of Extreme Light(SEL) 100 PW laser-accelerated heavy particles using different nanoscale short targets with a thickness of 100 nm Cr, Fe, Ag, Ta, Au, Pb, Th and U, as well as 200 nm thick Al and Ca. An obvious stratification is observed in the simulation. The layering phenomenon is a hybrid acceleration mechanism reflecting target normal sheath acceleration and radiation pressure acceleration, and this phenomenon is understood from the simulated energy spectrum,ionization and spatial electric field distribution. According to the stratification, it is suggested that high-quality heavy-ion beams could be expected for fusion reactions to synthesize superheavy nuclei. Two plasma clusters in the stratification are observed simultaneously, which suggest new techniques for plasma experiments as well as thinner metal targets in the precision machining process.

The role of polyurethane foam compressible layer in the mechanical behaviour of multi-layer yielding supports for deep soft rock tunnels

The polyurethane foam(PU)compressible layer is a viable solution to the problem of damage to the secondary lining in squeezing tunnels.Nevertheless,the mechanical behaviour of the multi-layer yielding supports has not been thoroughly investigated.To fill this gap,large-scale model tests were conducted in this study.The synergistic load-bearing mechanics were analyzed using the convergenceconfinement method.Two types of multi-layer yielding supports with different thicknesses(2.5 cm,3.75 cm and 5 cm)of PU compressible layers were investigated respectively.Digital image correlation(DIC)analysis and acoustic emission(AE)techniques were used for detecting the deformation fields and damage evolution of the multi-layer yielding supports in real-time.Results indicated that the loaddisplacement relationship of the multi-layer yielding supports could be divided into the crack initiation,crack propagation,strain-hardening,and failure stages.Compared with those of the stiff support,the toughness,deformability and ultimate load of the yielding supports were increased by an average of 225%,61%and 32%,respectively.Additionally,the PU compressible layer is positioned between two primary linings to allow the yielding support to have greater mechanical properties.The analysis of the synergistic bearing effect suggested that the thickness of PU compressible layer and its location significantly affect the mechanical properties of the yielding supports.The use of yielding supports with a compressible layer positioned between the primary and secondary linings is recommended to mitigate the effects of high geo-stress in squeezing tunnels.

A Multilayer Perceptron Artificial Neural Network Study of Fatal Road Traffic Crashes

This paper examines the relationship between fatal road traffic accidents and potential predictors using multilayer perceptron artificial neural network (MLANN) models. The initial analysis employed twelve potential predictors, including traffic volume, prevailing weather conditions, roadway characteristics and features, drivers’ age and gender, and number of lanes. Based on the output of the model and the variables’ importance factors, seven significant variables are identified and used for further analysis to improve the performance of models. The model is optimized by systematically changing the parameters, including the number of hidden layers and the activation function of both the hidden and output layers. The performances of the MLANN models are evaluated using the percentage of the achieved accuracy, R-squared, and Sum of Square Error (SSE) functions.

Multi-Layer Feature Extraction with Deformable Convolution for Fabric Defect Detection

In the textile industry,the presence of defects on the surface of fabric is an essential factor in determining fabric quality.Therefore,identifying fabric defects forms a crucial part of the fabric production process.Traditional fabric defect detection algorithms can only detect specific materials and specific fabric defect types;in addition,their detection efficiency is low,and their detection results are relatively poor.Deep learning-based methods have many advantages in the field of fabric defect detection,however,such methods are less effective in identifying multiscale fabric defects and defects with complex shapes.Therefore,we propose an effective algorithm,namely multilayer feature extraction combined with deformable convolution(MFDC),for fabric defect detection.In MFDC,multi-layer feature extraction is used to fuse the underlying location features with high-level classification features through a horizontally connected top-down architecture to improve the detection of multi-scale fabric defects.On this basis,a deformable convolution is added to solve the problem of the algorithm’s weak detection ability of irregularly shaped fabric defects.In this approach,Roi Align and Cascade-RCNN are integrated to enhance the adaptability of the algorithm in materials with complex patterned backgrounds.The experimental results show that the MFDC algorithm can achieve good detection results for both multi-scale fabric defects and defects with complex shapes,at the expense of a small increase in detection time.

基于Perceptron建立某车型焊钉及白车身在线检测体系

以北京奔驰汽车有限公司206车型为基础,基于Perceptron就螺柱焊钉位置尺寸、车身尺寸和覆盖件尺寸在线自动检测以及相应的精度控制进行了研究,规划并建立焊钉位置尺寸在线测量点76个,普通测量特征1373个测量点;规划并实施焊钉在线测量方案以及后端、Z1和Z2.3在线测量方案;完成在线检测工位测量工装优化改进,达成了基于Perceptron的V206焊钉及白车身在线检测体系建设,并实现了工时和成本的节约。

Prediction of flyrock distance induced by mine blasting using a novel Harris Hawks optimization-based multi-layer perceptron neural network

In mining or construction projects,for exploitation of hard rock with high strength properties,blasting is frequently applied to breaking or moving them using high explosive energy.However,use of explosives may lead to the flyrock phenomenon.Flyrock can damage structures or nearby equipment in the surrounding areas and inflict harm to humans,especially workers in the working sites.Thus,prediction of flyrock is of high importance.In this investigation,examination and estimation/forecast of flyrock distance induced by blasting through the application of five artificial intelligent algorithms were carried out.One hundred and fifty-two blasting events in three open-pit granite mines in Johor,Malaysia,were monitored to collect field data.The collected data include blasting parameters and rock mass properties.Site-specific weathering index(WI),geological strength index(GSI) and rock quality designation(RQD)are rock mass properties.Multi-layer perceptron(MLP),random forest(RF),support vector machine(SVM),and hybrid models including Harris Hawks optimization-based MLP(known as HHO-MLP) and whale optimization algorithm-based MLP(known as WOA-MLP) were developed.The performance of various models was assessed through various performance indices,including a10-index,coefficient of determination(R^(2)),root mean squared error(RMSE),mean absolute percentage error(MAPE),variance accounted for(VAF),and root squared error(RSE).The a10-index values for MLP,RF,SVM,HHO-MLP and WOA-MLP are 0.953,0.933,0.937,0.991 and 0.972,respectively.R^(2) of HHO-MLP is 0.998,which achieved the best performance among all five machine learning(ML) models.

Identification of low-resistivity-low-contrast pay zones in the feature space with a multi-layer perceptron based on conventional well log data

In the early exploration of many oilfields,low-resistivity-low-contrast(LRLC)pay zones are easily overlooked due to the resistivity similarity to the water zones.Existing identification methods are model-driven and cannot yield satisfactory results when the causes of LRLC pay zones are complicated.In this study,after analyzing a large number of core samples,main causes of LRLC pay zones in the study area are discerned,which include complex distribution of formation water salinity,high irreducible water saturation due to micropores,and high shale volume.Moreover,different oil testing layers may have different causes of LRLC pay zones.As a result,in addition to the well log data of oil testing layers,well log data of adjacent shale layers are also added to the original dataset as reference data.The densitybased spatial clustering algorithm with noise(DBSCAN)is used to cluster the original dataset into 49 clusters.A new dataset is ultimately projected into a feature space with 49 dimensions.The new dataset and oil testing results are respectively treated as input and output to train the multi-layer perceptron(MLP).A total of 3192 samples are used for stratified 8-fold cross-validation,and the accuracy of the MLP is found to be 85.53%.

Prediction of Logistics Demand via Least Square Method and Multi-Layer Perceptron

To implement the prediction of the logistics demand capacity of a certain region,a comprehensive index system is constructed,which is composed of freight volume and other eight relevant economic indices,such as gross domestic product(GDP),consumer price index(CPI),total import and export volume,port's cargo throughput,total retail sales of consumer goods,total fixed asset investment,highway mileage,and resident population,to form the foundation for the model calculation.Based on the least square method(LSM)to fit the parameters,the study obtains an accurate mathematical model and predicts the changes of each index in the next five years.Using artificial intelligence software,the research establishes the logistics demand model of multi-layer perceptron(MLP)neural network,makes an empirical analysis on the logistics demand of Quanzhou City,and predicts its logistics demand in the next five years,which provides some references for formulating logistics planning and development strategy.