A New Speed Limit Recognition Methodology Based on Ensemble Learning:Hardware Validation

Advanced DriverAssistance Systems(ADAS)technologies can assist drivers or be part of automatic driving systems to support the driving process and improve the level of safety and comfort on the road.Traffic Sign Recognition System(TSRS)is one of themost important components ofADAS.Among the challengeswith TSRS is being able to recognize road signs with the highest accuracy and the shortest processing time.Accordingly,this paper introduces a new real time methodology recognizing Speed Limit Signs based on a trio of developed modules.Firstly,the Speed Limit Detection(SLD)module uses the Haar Cascade technique to generate a new SL detector in order to localize SL signs within captured frames.Secondly,the Speed Limit Classification(SLC)module,featuring machine learning classifiers alongside a newly developed model called DeepSL,harnesses the power of a CNN architecture to extract intricate features from speed limit sign images,ensuring efficient and precise recognition.In addition,a new Speed Limit Classifiers Fusion(SLCF)module has been developed by combining trained ML classifiers and the DeepSL model by using the Dempster-Shafer theory of belief functions and ensemble learning’s voting technique.Through rigorous software and hardware validation processes,the proposedmethodology has achieved highly significant F1 scores of 99.98%and 99.96%for DS theory and the votingmethod,respectively.Furthermore,a prototype encompassing all components demonstrates outstanding reliability and efficacy,with processing times of 150 ms for the Raspberry Pi board and 81.5 ms for the Nano Jetson board,marking a significant advancement in TSRS technology.

Vibration properties of Paulownia wood for Ruan sound quality using machine learning methods

As an important material for manufacturing resonant components of musical instruments,Paulownia has an important influence on the sound quality of Ruan.In this paper,a model for evaluating the sound quality of Ruan based on the vibration characteristics of wood is developed using machine learning methods.Generally,the selection of materials for Ruan manufacturing relies primarily on manually weighing,observing,striking,and listening by the instrument technician.Deficiencies in scientific theory have hindered the quality of the finished Ruan.In this study,nine Ruans were manufactured,and a prediction model of Ruan sound quality was proposed based on the raw material information of Ruans.Out of a total of 180 data sets,145 and 45 sets were chosen for training and validation,respec-tively.In this paper,typical correlation analysis was used to determine the correlation between two single indicators in two adjacent pairwise combinations of the measured objects in each stage of the production process in Ruan.The vibra-tion characteristics of the wood were tested,and a model for predicting the evaluation of Ruan’s acoustic qualities was developed by measuring the vibration characteristics of the resonating plate material.The acoustic quality of the Ruan sound board wood was evaluated and predicted using machine learning model generalized regression neural net-work.The results show that the prediction of Ruan sound quality can be achieved using Matlab simulation based on the vibration characteristics of the soundboard wood.When the model-predicted values were compared with the tradi-tional predicted results,it was found that the generalized regression neural network had good performance,achieving an accuracy of 93.8%which was highly consistent with the experimental results.It was concluded that the model can accurately predict the acoustic quality of the Ruan based on the vibration performance of the soundboards.

A Deep Learning Approach to Shape Optimization Problems for Flexoelectric Materials Using the Isogeometric Finite Element Method

A new approach for flexoelectricmaterial shape optimization is proposed in this study.In this work,a proxymodel based on artificial neural network(ANN)is used to solve the parameter optimization and shape optimization problems.To improve the fitting ability of the neural network,we use the idea of pre-training to determine the structure of the neural network and combine different optimizers for training.The isogeometric analysis-finite element method(IGA-FEM)is used to discretize the flexural theoretical formulas and obtain samples,which helps ANN to build a proxy model from the model shape to the target value.The effectiveness of the proposed method is verified through two numerical examples of parameter optimization and one numerical example of shape optimization.

Production Capacity Prediction Method of Shale Oil Based on Machine Learning Combination Model

The production capacity of shale oil reservoirs after hydraulic fracturing is influenced by a complex interplay involving geological characteristics,engineering quality,and well conditions.These relationships,nonlinear in nature,pose challenges for accurate description through physical models.While field data provides insights into real-world effects,its limited volume and quality restrict its utility.Complementing this,numerical simulation models offer effective support.To harness the strengths of both data-driven and model-driven approaches,this study established a shale oil production capacity prediction model based on a machine learning combination model.Leveraging fracturing development data from 236 wells in the field,a data-driven method employing the random forest algorithm is implemented to identify the main controlling factors for different types of shale oil reservoirs.Through the combination model integrating support vector machine(SVM)algorithm and back propagation neural network(BPNN),a model-driven shale oil production capacity prediction model is developed,capable of swiftly responding to shale oil development performance under varying geological,fluid,and well conditions.The results of numerical experiments show that the proposed method demonstrates a notable enhancement in R2 by 22.5%and 5.8%compared to singular machine learning models like SVM and BPNN,showcasing its superior precision in predicting shale oil production capacity across diverse datasets.

A Study on Effective Methods of English Vocabulary Learning

English is a key subject in high school that troubles many students,especially in the aspect of vocabulary learning.Only by laying a good vocabulary foundation can students better complete the learning tasks such as reading,writing,listening,and speaking training.This paper aims to explain the importance of improving the efficiency of English vocabulary learning and discuss the effective methods of English vocabulary learning in high school,in order to help more students find their own learning methods,improve vocabulary memory and application skills,and lay a solid foundation for follow-up learning,examination,and even work.

The Effectiveness of Group Cooperative Learning Method in Badminton Teaching in Colleges and Universities

In college badminton teaching,teachers utilize the group cooperative learning method,which not only helps to improve students’badminton skill level but also cultivates their teamwork spirit,communication skills,and self-management ability unconsciously.In view of this,this paper mainly describes the significance of applying the group cooperative learning method in college badminton teaching,analyzes the current problems in college badminton teaching,and aims to discover effective development strategies for group cooperative learning method in college badminton teaching in order to improve the effectiveness of college badminton teaching.

Development of Inquiry-Based Learning Tourism Products in Binzhou from the Perspective of Tourism Resources

Under the macro-background of “all-for-one” tourism,this study analyzes the related concepts and characteristics of inquiry-based learning tourism to understand the significance and role of developing inquiry-based learning tourism in China.With Binzhou as the object of study,this study also explores the development of inquiry-based learning tourism products from the aspects of the product development idea,level,framework and marketing,with a view to providing references for implementing inquiry-based learning tourism activities in other regions.

The Effect of Inquiry-Based Learning Strategy on EFL Tenth-Grade Students’ Reading Comprehension

This study examined the potential effect of Inquiry-Based Learning Strategy(IBL)on the tenth-grade students’reading comprehension.Two groups and a quasi-experimental design were used.Two complete sections of grade 10 students from a public Secondary School for Girls in Irbid was randomly assigned by the researcher.The experimental group of 30 students was chosen first,and then the control group of 30 students.A pre-post reading comprehension test was designed before and after the study in order to fulfill its goals.Additionally,the experimental group was taught using the IBL strategy,whereas the control group was taught using the traditional teaching methods recommended in the tenth-grade Teacher’s Book.According to the findings,there were significant statistical differences favoring the experimental group over the control group.In light of the findings,the researcher recommended employing the IBL strategy to students with various levels and EFL skills.

XMAM:X-raying models with a matrix to reveal backdoor attacks for federated learning

Federated Learning(FL),a burgeoning technology,has received increasing attention due to its privacy protection capability.However,the base algorithm FedAvg is vulnerable when it suffers from so-called backdoor attacks.Former researchers proposed several robust aggregation methods.Unfortunately,due to the hidden characteristic of backdoor attacks,many of these aggregation methods are unable to defend against backdoor attacks.What's more,the attackers recently have proposed some hiding methods that further improve backdoor attacks'stealthiness,making all the existing robust aggregation methods fail.To tackle the threat of backdoor attacks,we propose a new aggregation method,X-raying Models with A Matrix(XMAM),to reveal the malicious local model updates submitted by the backdoor attackers.Since we observe that the output of the Softmax layer exhibits distinguishable patterns between malicious and benign updates,unlike the existing aggregation algorithms,we focus on the Softmax layer's output in which the backdoor attackers are difficult to hide their malicious behavior.Specifically,like medical X-ray examinations,we investigate the collected local model updates by using a matrix as an input to get their Softmax layer's outputs.Then,we preclude updates whose outputs are abnormal by clustering.Without any training dataset in the server,the extensive evaluations show that our XMAM can effectively distinguish malicious local model updates from benign ones.For instance,when other methods fail to defend against the backdoor attacks at no more than 20%malicious clients,our method can tolerate 45%malicious clients in the black-box mode and about 30%in Projected Gradient Descent(PGD)mode.Besides,under adaptive attacks,the results demonstrate that XMAM can still complete the global model training task even when there are 40%malicious clients.Finally,we analyze our method's screening complexity and compare the real screening time with other methods.The results show that XMAM is about 10–10000 times faster than the existing methods.

The State-of-the-Art Review on Applications of Intrusive Sensing,Image Processing Techniques,and Machine Learning Methods in Pavement Monitoring and Analysis

In modern transportation,pavement is one of the most important civil infrastructures for the movement of vehicles and pedestrians.Pavement service quality and service life are of great importance for civil engineers as they directly affect the regular service for the users.Therefore,monitoring the health status of pavement before irreversible damage occurs is essential for timely maintenance,which in turn ensures public transportation safety.Many pavement damages can be detected and analyzed by monitoring the structure dynamic responses and evaluating road surface conditions.Advanced technologies can be employed for the collection and analysis of such data,including various intrusive sensing techniques,image processing techniques,and machine learning methods.This review summarizes the state-ofthe-art of these three technologies in pavement engineering in recent years and suggests possible developments for future pavement monitoring and analysis based on these approaches.

A liquid loading prediction method of gas pipeline based on machine learning

The liquid loading is one of the most frequently encountered phenomena in the transportation of gas pipeline,reducing the transmission efficiency and threatening the flow assurance.However,most of the traditional mechanism models are semi-empirical models,and have to be resolved under different working conditions with complex calculation process.The development of big data technology and artificial intelligence provides the possibility to establish data-driven models.This paper aims to establish a liquid loading prediction model for natural gas pipeline with high generalization ability based on machine learning.First,according to the characteristics of actual gas pipeline,a variety of reasonable combinations of working conditions such as different gas velocity,pipe diameters,water contents and outlet pressures were set,and multiple undulating pipeline topography with different elevation differences was established.Then a large number of simulations were performed by simulator OLGA to obtain the data required for machine learning.After data preprocessing,six supervised learning algorithms,including support vector machine(SVM),decision tree(DT),random forest(RF),artificial neural network(ANN),plain Bayesian classification(NBC),and K nearest neighbor algorithm(KNN),were compared to evaluate the performance of liquid loading prediction.Finally,the RF and KNN with better performance were selected for parameter tuning and then used to the actual pipeline for liquid loading location prediction.Compared with OLGA simulation,the established data-driven model not only improves calculation efficiency and reduces workload,but also can provide technical support for gas pipeline flow assurance.

Soliton, breather, and rogue wave solutions for solving the nonlinear Schrodinger equation using a deep learning method with physical constraints

The nonlinear Schrodinger equation is a classical integrable equation which contains plenty of significant properties and occurs in many physical areas.However,due to the difficulty of solving this equation,in particular in high dimensions,lots of methods are proposed to effectively obtain different kinds of solutions,such as neural networks among others.Recently,a method where some underlying physical laws are embeded into a conventional neural network is proposed to uncover the equation’s dynamical behaviors from spatiotemporal data directly.Compared with traditional neural networks,this method can obtain remarkably accurate solution with extraordinarily less data.Meanwhile,this method also provides a better physical explanation and generalization.In this paper,based on the above method,we present an improved deep learning method to recover the soliton solutions,breather solution,and rogue wave solutions of the nonlinear Schrodinger equation.In particular,the dynamical behaviors and error analysis about the one-order and two-order rogue waves of nonlinear integrable equations are revealed by the deep neural network with physical constraints for the first time.Moreover,the effects of different numbers of initial points sampled,collocation points sampled,network layers,neurons per hidden layer on the one-order rogue wave dynamics of this equation have been considered with the help of the control variable way under the same initial and boundary conditions.Numerical experiments show that the dynamical behaviors of soliton solutions,breather solution,and rogue wave solutions of the integrable nonlinear Schrodinger equation can be well reconstructed by utilizing this physically-constrained deep learning method.

A systematic machine learning method for reservoir identification and production prediction

Reservoir identification and production prediction are two of the most important tasks in petroleum exploration and development.Machine learning(ML)methods are used for petroleum-related studies,but have not been applied to reservoir identification and production prediction based on reservoir identification.Production forecasting studies are typically based on overall reservoir thickness and lack accuracy when reservoirs contain a water or dry layer without oil production.In this paper,a systematic ML method was developed using classification models for reservoir identification,and regression models for production prediction.The production models are based on the reservoir identification results.To realize the reservoir identification,seven optimized ML methods were used:four typical single ML methods and three ensemble ML methods.These methods classify the reservoir into five types of layers:water,dry and three levels of oil(I oil layer,II oil layer,III oil layer).The validation and test results of these seven optimized ML methods suggest the three ensemble methods perform better than the four single ML methods in reservoir identification.The XGBoost produced the model with the highest accuracy;up to 99%.The effective thickness of I and II oil layers determined during the reservoir identification was fed into the models for predicting production.Effective thickness considers the distribution of the water and the oil resulting in a more reasonable production prediction compared to predictions based on the overall reservoir thickness.To validate the superiority of the ML methods,reference models using overall reservoir thickness were built for comparison.The models based on effective thickness outperformed the reference models in every evaluation metric.The prediction accuracy of the ML models using effective thickness were 10%higher than that of reference model.Without the personal error or data distortion existing in traditional methods,this novel system realizes rapid analysis of data while reducing the time required to resolve reservoir classification and production prediction challenges.The ML models using the effective thickness obtained from reservoir identification were more accurate when predicting oil production compared to previous studies which use overall reservoir thickness.

Model Change Active Learning in Graph-Based Semi-supervised Learning

Active learning in semi-supervised classification involves introducing additional labels for unlabelled data to improve the accuracy of the underlying classifier.A challenge is to identify which points to label to best improve performance while limiting the number of new labels."Model Change"active learning quantifies the resulting change incurred in the classifier by introducing the additional label(s).We pair this idea with graph-based semi-supervised learning(SSL)methods,that use the spectrum of the graph Laplacian matrix,which can be truncated to avoid prohibitively large computational and storage costs.We consider a family of convex loss functions for which the acquisition function can be efficiently approximated using the Laplace approximation of the posterior distribution.We show a variety of multiclass examples that illustrate improved performance over prior state-of-art.

Machine learning models for the density and heat capacity of ionic liquid-water binary mixtures

Ionic liquids(ILs),because of the advantages of low volatility,good thermal stability,high gas solubility and easy recovery,can be regarded as the green substitute for traditional solvent.However,the high viscosity and synthesis cost limits their application,the hybrid solvent which combining ILs together with others especially water can solve this problem.Compared with the pure IL systems,the study of the ILs-H_(2)O binary system is rare,and the experimental data of corresponding thermodynamic properties(such as density,heat capacity,etc.)are less.Moreover,it is also difficult to obtain all the data through experiments.Therefore,this work establishes a predicted model on ILs-water binary systems based on the group contribution(GC)method.Three different machine learning algorithms(ANN,XGBoost,LightBGM)are applied to fit the density and heat capacity of ILs-water binary systems.And then the three models are compared by two index of MAE and R^(2).The results show that the ANN-GC model has the best prediction effect on the density and heat capacity of ionic liquid-water mixed system.Furthermore,the Shapley additive explanations(SHAP)method is harnessed to scrutinize the significance of each structure and parameter within the ANN-GC model in relation to prediction outcomes.The results reveal that system components(XIL)within the ILs-H_(2)O binary system exert the most substantial influence on density,while for the heat capacity,the substituents on the cation exhibit the greatest impact.This study not only introduces a robust prediction model for the density and heat capacity properties of IL-H_(2)O binary mixtures but also provides insight into the influence of mixture features on its density and heat capacity.

Accurate machine learning models based on small dataset of energetic materials through spatial matrix featurization methods

A large database is desired for machine learning(ML) technology to make accurate predictions of materials physicochemical properties based on their molecular structure.When a large database is not available,the development of proper featurization method based on physicochemical nature of target proprieties can improve the predictive power of ML models with a smaller database.In this work,we show that two new featurization methods,volume occupation spatial matrix and heat contribution spatial matrix,can improve the accuracy in predicting energetic materials' crystal density(ρ_(crystal)) and solid phase enthalpy of formation(H_(f,solid)) using a database containing 451 energetic molecules.Their mean absolute errors are reduced from 0.048 g/cm~3 and 24.67 kcal/mol to 0.035 g/cm~3 and 9.66 kcal/mol,respectively.By leave-one-out-cross-validation,the newly developed ML models can be used to determine the performance of most kinds of energetic materials except cubanes.Our ML models are applied to predict ρ_(crystal) and H_(f,solid) of CHON-based molecules of the 150 million sized PubChem database,and screened out 56 candidates with competitive detonation performance and reasonable chemical structures.With further improvement in future,spatial matrices have the potential of becoming multifunctional ML simulation tools that could provide even better predictions in wider fields of materials science.

Bayesian machine learning-based method for prediction of slope failure time

The data-driven phenomenological models based on deformation measurements have been widely utilized to predict the slope failure time(SFT).The observational and model uncertainties could lead the predicted SFT calculated from the phenomenological models to deviate from the actual SFT.Currently,very limited study has been conducted on how to evaluate the effect of such uncertainties on SFT prediction.In this paper,a comprehensive slope failure database was compiled.A Bayesian machine learning(BML)-based method was developed to learn the model and observational uncertainties involved in SFT prediction,through which the probabilistic distribution of the SFT can be obtained.This method was illustrated in detail with an example.Verification studies show that the BML-based method is superior to the traditional inverse velocity method(INVM)and the maximum likelihood method for predicting SFT.The proposed method in this study provides an effective tool for SFT prediction.

A Real-time Prediction System for Molecular-level Information of Heavy Oil Based on Machine Learning

Acquiring accurate molecular-level information about petroleum is crucial for refining and chemical enterprises to implement the“selection of the optimal processing route”strategy.With the development of data prediction systems represented by machine learning,it has become possible for real-time prediction systems of petroleum fraction molecular information to replace analyses such as gas chromatography and mass spectrometry.However,the biggest difficulty lies in acquiring the data required for training the neural network.To address these issues,this work proposes an innovative method that utilizes the Aspen HYSYS and full two-dimensional gas chromatography-time-of-flight mass spectrometry to establish a comprehensive training database.Subsequently,a deep neural network prediction model is developed for heavy distillate oil to predict its composition in terms of molecular structure.After training,the model accurately predicts the molecular composition of catalytically cracked raw oil in a refinery.The validation and test sets exhibit R2 values of 0.99769 and 0.99807,respectively,and the average relative error of molecular composition prediction for raw materials of the catalytic cracking unit is less than 7%.Finally,the SHAP(SHapley Additive ExPlanation)interpretation method is used to disclose the relationship among different variables by performing global and local weight comparisons and correlation analyses.

Comprehensive analysis of multiple machine learning techniques for rock slope failure prediction

In this study,twelve machine learning(ML)techniques are used to accurately estimate the safety factor of rock slopes(SFRS).The dataset used for developing these models consists of 344 rock slopes from various open-pit mines around Iran,evenly distributed between the training(80%)and testing(20%)datasets.The models are evaluated for accuracy using Janbu's limit equilibrium method(LEM)and commercial tool GeoStudio methods.Statistical assessment metrics show that the random forest model is the most accurate in estimating the SFRS(MSE=0.0182,R2=0.8319)and shows high agreement with the results from the LEM method.The results from the long-short-term memory(LSTM)model are the least accurate(MSE=0.037,R2=0.6618)of all the models tested.However,only the null space support vector regression(NuSVR)model performs accurately compared to the practice mode by altering the value of one parameter while maintaining the other parameters constant.It is suggested that this model would be the best one to use to calculate the SFRS.A graphical user interface for the proposed models is developed to further assist in the calculation of the SFRS for engineering difficulties.In this study,we attempt to bridge the gap between modern slope stability evaluation techniques and more conventional analysis methods.

Machine Learning Enhanced Boundary Element Method:Prediction of Gaussian Quadrature Points

This paper applies a machine learning technique to find a general and efficient numerical integration scheme for boundary element methods.A model based on the neural network multi-classification algorithmis constructed to find the minimum number of Gaussian quadrature points satisfying the given accuracy.The constructed model is trained by using a large amount of data calculated in the traditional boundary element method and the optimal network architecture is selected.The two-dimensional potential problem of a circular structure is tested and analyzed based on the determined model,and the accuracy of the model is about 90%.Finally,by incorporating the predicted Gaussian quadrature points into the boundary element analysis,we find that the numerical solution and the analytical solution are in good agreement,which verifies the robustness of the proposed method.