A New Speed Limit Recognition Methodology Based on Ensemble Learning:Hardware Validation

Advanced DriverAssistance Systems(ADAS)technologies can assist drivers or be part of automatic driving systems to support the driving process and improve the level of safety and comfort on the road.Traffic Sign Recognition System(TSRS)is one of themost important components ofADAS.Among the challengeswith TSRS is being able to recognize road signs with the highest accuracy and the shortest processing time.Accordingly,this paper introduces a new real time methodology recognizing Speed Limit Signs based on a trio of developed modules.Firstly,the Speed Limit Detection(SLD)module uses the Haar Cascade technique to generate a new SL detector in order to localize SL signs within captured frames.Secondly,the Speed Limit Classification(SLC)module,featuring machine learning classifiers alongside a newly developed model called DeepSL,harnesses the power of a CNN architecture to extract intricate features from speed limit sign images,ensuring efficient and precise recognition.In addition,a new Speed Limit Classifiers Fusion(SLCF)module has been developed by combining trained ML classifiers and the DeepSL model by using the Dempster-Shafer theory of belief functions and ensemble learning’s voting technique.Through rigorous software and hardware validation processes,the proposedmethodology has achieved highly significant F1 scores of 99.98%and 99.96%for DS theory and the votingmethod,respectively.Furthermore,a prototype encompassing all components demonstrates outstanding reliability and efficacy,with processing times of 150 ms for the Raspberry Pi board and 81.5 ms for the Nano Jetson board,marking a significant advancement in TSRS technology.

Vibration properties of Paulownia wood for Ruan sound quality using machine learning methods

As an important material for manufacturing resonant components of musical instruments,Paulownia has an important influence on the sound quality of Ruan.In this paper,a model for evaluating the sound quality of Ruan based on the vibration characteristics of wood is developed using machine learning methods.Generally,the selection of materials for Ruan manufacturing relies primarily on manually weighing,observing,striking,and listening by the instrument technician.Deficiencies in scientific theory have hindered the quality of the finished Ruan.In this study,nine Ruans were manufactured,and a prediction model of Ruan sound quality was proposed based on the raw material information of Ruans.Out of a total of 180 data sets,145 and 45 sets were chosen for training and validation,respec-tively.In this paper,typical correlation analysis was used to determine the correlation between two single indicators in two adjacent pairwise combinations of the measured objects in each stage of the production process in Ruan.The vibra-tion characteristics of the wood were tested,and a model for predicting the evaluation of Ruan’s acoustic qualities was developed by measuring the vibration characteristics of the resonating plate material.The acoustic quality of the Ruan sound board wood was evaluated and predicted using machine learning model generalized regression neural net-work.The results show that the prediction of Ruan sound quality can be achieved using Matlab simulation based on the vibration characteristics of the soundboard wood.When the model-predicted values were compared with the tradi-tional predicted results,it was found that the generalized regression neural network had good performance,achieving an accuracy of 93.8%which was highly consistent with the experimental results.It was concluded that the model can accurately predict the acoustic quality of the Ruan based on the vibration performance of the soundboards.

A Deep Learning Approach to Shape Optimization Problems for Flexoelectric Materials Using the Isogeometric Finite Element Method

A new approach for flexoelectricmaterial shape optimization is proposed in this study.In this work,a proxymodel based on artificial neural network(ANN)is used to solve the parameter optimization and shape optimization problems.To improve the fitting ability of the neural network,we use the idea of pre-training to determine the structure of the neural network and combine different optimizers for training.The isogeometric analysis-finite element method(IGA-FEM)is used to discretize the flexural theoretical formulas and obtain samples,which helps ANN to build a proxy model from the model shape to the target value.The effectiveness of the proposed method is verified through two numerical examples of parameter optimization and one numerical example of shape optimization.

Production Capacity Prediction Method of Shale Oil Based on Machine Learning Combination Model

The production capacity of shale oil reservoirs after hydraulic fracturing is influenced by a complex interplay involving geological characteristics,engineering quality,and well conditions.These relationships,nonlinear in nature,pose challenges for accurate description through physical models.While field data provides insights into real-world effects,its limited volume and quality restrict its utility.Complementing this,numerical simulation models offer effective support.To harness the strengths of both data-driven and model-driven approaches,this study established a shale oil production capacity prediction model based on a machine learning combination model.Leveraging fracturing development data from 236 wells in the field,a data-driven method employing the random forest algorithm is implemented to identify the main controlling factors for different types of shale oil reservoirs.Through the combination model integrating support vector machine(SVM)algorithm and back propagation neural network(BPNN),a model-driven shale oil production capacity prediction model is developed,capable of swiftly responding to shale oil development performance under varying geological,fluid,and well conditions.The results of numerical experiments show that the proposed method demonstrates a notable enhancement in R2 by 22.5%and 5.8%compared to singular machine learning models like SVM and BPNN,showcasing its superior precision in predicting shale oil production capacity across diverse datasets.

A Study on Effective Methods of English Vocabulary Learning

English is a key subject in high school that troubles many students,especially in the aspect of vocabulary learning.Only by laying a good vocabulary foundation can students better complete the learning tasks such as reading,writing,listening,and speaking training.This paper aims to explain the importance of improving the efficiency of English vocabulary learning and discuss the effective methods of English vocabulary learning in high school,in order to help more students find their own learning methods,improve vocabulary memory and application skills,and lay a solid foundation for follow-up learning,examination,and even work.

The Effectiveness of Group Cooperative Learning Method in Badminton Teaching in Colleges and Universities

In college badminton teaching,teachers utilize the group cooperative learning method,which not only helps to improve students’badminton skill level but also cultivates their teamwork spirit,communication skills,and self-management ability unconsciously.In view of this,this paper mainly describes the significance of applying the group cooperative learning method in college badminton teaching,analyzes the current problems in college badminton teaching,and aims to discover effective development strategies for group cooperative learning method in college badminton teaching in order to improve the effectiveness of college badminton teaching.

A new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning

In this paper,a new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning is presented in this paper.The existence of nonlinear terms in the studied system makes it very difficult to design the optimal controller using traditional methods.To achieve optimal control,RL algorithm based on critic–actor architecture is considered for the nonlinear system.Due to the significant security risks of network transmission,the system is vulnerable to deception attacks,which can make all the system state unavailable.By using the attacked states to design coordinate transformation,the harm brought by unknown deception attacks has been overcome.The presented control strategy can ensure that all signals in the closed-loop system are semi-globally ultimately bounded.Finally,the simulation experiment is shown to prove the effectiveness of the strategy.

The State-of-the-Art Review on Applications of Intrusive Sensing,Image Processing Techniques,and Machine Learning Methods in Pavement Monitoring and Analysis

In modern transportation,pavement is one of the most important civil infrastructures for the movement of vehicles and pedestrians.Pavement service quality and service life are of great importance for civil engineers as they directly affect the regular service for the users.Therefore,monitoring the health status of pavement before irreversible damage occurs is essential for timely maintenance,which in turn ensures public transportation safety.Many pavement damages can be detected and analyzed by monitoring the structure dynamic responses and evaluating road surface conditions.Advanced technologies can be employed for the collection and analysis of such data,including various intrusive sensing techniques,image processing techniques,and machine learning methods.This review summarizes the state-ofthe-art of these three technologies in pavement engineering in recent years and suggests possible developments for future pavement monitoring and analysis based on these approaches.

Soliton, breather, and rogue wave solutions for solving the nonlinear Schrodinger equation using a deep learning method with physical constraints

The nonlinear Schrodinger equation is a classical integrable equation which contains plenty of significant properties and occurs in many physical areas.However,due to the difficulty of solving this equation,in particular in high dimensions,lots of methods are proposed to effectively obtain different kinds of solutions,such as neural networks among others.Recently,a method where some underlying physical laws are embeded into a conventional neural network is proposed to uncover the equation’s dynamical behaviors from spatiotemporal data directly.Compared with traditional neural networks,this method can obtain remarkably accurate solution with extraordinarily less data.Meanwhile,this method also provides a better physical explanation and generalization.In this paper,based on the above method,we present an improved deep learning method to recover the soliton solutions,breather solution,and rogue wave solutions of the nonlinear Schrodinger equation.In particular,the dynamical behaviors and error analysis about the one-order and two-order rogue waves of nonlinear integrable equations are revealed by the deep neural network with physical constraints for the first time.Moreover,the effects of different numbers of initial points sampled,collocation points sampled,network layers,neurons per hidden layer on the one-order rogue wave dynamics of this equation have been considered with the help of the control variable way under the same initial and boundary conditions.Numerical experiments show that the dynamical behaviors of soliton solutions,breather solution,and rogue wave solutions of the integrable nonlinear Schrodinger equation can be well reconstructed by utilizing this physically-constrained deep learning method.

Accurate machine learning models based on small dataset of energetic materials through spatial matrix featurization methods

A large database is desired for machine learning(ML) technology to make accurate predictions of materials physicochemical properties based on their molecular structure.When a large database is not available,the development of proper featurization method based on physicochemical nature of target proprieties can improve the predictive power of ML models with a smaller database.In this work,we show that two new featurization methods,volume occupation spatial matrix and heat contribution spatial matrix,can improve the accuracy in predicting energetic materials' crystal density(ρ_(crystal)) and solid phase enthalpy of formation(H_(f,solid)) using a database containing 451 energetic molecules.Their mean absolute errors are reduced from 0.048 g/cm~3 and 24.67 kcal/mol to 0.035 g/cm~3 and 9.66 kcal/mol,respectively.By leave-one-out-cross-validation,the newly developed ML models can be used to determine the performance of most kinds of energetic materials except cubanes.Our ML models are applied to predict ρ_(crystal) and H_(f,solid) of CHON-based molecules of the 150 million sized PubChem database,and screened out 56 candidates with competitive detonation performance and reasonable chemical structures.With further improvement in future,spatial matrices have the potential of becoming multifunctional ML simulation tools that could provide even better predictions in wider fields of materials science.

A liquid loading prediction method of gas pipeline based on machine learning

The liquid loading is one of the most frequently encountered phenomena in the transportation of gas pipeline,reducing the transmission efficiency and threatening the flow assurance.However,most of the traditional mechanism models are semi-empirical models,and have to be resolved under different working conditions with complex calculation process.The development of big data technology and artificial intelligence provides the possibility to establish data-driven models.This paper aims to establish a liquid loading prediction model for natural gas pipeline with high generalization ability based on machine learning.First,according to the characteristics of actual gas pipeline,a variety of reasonable combinations of working conditions such as different gas velocity,pipe diameters,water contents and outlet pressures were set,and multiple undulating pipeline topography with different elevation differences was established.Then a large number of simulations were performed by simulator OLGA to obtain the data required for machine learning.After data preprocessing,six supervised learning algorithms,including support vector machine(SVM),decision tree(DT),random forest(RF),artificial neural network(ANN),plain Bayesian classification(NBC),and K nearest neighbor algorithm(KNN),were compared to evaluate the performance of liquid loading prediction.Finally,the RF and KNN with better performance were selected for parameter tuning and then used to the actual pipeline for liquid loading location prediction.Compared with OLGA simulation,the established data-driven model not only improves calculation efficiency and reduces workload,but also can provide technical support for gas pipeline flow assurance.

Bayesian machine learning-based method for prediction of slope failure time

The data-driven phenomenological models based on deformation measurements have been widely utilized to predict the slope failure time(SFT).The observational and model uncertainties could lead the predicted SFT calculated from the phenomenological models to deviate from the actual SFT.Currently,very limited study has been conducted on how to evaluate the effect of such uncertainties on SFT prediction.In this paper,a comprehensive slope failure database was compiled.A Bayesian machine learning(BML)-based method was developed to learn the model and observational uncertainties involved in SFT prediction,through which the probabilistic distribution of the SFT can be obtained.This method was illustrated in detail with an example.Verification studies show that the BML-based method is superior to the traditional inverse velocity method(INVM)and the maximum likelihood method for predicting SFT.The proposed method in this study provides an effective tool for SFT prediction.

A systematic machine learning method for reservoir identification and production prediction

Reservoir identification and production prediction are two of the most important tasks in petroleum exploration and development.Machine learning(ML)methods are used for petroleum-related studies,but have not been applied to reservoir identification and production prediction based on reservoir identification.Production forecasting studies are typically based on overall reservoir thickness and lack accuracy when reservoirs contain a water or dry layer without oil production.In this paper,a systematic ML method was developed using classification models for reservoir identification,and regression models for production prediction.The production models are based on the reservoir identification results.To realize the reservoir identification,seven optimized ML methods were used:four typical single ML methods and three ensemble ML methods.These methods classify the reservoir into five types of layers:water,dry and three levels of oil(I oil layer,II oil layer,III oil layer).The validation and test results of these seven optimized ML methods suggest the three ensemble methods perform better than the four single ML methods in reservoir identification.The XGBoost produced the model with the highest accuracy;up to 99%.The effective thickness of I and II oil layers determined during the reservoir identification was fed into the models for predicting production.Effective thickness considers the distribution of the water and the oil resulting in a more reasonable production prediction compared to predictions based on the overall reservoir thickness.To validate the superiority of the ML methods,reference models using overall reservoir thickness were built for comparison.The models based on effective thickness outperformed the reference models in every evaluation metric.The prediction accuracy of the ML models using effective thickness were 10%higher than that of reference model.Without the personal error or data distortion existing in traditional methods,this novel system realizes rapid analysis of data while reducing the time required to resolve reservoir classification and production prediction challenges.The ML models using the effective thickness obtained from reservoir identification were more accurate when predicting oil production compared to previous studies which use overall reservoir thickness.

Machine Learning Enhanced Boundary Element Method:Prediction of Gaussian Quadrature Points

This paper applies a machine learning technique to find a general and efficient numerical integration scheme for boundary element methods.A model based on the neural network multi-classification algorithmis constructed to find the minimum number of Gaussian quadrature points satisfying the given accuracy.The constructed model is trained by using a large amount of data calculated in the traditional boundary element method and the optimal network architecture is selected.The two-dimensional potential problem of a circular structure is tested and analyzed based on the determined model,and the accuracy of the model is about 90%.Finally,by incorporating the predicted Gaussian quadrature points into the boundary element analysis,we find that the numerical solution and the analytical solution are in good agreement,which verifies the robustness of the proposed method.

Machine Learning to Instruct Single Crystal Growth by Flux Method

Growth of high-quality single crystals is of great significance for research of condensed matter physics. The exploration of suitable growing conditions for single crystals is expensive and time-consuming, especially for ternary compounds because of the lack of ternary phase diagram. Here we use machine learning(ML) trained on our experimental data to predict and instruct the growth. Four kinds of ML methods, including support vector machine(SVM), decision tree, random forest and gradient boosting decision tree, are adopted. The SVM method is relatively stable and works well, with an accuracy of 81% in predicting experimental results. By comparison,the accuracy of laboratory reaches 36%. The decision tree model is also used to reveal which features will take critical roles in growing processes.

Real-time determination of sandy soil stiffness during vibratory compaction incorporating machine learning method for intelligent compaction

An emerging real-time ground compaction and quality control, known as intelligent compaction(IC), has been applied for efficiently optimising the full-area compaction. Although IC technology can provide real-time assessment of uniformity of the compacted area, accurate determination of the soil stiffness required for quality control and design remains challenging. In this paper, a novel and advanced numerical model simulating the interaction of vibratory drum and soil beneath is developed. The model is capable of evaluating the nonlinear behaviour of underlying soil subjected to dynamic loading by capturing the variations of damping with the cyclic shear strains and degradation of soil modulus. The interaction of the drum and the soil is simulated via the finite element method to develop a comprehensive dataset capturing the dynamic responses of the drum and the soil. Indeed, more than a thousand three-dimensional(3D) numerical models covering various soil characteristics, roller weights, vibration amplitudes and frequencies were adopted. The developed dataset is then used to train the inverse solver using an innovative machine learning approach, i.e. the extended support vector regression, to simulate the stiffness of the compacted soil by adopting drum acceleration records. Furthermore, the impacts of the amplitude and frequency of the vibration on the level of underlying soil compaction are discussed.The proposed machine learning approach is promising for real-time extraction of actual soil stiffness during compaction. Results of the study can be employed by practising engineers to interpret roller drum acceleration data to estimate the level of compaction and ground stiffness during compaction.

Enhancing Parkinson’s Disease Prediction Using Machine Learning and Feature Selection Methods

Several millions of people suffer from Parkinson’s disease globally.Parkinson’s affects about 1%of people over 60 and its symptoms increase with age.The voice may be affected and patients experience abnormalities in speech that might not be noticed by listeners,but which could be analyzed using recorded speech signals.With the huge advancements of technology,the medical data has increased dramatically,and therefore,there is a need to apply data mining and machine learning methods to extract new knowledge from this data.Several classification methods were used to analyze medical data sets and diagnostic problems,such as Parkinson’s Disease(PD).In addition,to improve the performance of classification,feature selection methods have been extensively used in many fields.This paper aims to propose a comprehensive approach to enhance the prediction of PD using several machine learning methods with different feature selection methods such as filter-based and wrapper-based.The dataset includes 240 recodes with 46 acoustic features extracted from3 voice recording replications for 80 patients.The experimental results showed improvements when wrapper-based features selection method was used with K-NN classifier with accuracy of 88.33%.The best obtained results were compared with other studies and it was found that this study provides comparable and superior results.

Least Squares Method from the View Point of Deep Learning

The least squares method is one of the most fundamental methods in Statistics to estimate correlations among various data. On the other hand, Deep Learning is the heart of Artificial Intelligence and it is a learning method based on the least squares. In this paper we reconsider the least squares method from the view point of Deep Learning and we carry out the computation thoroughly for the gradient descent sequence in a very simple setting. Depending on the values of the learning rate, an essential parameter of Deep Learning, the least squares methods of Statistics and Deep Learning reveal an interesting difference.

Least Squares Method from the View Point of Deep Learning II: Generalization

The least squares method is one of the most fundamental methods in Statistics to estimate correlations among various data. On the other hand, Deep Learning is the heart of Artificial Intelligence and it is a learning method based on the least squares method, in which a parameter called learning rate plays an important role. It is in general very hard to determine its value. In this paper we generalize the preceding paper [K. Fujii: Least squares method from the view point of Deep Learning: Advances in Pure Mathematics, 8, 485-493, 2018] and give an admissible value of the learning rate, which is easily obtained.

Constitutive modelling of idealised granular materials using machine learning method

Predicting the constitutive response of granular soils is a fundamental goal in geomechanics.This paper presents a machine learning(ML)framework for the prediction of the stress-strain behaviour and shearinduced contact fabric evolution of an idealised granular material subject to triaxial shearing.The MLbased framework is comprised of a set of mini-triaxial tests which provide a benchmark for the setup and validation of the discrete element method(DEM)model of the granular materials,a parametric DEM simulation programme of virtual triaxial tests which provides datasets of micro-and macro-mechanical information,as well as a multi-layer perceptron(MLP)neural network which is trained and tested using the DEM-based datasets.The ML model only requires the initial void ratio of the granular sample as the input for predicting its constitutive response.The excellent agreement between the ML model prediction and experimental test and DEM simulation results indicates that the MLebased modelling approach is capable of capturing accurately the effects of initial void ratio on the constitutive behaviour of idealised granular materials,bypassing the need to incorporate the complex micromechanics underlying the macroscopic mechanical behaviour of granular materials.Lastly,a detailed comparison between the used MLP model and long short-term memory(LSTM)model was made from the perspective of technical algorithm,prediction accuracy,and computational efficiency.