Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

GLOBAL SOLUTIONS TO 1D COMPRESSIBLE NAVIER-STOKES/ALLEN-CAHN SYSTEM WITH DENSITY-DEPENDENT VISCOSITY AND FREE-BOUNDARY

This paper is concerned with the Navier-Stokes/Allen-Cahn system,which is used to model the dynamics of immiscible two-phase flows.We consider a 1D free boundary problem and assume that the viscosity coefficient depends on the density in the form ofη(ρ)=ρ^(α).The existence of unique global H^(2m)-solutions(m∈N)to the free boundary problem is proven for when 0<α<1/4.Furthermore,we obtain the global C^(∞)-solutions if the initial data is smooth.

Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

Orientation and Decision-Making for Soccer Based on Sports Analytics and AI:A Systematic Review

Due to ever-growing soccer data collection approaches and progressing artificial intelligence(AI) methods, soccer analysis, evaluation, and decision-making have received increasing interest from not only the professional sports analytics realm but also the academic AI research community. AI brings gamechanging approaches for soccer analytics where soccer has been a typical benchmark for AI research. The combination has been an emerging topic. In this paper, soccer match analytics are taken as a complete observation-orientation-decision-action(OODA) loop.In addition, as in AI frameworks such as that for reinforcement learning, interacting with a virtual environment enables an evolving model. Therefore, both soccer analytics in the real world and virtual domains are discussed. With the intersection of the OODA loop and the real-virtual domains, available soccer data, including event and tracking data, and diverse orientation and decisionmaking models for both real-world and virtual soccer matches are comprehensively reviewed. Finally, some promising directions in this interdisciplinary area are pointed out. It is claimed that paradigms for both professional sports analytics and AI research could be combined. Moreover, it is quite promising to bridge the gap between the real and virtual domains for soccer match analysis and decision-making.

Localized wave solutions and interactions of the (2+1)-dimensional Hirota-Satsuma-Ito equation

This paper studies the(2+1)-dimensional Hirota-Satsuma-Ito equation.Based on an associated Hirota bilinear form,lump-type solution,two types of interaction solutions,and breather wave solution of the(2+1)-dimensional Hirota-Satsuma-Ito equation are obtained,which are all related to the seed solution of the equation.It is interesting that the rogue wave is aroused by the interaction between one-lump soliton and a pair of resonance stripe solitons,and the fusion and fission phenomena are also found in the interaction between lump solitons and one-stripe soliton.Furthermore,the breather wave solution is also obtained by reducing the two-soliton solutions.The trajectory and period of the one-order breather wave are analyzed.The corresponding dynamical characteristics are demonstrated by the graphs.

Ethical Decision-Making Framework Based on Incremental ILP Considering Conflicts

Humans are experiencing the inclusion of artificial agents in their lives,such as unmanned vehicles,service robots,voice assistants,and intelligent medical care.If the artificial agents cannot align with social values or make ethical decisions,they may not meet the expectations of humans.Traditionally,an ethical decision-making framework is constructed by rule-based or statistical approaches.In this paper,we propose an ethical decision-making framework based on incremental ILP(Inductive Logic Programming),which can overcome the brittleness of rule-based approaches and little interpretability of statistical approaches.As the current incremental ILP makes it difficult to solve conflicts,we propose a novel ethical decision-making framework considering conflicts in this paper,which adopts our proposed incremental ILP system.The framework consists of two processes:the learning process and the deduction process.The first process records bottom clauses with their score functions and learns rules guided by the entailment and the score function.The second process obtains an ethical decision based on the rules.In an ethical scenario about chatbots for teenagers’mental health,we verify that our framework can learn ethical rules and make ethical decisions.Besides,we extract incremental ILP from the framework and compare it with the state-of-the-art ILP systems based on ASP(Answer Set Programming)focusing on conflict resolution.The results of comparisons show that our proposed system can generate better-quality rules than most other systems.

PDE Standardization Analysis and Solution of TypicalMechanics Problems

A numerical approach is an effective means of solving boundary value problems(BVPs).This study focuses on physical problems with general partial differential equations(PDEs).It investigates the solution approach through the standard forms of the PDE module in COMSOL.Two typical mechanics problems are exemplified:The deflection of a thin plate,which can be addressed with the dedicated finite element module,and the stress of a pure bending beamthat cannot be tackled.The procedure for the two problems regarding the three standard forms required by the PDE module is detailed.The results were in good agreement with the literature,indicating that the PDE module provides a promising means to solve complex PDEs,especially for those a dedicated finite element module has yet to be developed.

THE LIMITING PROFILE OF SOLUTIONS FOR SEMILINEAR ELLIPTIC SYSTEMS WITH A SHRINKING SELF-FOCUSING CORE

In this paper,we consider the semilinear elliptic equation systems{△u+u=αQ_(n)(x)|u|^(α-2)|v|^(β)u in R^(N),-△v+v=βQ(x)|u|^(α)|v|^(β-2)v in R^(N),where N≥3,α,β>1,α+β<2^(*),2^(*)=2N/N-2 and Q_(n) are bounded given functions whose self-focusing cores{x∈R^(N)|Q_(n)(x)>0} shrink to a set with finitely many points as n→∞.Motivated by the work of Fang and Wang[13],we use variational methods to study the limiting profile of ground state solutions which are concentrated at one point of the set with finitely many points,and we build the localized concentrated bound state solutions for the above equation systems.

Stroke Risk Assessment Decision-Making Using a Machine Learning Model:Logistic-AdaBoost

Stroke is a chronic cerebrovascular disease that carries a high risk.Stroke risk assessment is of great significance in preventing,reversing and reducing the spread and the health hazards caused by stroke.Aiming to objectively predict and identify strokes,this paper proposes a new stroke risk assessment decision-making model named Logistic-AdaBoost(Logistic-AB)based on machine learning.First,the categorical boosting(CatBoost)method is used to perform feature selection for all features of stroke,and 8 main features are selected to form a new index evaluation system to predict the risk of stroke.Second,the borderline synthetic minority oversampling technique(SMOTE)algorithm is applied to transform the unbalanced stroke dataset into a balanced dataset.Finally,the stroke risk assessment decision-makingmodel Logistic-AB is constructed,and the overall prediction performance of this new model is evaluated by comparing it with ten other similar models.The comparison results show that the new model proposed in this paper performs better than the two single algorithms(logistic regression and AdaBoost)on the four indicators of recall,precision,F1 score,and accuracy,and the overall performance of the proposed model is better than that of common machine learning algorithms.The Logistic-AB model presented in this paper can more accurately predict patients’stroke risk.

Existence of Entropy Solution for Degenerate Parabolic-Hyperbolic Problem Involving p(x)-Laplacian with Neumann Boundary Condition

We consider a strongly non-linear degenerate parabolic-hyperbolic problem with p(x)-Laplacian diffusion flux function. We propose an entropy formulation and prove the existence of an entropy solution.

The Spherical q-Linear Diophantine Fuzzy Multiple-Criteria Group Decision-Making Based on Differential Measure

Spherical q-linearDiophantine fuzzy sets(Sq-LDFSs)provedmore effective for handling uncertainty and vagueness in multi-criteria decision-making(MADM).It does not only cover the data in two variable parameters but is also beneficial for three parametric data.By Pythagorean fuzzy sets,the difference is calculated only between two parameters(membership and non-membership).According to human thoughts,fuzzy data can be found in three parameters(membership uncertainty,and non-membership).So,to make a compromise decision,comparing Sq-LDFSs is essential.Existing measures of different fuzzy sets do,however,can have several flaws that can lead to counterintuitive results.For instance,they treat any increase or decrease in the membership degree as the same as the non-membership degree because the uncertainty does not change,even though each parameter has a different implication.In the Sq-LDFSs comparison,this research develops the differentialmeasure(DFM).Themain goal of the DFM is to cover the unfair arguments that come from treating different types of FSs opposing criteria equally.Due to their relative positions in the attribute space and the similarity of their membership and non-membership degrees,two Sq-LDFSs formthis preference connectionwhen the uncertainty remains same in both sets.According to the degree of superiority or inferiority,two Sq-LDFSs are shown as identical,equivalent,superior,or inferior over one another.The suggested DFM’s fundamental characteristics are provided.Based on the newly developed DFM,a unique approach tomultiple criterion group decision-making is offered.Our suggestedmethod verifies the novel way of calculating the expert weights for Sq-LDFSS as in PFSs.Our proposed technique in three parameters is applied to evaluate solid-state drives and choose the optimum photovoltaic cell in two applications by taking uncertainty parameter zero.The method’s applicability and validity shown by the findings are contrasted with those obtained using various other existing approaches.To assess its stability and usefulness,a sensitivity analysis is done.

GLOBAL WEAK SOLUTIONS FOR AN ATTRACTION-REPULSION CHEMOTAXIS SYSTEM WITH p-LAPLACIAN DIFFUSION AND LOGISTIC SOURCE

This paper is concerned with the following attraction-repulsion chemotaxis system with p-Laplacian diffusion and logistic source:■The system here is under a homogenous Neumann boundary condition in a bounded domainΩ ■ R^(n)(n≥2),with χ,ξ,α,β,γ,δ,k_(1),k_(2)> 0,p> 2.In addition,the function f is smooth and satisfies that f(s)≤κ-μs~l for all s≥0,with κ ∈ R,μ> 0,l> 1.It is shown that(ⅰ)if l> max{2k_(1),(2k_(1)n)/(2+n)+1/(p-1)},then system possesses a global bounded weak solution and(ⅱ)if k_(2)> max{2k_(1)-1,(2k_(1)n)/(2+n)+(2-p)/(p-1)} with l> 2,then system possesses a global bounded weak solution.

Hamiltonian system for the inhomogeneous plane elasticity of dodecagonal quasicrystal plates and its analytical solutions

A Hamiltonian system is derived for the plane elasticity problem of two-dimensional dodecagonal quasicrystals by introducing the simple state function. By using symplectic elasticity approach, the analytic solutions of the phonon and phason displacements are obtained further for the quasicrystal plates. In addition, the effectiveness of the approach is verified by comparison with the data of the finite integral transformation method.

On entire solutions of some Fermat type differential-difference equations

On one hand,we study the existence of transcendental entire solutions with finite order of the Fermat type difference equations.On the other hand,we also investigate the existence and growth of solutions of nonlinear differential-difference equations.These results extend and improve some previous in[5,14].

A NovelMethod for Determining Tourism Carrying Capacity in a Decision-Making Context Using q−Rung Orthopair Fuzzy Hypersoft Environment

Tourism is a popular activity that allows individuals to escape their daily routines and explore new destinations for various reasons,including leisure,pleasure,or business.A recent study has proposed a unique mathematical concept called a q−Rung orthopair fuzzy hypersoft set(q−ROFHS)to enhance the formal representation of human thought processes and evaluate tourism carrying capacity.This approach can capture the imprecision and ambiguity often present in human perception.With the advanced mathematical tools in this field,the study has also incorporated the Einstein aggregation operator and score function into the q−ROFHS values to supportmultiattribute decision-making algorithms.By implementing this technique,effective plans can be developed for social and economic development while avoiding detrimental effects such as overcrowding or environmental damage caused by tourism.A case study of selected tourism carrying capacity will demonstrate the proposed methodology.

UAV maneuvering decision-making algorithm based on deep reinforcement learning under the guidance of expert experience

Autonomous umanned aerial vehicle(UAV) manipulation is necessary for the defense department to execute tactical missions given by commanders in the future unmanned battlefield. A large amount of research has been devoted to improving the autonomous decision-making ability of UAV in an interactive environment, where finding the optimal maneuvering decisionmaking policy became one of the key issues for enabling the intelligence of UAV. In this paper, we propose a maneuvering decision-making algorithm for autonomous air-delivery based on deep reinforcement learning under the guidance of expert experience. Specifically, we refine the guidance towards area and guidance towards specific point tasks for the air-delivery process based on the traditional air-to-surface fire control methods.Moreover, we construct the UAV maneuvering decision-making model based on Markov decision processes(MDPs). Specifically, we present a reward shaping method for the guidance towards area and guidance towards specific point tasks using potential-based function and expert-guided advice. The proposed algorithm could accelerate the convergence of the maneuvering decision-making policy and increase the stability of the policy in terms of the output during the later stage of training process. The effectiveness of the proposed maneuvering decision-making policy is illustrated by the curves of training parameters and extensive experimental results for testing the trained policy.

Multi-soliton solutions, breather-like and bound-state solitons for complex modified Korteweg–de Vries equation in optical fibers

Under investigation in this paper is a complex modified Korteweg–de Vries(KdV) equation, which describes the propagation of short pulses in optical fibers. Bilinear forms and multi-soliton solutions are obtained through the Hirota method and symbolic computation. Breather-like and bound-state solitons are constructed in which the signs of the imaginary parts of the complex wave numbers and the initial separations of the two parallel solitons are important factors for the interaction patterns. The periodic structures and position-induced phase shift of some solutions are introduced.

Bifurcation Analysis Reveals Solution Structures of Phase Field Models

The phase field method is playing an increasingly important role in understanding and predicting morphological evolution in materials and biological systems.Here,we develop a new analytical approach based on the bifurcation analysis to explore the mathematical solution structure of phase field models.Revealing such solution structures not only is of great mathematical interest but also may provide guidance to experimentally or computationally uncover new morphological evolution phenomena in materials undergoing electronic and structural phase transitions.To elucidate the idea,we apply this analytical approach to three representative phase field equations:the Allen-Cahn equation,the Cahn-Hilliard equation,and the Allen-Cahn-Ohta-Kawasaki system.The solution structures of these three phase field equations are also verified numerically by the homotopy continuation method.

Enhancing Cybersecurity through Cloud Computing Solutions in the United States

This study investigates how cybersecurity can be enhanced through cloud computing solutions in the United States. The motive for this study is due to the rampant loss of data, breaches, and unauthorized access of internet criminals in the United States. The study adopted a survey research design, collecting data from 890 cloud professionals with relevant knowledge of cybersecurity and cloud computing. A machine learning approach was adopted, specifically a random forest classifier, an ensemble, and a decision tree model. Out of the features in the data, ten important features were selected using random forest feature importance, which helps to achieve the objective of the study. The study’s purpose is to enable organizations to develop suitable techniques to prevent cybercrime using random forest predictions as they relate to cloud services in the United States. The effectiveness of the models used is evaluated by utilizing validation matrices that include recall values, accuracy, and precision, in addition to F1 scores and confusion matrices. Based on evaluation scores (accuracy, precision, recall, and F1 scores) of 81.9%, 82.6%, and 82.1%, the results demonstrated the effectiveness of the random forest model. It showed the importance of machine learning algorithms in preventing cybercrime and boosting security in the cloud environment. It recommends that other machine learning models be adopted to see how to improve cybersecurity through cloud computing.

Investigation of Cavitation in NaCl Solutions in a Sonochemical Reactor Using the Foil Test Method

Ultrasonic baths and sonochemical reactors are widely used in industrial applications dealing with surface cleaningand chemical synthesis. The processes of erosion, cleaning and structuring of the surface can be typically controlledby changing relevant influential parameters. In particular, in this work, we experimentally investigate theeffect of NaCl concentration (0–5.5 mol/L) on the erosion of an aluminum foil under ultrasonic exposure at afrequency of 28 kHz. Special attention is paid to the determination of cavitation zones and their visualizationusing heat maps. It is found that at low NaCl concentration (0.3 mol/L), the foil destruction rate is higher thanin distilled water. At higher concentrations of salt, cavitation takes place mainly in the upper part of the container.