Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

New direction for surgery:Super minimally invasive surgery

The top goal of modern medicine is treating disease without destroying organ structures and making patients as healthy as they were before their sickness.Minimally invasive surgery(MIS)has dominated the surgical realm because of its lesser invasiveness.However,changes in anatomical structures of the body and reconstruction of internal organs or different organs are common after traditional surgery or MIS,decreasing the quality of life of patients post-operation.Thus,I propose a new treatment mode,super MIS(SMIS),which is defined as“curing a disease or lesion which used to be treated by MIS while preserving the integrity of the organs”.In this study,I describe the origin,definition,operative channels,advantages,and future perspectives of SMIS.

Orientation and Decision-Making for Soccer Based on Sports Analytics and AI:A Systematic Review

Due to ever-growing soccer data collection approaches and progressing artificial intelligence(AI) methods, soccer analysis, evaluation, and decision-making have received increasing interest from not only the professional sports analytics realm but also the academic AI research community. AI brings gamechanging approaches for soccer analytics where soccer has been a typical benchmark for AI research. The combination has been an emerging topic. In this paper, soccer match analytics are taken as a complete observation-orientation-decision-action(OODA) loop.In addition, as in AI frameworks such as that for reinforcement learning, interacting with a virtual environment enables an evolving model. Therefore, both soccer analytics in the real world and virtual domains are discussed. With the intersection of the OODA loop and the real-virtual domains, available soccer data, including event and tracking data, and diverse orientation and decisionmaking models for both real-world and virtual soccer matches are comprehensively reviewed. Finally, some promising directions in this interdisciplinary area are pointed out. It is claimed that paradigms for both professional sports analytics and AI research could be combined. Moreover, it is quite promising to bridge the gap between the real and virtual domains for soccer match analysis and decision-making.

Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

Ethical Decision-Making Framework Based on Incremental ILP Considering Conflicts

Humans are experiencing the inclusion of artificial agents in their lives,such as unmanned vehicles,service robots,voice assistants,and intelligent medical care.If the artificial agents cannot align with social values or make ethical decisions,they may not meet the expectations of humans.Traditionally,an ethical decision-making framework is constructed by rule-based or statistical approaches.In this paper,we propose an ethical decision-making framework based on incremental ILP(Inductive Logic Programming),which can overcome the brittleness of rule-based approaches and little interpretability of statistical approaches.As the current incremental ILP makes it difficult to solve conflicts,we propose a novel ethical decision-making framework considering conflicts in this paper,which adopts our proposed incremental ILP system.The framework consists of two processes:the learning process and the deduction process.The first process records bottom clauses with their score functions and learns rules guided by the entailment and the score function.The second process obtains an ethical decision based on the rules.In an ethical scenario about chatbots for teenagers’mental health,we verify that our framework can learn ethical rules and make ethical decisions.Besides,we extract incremental ILP from the framework and compare it with the state-of-the-art ILP systems based on ASP(Answer Set Programming)focusing on conflict resolution.The results of comparisons show that our proposed system can generate better-quality rules than most other systems.

Preventing brain aging by the artificial enforcement of the unfolded protein response:future directions

As the life expectancy of the world’s population increases,age-related diseases are emerging as one of the greatest problems facing modern society.The onset of dementia and neurodegenerative diseases is strictly dependent on aging as a major risk factor and has a profound impact on various aspects of the lives of individuals and their families.

Stroke Risk Assessment Decision-Making Using a Machine Learning Model:Logistic-AdaBoost

Stroke is a chronic cerebrovascular disease that carries a high risk.Stroke risk assessment is of great significance in preventing,reversing and reducing the spread and the health hazards caused by stroke.Aiming to objectively predict and identify strokes,this paper proposes a new stroke risk assessment decision-making model named Logistic-AdaBoost(Logistic-AB)based on machine learning.First,the categorical boosting(CatBoost)method is used to perform feature selection for all features of stroke,and 8 main features are selected to form a new index evaluation system to predict the risk of stroke.Second,the borderline synthetic minority oversampling technique(SMOTE)algorithm is applied to transform the unbalanced stroke dataset into a balanced dataset.Finally,the stroke risk assessment decision-makingmodel Logistic-AB is constructed,and the overall prediction performance of this new model is evaluated by comparing it with ten other similar models.The comparison results show that the new model proposed in this paper performs better than the two single algorithms(logistic regression and AdaBoost)on the four indicators of recall,precision,F1 score,and accuracy,and the overall performance of the proposed model is better than that of common machine learning algorithms.The Logistic-AB model presented in this paper can more accurately predict patients’stroke risk.

Research on Maneuver Decision-Making of Multi-Agent Adversarial Game in a Random Interference Environment

The strategy evolution process of game players is highly uncertain due to random emergent situations and other external disturbances.This paper investigates the issue of strategy interaction and behavioral decision-making among game players in simulated confrontation scenarios within a random interference environment.It considers the possible risks that random disturbances may pose to the autonomous decision-making of game players,as well as the impact of participants’manipulative behaviors on the state changes of the players.A nonlinear mathematical model is established to describe the strategy decision-making process of the participants in this scenario.Subsequently,the strategy selection interaction relationship,strategy evolution stability,and dynamic decision-making process of the game players are investigated and verified by simulation experiments.The results show that maneuver-related parameters and random environmental interference factors have different effects on the selection and evolutionary speed of the agent’s strategies.Especially in a highly uncertain environment,even small information asymmetry or miscalculation may have a significant impact on decision-making.This also confirms the feasibility and effectiveness of the method proposed in the paper,which can better explain the behavioral decision-making process of the agent in the interaction process.This study provides feasibility analysis ideas and theoretical references for improving multi-agent interactive decision-making and the interpretability of the game system model.

Ascertaining the influences of auxiliary qubits on the Einstein–Podolsky–Rosen steering and its directions

Einstein–Podolsky–Rosen(EPR) steering is an example of nontrivial quantum nonlocality and characteristic in the non-classical world.The directivity(or asymmetry) is a fascinating trait of EPR steering,and it is different from other quantum nonlocalities.Here,we consider the strategy in which two atoms compose a two-qubit X state,and the two atoms are owned by Alice and Bob,respectively.The atom of Alice suffers from a reservoir,and the atom of Bob couples with a bit flip channel.The influences of auxiliary qubits on EPR steering and its directions are revealed by means of the entropy uncertainty relation.The results indicate that EPR steering declines with growing time t when adding fewer auxiliary qubits.The EPR steering behaves as damped oscillation when introducing more auxiliary qubits in the strong coupling regime.In the weak coupling regime,the EPR steering monotonously decreases as t increases when coupling auxiliary qubits.The increases in auxiliary qubits are responsible for the fact that the steerability from Alice to Bob(or from Bob to Alice) can be more effectively revealed.Notably,the introductions of more auxiliary qubits can change the situation that steerability from Alice to Bob is certain to a situation in which steerability from Bob to Alice is certain.

Determination of the best materials for development and designing product using a multi-criteria decision-making

Purpose–Material selection,driven by wide and often conflicting objectives,is an important,sometimes difficult problem in material engineering.In this context,multi-criteria decision-making(MCDM)methodologies are effective.An approach of MCDM is needed to cater to criteria of material assortment simultaneously.More firms are now concerned about increasing their productivity using mathematical tools.To occupy a gap in the previous literature this research recommends an integrated MCDM and mathematical Bi-objective model for the selection of material.In addition,by using the Technique for Order Preference by Similarity to Ideal Solution(TOPSIS),the inherent ambiguities of decision-makers in paired evaluations are considered in this research.It goes on to construct a mathematical bi-objective model for determining the best item to purchase.Design/methodology/approach–The entropy perspective is implemented in this paper to evaluate the weight parameters,while the TOPSIS technique is used to determine the best and worst intermediate pipe materials for automotive exhaust system.The intermediate pipes are used to join the components of the exhaust systems.The materials usually used to manufacture intermediate pipe are SUS 436LM,SUS 430,SUS 304,SUS 436L,SUH 409 L,SUS 441 L and SUS 439L.These seven materials are evaluated based on tensile strength(TS),hardness(H),elongation(E),yield strength(YS)and cost(C).A hybrid methodology combining entropy-based criteria weighting,with the TOPSIS for alternative ranking,is pursued to identify the optimal design material for an engineered application in this paper.This study aims to help while filling the information gap in selecting the most suitable material for use in the exhaust intermediate pipes.After that,the authors searched for and considered eight materials and evaluated them on the following five criteria:(1)TS,(2)YS,(3)H,(4)E and(5)C.The first two criteria have been chosen because they can have a lot of influence on the behavior of the exhaust intermediate pipes,on their performance and on the cost.In this structure,the weights of the criteria are calculated objectively through the entropy method in order to have an unbiased assessment.This essentially measures the quantity of information each criterion contribution,indicating the relative importance of these criteria better.Subsequently,the materials were ranked using the TOPSIS method in terms of their relative performance by measuring each material from an ideal solution to determine the best alternative.The results show that SUS 309,SUS 432L and SUS 436 LM are the first three materials that the exhaust intermediate pipe optimal design should consider.Findings–The material matrix of the decision presented in Table 3 was normalized through Equation 5,as shown in Table 5,and the matrix was multiplied with weighting criteriaß_j.The obtained weighted normalized matrix V_ij is presented in Table 6.However,the ideal,worst and best value was ascertained by employing Equation 7.This study is based on the selection of material for the development of intermediate pipe using MCDM,and it involves four basic stages,i.e.method of translation criteria,screening process,method of ranking and search for methods.The selection was done through the TOPSIS method,and the criteria weight was obtained by the entropy method.The result showed that the top three materials are SUS 309,SUS 432L and SUS 436 LM,respectively.For the future work,it is suggested to select more alternatives and criteria.The comparison can also be done by using different MCDM techniques like and Choice Expressing Reality(ELECTRE),Decision-Making Trial and Evaluation Laboratory(DEMATEL)and Preference Ranking Organization Method for Enrichment Evaluation(PROMETHEE).Originality/value–The results provide important conclusions for material selection in this targeted application,verifying the employment of mutual entropy-TOPSIS methodology for a series of difficult engineering decisions in material engineering concepts that combine superior capacity with better performance as well as cost-efficiency in various engineering design.

The Spherical q-Linear Diophantine Fuzzy Multiple-Criteria Group Decision-Making Based on Differential Measure

Spherical q-linearDiophantine fuzzy sets(Sq-LDFSs)provedmore effective for handling uncertainty and vagueness in multi-criteria decision-making(MADM).It does not only cover the data in two variable parameters but is also beneficial for three parametric data.By Pythagorean fuzzy sets,the difference is calculated only between two parameters(membership and non-membership).According to human thoughts,fuzzy data can be found in three parameters(membership uncertainty,and non-membership).So,to make a compromise decision,comparing Sq-LDFSs is essential.Existing measures of different fuzzy sets do,however,can have several flaws that can lead to counterintuitive results.For instance,they treat any increase or decrease in the membership degree as the same as the non-membership degree because the uncertainty does not change,even though each parameter has a different implication.In the Sq-LDFSs comparison,this research develops the differentialmeasure(DFM).Themain goal of the DFM is to cover the unfair arguments that come from treating different types of FSs opposing criteria equally.Due to their relative positions in the attribute space and the similarity of their membership and non-membership degrees,two Sq-LDFSs formthis preference connectionwhen the uncertainty remains same in both sets.According to the degree of superiority or inferiority,two Sq-LDFSs are shown as identical,equivalent,superior,or inferior over one another.The suggested DFM’s fundamental characteristics are provided.Based on the newly developed DFM,a unique approach tomultiple criterion group decision-making is offered.Our suggestedmethod verifies the novel way of calculating the expert weights for Sq-LDFSS as in PFSs.Our proposed technique in three parameters is applied to evaluate solid-state drives and choose the optimum photovoltaic cell in two applications by taking uncertainty parameter zero.The method’s applicability and validity shown by the findings are contrasted with those obtained using various other existing approaches.To assess its stability and usefulness,a sensitivity analysis is done.

Bioinspired directional structures for inhibiting wetting on super-melt-philic surfaces above 1200°C

Over the past two decades,superhydrophobic surfaces that are easily created have aroused considerable attention for their superior performances in various applications at room temperature.Nowadays,there is a growing demand in special fields for the development of surfaces that can resist wetting by high-temperature molten droplets(>1200°C)using facile design and fabrication strategies.Herein,bioinspired directional structures(BDSs)were prepared on Y2O3-stabilized ZrO2(YSZ)surfaces using femtosecond laser ablation.Benefiting from the anisotropic energy barriers,the BDSs featured with no additional modifiers showed a remarkable increase from 9.2°to 60°in the contact angle of CaO–MgO–Al2O3–SiO2(CMAS)melt and a 70.1%reduction in the spreading area of CMAS at 1250°C,compared with polished super-CMAS-melt-philic YSZ surfaces.Moreover,the BDSs demonstrated exceptional wetting inhibition even at 1400°C,with an increase from 3.3°to 31.3°in contact angle and a 67.9%decrease in spreading area.This work provides valuable insight and a facile preparation strategy for effectively inhibiting the wetting of molten droplets on super-melt-philic surfaces at extremely high temperatures.

Study of the pressure transient behavior of directional wells considering the effect of non-uniform flux distribution

During the production,the fluid in the vicinity of the directional well enters the wellbore with different rates,leading to non-uniform flux distribution along the directional well.However,in all existing studies,it is oversimplified to a uniform flux distribution,which can result in inaccurate results for field applications.Therefore,this paper proposes a semi-analytical model of a directional well based on the assumption of non-uniform flux distribution.Specifically,the direction well is discretized into a carefully chosen series of linear sources,such that the complex well trajectory can be captured and the nonuniform flux distribution along the wellbore can be considered to model the three-dimensional flow behavior.By using the finite difference method,we can obtain the numerical solutions of the transient flow within the wellbore.With the aid of Green's function method,we can obtain the analytical solutions of the transient flow from the matrix to the wellbore.The complete flow behavior of a directional well is perfectly represented by coupling the above two types of transient flow.Subsequently,on the basis of the proposed model,we conduct a comprehensive analysis of the pressure transient behavior of a directional well.The computation results show that the flux variation along the direction well has a significant effect on pressure responses.In addition,the directional well in an infinite reservoir may exhibit the following flow regimes:wellbore afterflow,transition flow,inclined radial flow,elliptical flow,horizontal linear flow,and horizontal radial flow.The horizontal linear flow can be observed only if the formation thickness is much smaller than the well length.Furthermore,a dip region that appears on the pressure derivative curve indicates the three-dimensional flow behavior near the wellbore.

MSD-Net: Pneumonia Classification Model Based on Multi-Scale Directional Feature Enhancement

Computer-aided diagnosis of pneumonia based on deep learning is a research hotspot.However,there are some problems that the features of different sizes and different directions are not sufficient when extracting the features in lung X-ray images.A pneumonia classification model based on multi-scale directional feature enhancement MSD-Net is proposed in this paper.The main innovations are as follows:Firstly,the Multi-scale Residual Feature Extraction Module(MRFEM)is designed to effectively extract multi-scale features.The MRFEM uses dilated convolutions with different expansion rates to increase the receptive field and extract multi-scale features effectively.Secondly,the Multi-scale Directional Feature Perception Module(MDFPM)is designed,which uses a three-branch structure of different sizes convolution to transmit direction feature layer by layer,and focuses on the target region to enhance the feature information.Thirdly,the Axial Compression Former Module(ACFM)is designed to perform global calculations to enhance the perception ability of global features in different directions.To verify the effectiveness of the MSD-Net,comparative experiments and ablation experiments are carried out.In the COVID-19 RADIOGRAPHY DATABASE,the Accuracy,Recall,Precision,F1 Score,and Specificity of MSD-Net are 97.76%,95.57%,95.52%,95.52%,and 98.51%,respectively.In the chest X-ray dataset,the Accuracy,Recall,Precision,F1 Score and Specificity of MSD-Net are 97.78%,95.22%,96.49%,95.58%,and 98.11%,respectively.This model improves the accuracy of lung image recognition effectively and provides an important clinical reference to pneumonia Computer-Aided Diagnosis.

A NovelMethod for Determining Tourism Carrying Capacity in a Decision-Making Context Using q−Rung Orthopair Fuzzy Hypersoft Environment

Tourism is a popular activity that allows individuals to escape their daily routines and explore new destinations for various reasons,including leisure,pleasure,or business.A recent study has proposed a unique mathematical concept called a q−Rung orthopair fuzzy hypersoft set(q−ROFHS)to enhance the formal representation of human thought processes and evaluate tourism carrying capacity.This approach can capture the imprecision and ambiguity often present in human perception.With the advanced mathematical tools in this field,the study has also incorporated the Einstein aggregation operator and score function into the q−ROFHS values to supportmultiattribute decision-making algorithms.By implementing this technique,effective plans can be developed for social and economic development while avoiding detrimental effects such as overcrowding or environmental damage caused by tourism.A case study of selected tourism carrying capacity will demonstrate the proposed methodology.

Effects of cooling rate on microstructure and microhardness of directionally solidified Galvalume alloy

The influences of cooling rate on the phase constitution,microstructural length scale,and microhardness of directionally solidified Galvalume(Zn-55Al-1.6Si)alloy were investigated by directional solidification experiments at different withdrawal speeds(5,10,20,50,100,200,and 400μm·s^(-1)).The results show that the microstructure of directionally solidified Galvalume alloys is composed of primary Al dendrites,Si-rich phase and(Zn-Al-Si)ternary eutectics at the withdrawal speed ranging from 5 to 400μm·s^(-1).As the withdrawal speed increases,the segregation of Si element intensifies,resulting in an increase in the area fraction of the Si-rich phase.In addition,the primary Al dendrites show significant refinement with an increase in the withdrawal speed.The relationship between the primary dendrite arm spacing(λ_(1))and the thermal parameters of solidification is obtained:λ_(1)=127.3V^(-0.31).Moreover,as the withdrawal speed increases from 5 to 400μm·s^(-1),the microhardness of the alloy increases from 90 HV to 151 HV.This is a combined effect of grain refinement and second-phase strengthening.

UAV maneuvering decision-making algorithm based on deep reinforcement learning under the guidance of expert experience

Autonomous umanned aerial vehicle(UAV) manipulation is necessary for the defense department to execute tactical missions given by commanders in the future unmanned battlefield. A large amount of research has been devoted to improving the autonomous decision-making ability of UAV in an interactive environment, where finding the optimal maneuvering decisionmaking policy became one of the key issues for enabling the intelligence of UAV. In this paper, we propose a maneuvering decision-making algorithm for autonomous air-delivery based on deep reinforcement learning under the guidance of expert experience. Specifically, we refine the guidance towards area and guidance towards specific point tasks for the air-delivery process based on the traditional air-to-surface fire control methods.Moreover, we construct the UAV maneuvering decision-making model based on Markov decision processes(MDPs). Specifically, we present a reward shaping method for the guidance towards area and guidance towards specific point tasks using potential-based function and expert-guided advice. The proposed algorithm could accelerate the convergence of the maneuvering decision-making policy and increase the stability of the policy in terms of the output during the later stage of training process. The effectiveness of the proposed maneuvering decision-making policy is illustrated by the curves of training parameters and extensive experimental results for testing the trained policy.

Stability assessment of tree ring growth of Pinus armandii Franch in response to climate change based on slope directions at the Lubanling in the Funiu Mountains,China

Global warming will affect growth strategies and how trees will adapt.To compare the response of tree radial growth to climate warming in different slope directions,samples of Pinus armandii Franch were collected and treering chronologies developed on northern and western slopes from the Lubanling in the Funiu Mountains.Correlation analyses showed that two chronologies were mainly limited by temperatures in the previous June–August and the combination of temperatures and moisture in the current May–July.The difference of the climate response to slopes was small but not negligible.Radial growth of the LBL01 site on the northern slope was affected by the combined maximum and minimum temperatures,while that of the LBL02 site was affected by maximum temperatures.With regards to moisture,radial growth of the trees on the north slope was influenced by the relative humidity in the current May–July,while on the western slope,it was affected by the relative humidity in the previous June–August,the current May–July and the precipitation in the current May–July.With the change in climate,the effects of the main limiting factors on growth on different slopes were visible to a certain extent,but the differences in response of trees on different slopes gradually decreased,which might be caused by factors such as different slope directions and the change in diurnal temperature range.These results may provide information for forest protection and ecological construction in this region,and a scientific reference for future climate reconstruction.

Stability assessment of tree ring growth of Pinus armandii Franch in response to climate change based on slope directions at the Lubanling in the Funiu Mountains,China

Global warming will affect growth strategies and how trees will adapt.To compare the response of tree radial growth to climate warming in different slope directions,samples of Pinus armandii Franch were collected and tree-ring chronologies developed on northern and western slopes from the Lubanling in the Funiu Mountains.Correlation analyses showed that two chronologies were mainly limited by temperatures in the previous June-August and the com-bination of temperatures and moisture in the current May-July.The difference of the climate response to slopes was small but not negligible.Radial growth of the LBLO1 site on the northern slope was affected by the combined maximum and minimum temperatures,while that of the LBLO2 site was affected by maximum temperatures.With regards to moisture,radial growth of the trees on the north slope was influenced by the relative humidity in the current May-July,while on the western slope,it was affected by the relative humidity in the previous June-August,the current May-July and the precipitation in the current May-July.With the change in climate,the effects of the main limiting factors on growth on different slopes were visible to a certain extent,but the differences in response of trees on different slopes gradually decreased,which might be caused by factors such as different slope directions and the change in diurnal temperature range.These results may provide information for forest protection and ecological construction in this region,and a scientific reference for future climate reconstruction.

Numerical simulation on directional solidification and heat treatment processes of turbine blades

Study on turbine blades is crucial due to their critical role in ensuring the efficient and reliable operation of aircraft engines.Nickel-based single crystal superalloys are extensively used in the hot manufacturing of turbine blades due to their exceptional high-temperature mechanical properties.The hot manufacturing of single crystal blades involves directional solidification and heat treatment.Experimental manufacturing of these blades is time-consuming,capital-intensive,and often insufficient to meet industrial demands.Numerical simulation techniques have gained widespread acceptance in blade manufacturing research due to their low energy consumption,high efficiency,and rapid turnaround time.This article introduces the modeling and simulation of hot manufacturing in single crystal blades.The discussion outlines the prevalent mathematical models employed in numerical simulations related to blade hot manufacturing.It encapsulates the advancements in research concerning macro to micro-level numerical simulation techniques for directional solidification and heat treatment processes.Furthermore,potential future trajectories for the numerical simulation of single crystal blade hot manufacturing are also discussed.