Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

A NovelMethod for Determining Tourism Carrying Capacity in a Decision-Making Context Using q−Rung Orthopair Fuzzy Hypersoft Environment

Tourism is a popular activity that allows individuals to escape their daily routines and explore new destinations for various reasons,including leisure,pleasure,or business.A recent study has proposed a unique mathematical concept called a q−Rung orthopair fuzzy hypersoft set(q−ROFHS)to enhance the formal representation of human thought processes and evaluate tourism carrying capacity.This approach can capture the imprecision and ambiguity often present in human perception.With the advanced mathematical tools in this field,the study has also incorporated the Einstein aggregation operator and score function into the q−ROFHS values to supportmultiattribute decision-making algorithms.By implementing this technique,effective plans can be developed for social and economic development while avoiding detrimental effects such as overcrowding or environmental damage caused by tourism.A case study of selected tourism carrying capacity will demonstrate the proposed methodology.

Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

Orientation and Decision-Making for Soccer Based on Sports Analytics and AI:A Systematic Review

Due to ever-growing soccer data collection approaches and progressing artificial intelligence(AI) methods, soccer analysis, evaluation, and decision-making have received increasing interest from not only the professional sports analytics realm but also the academic AI research community. AI brings gamechanging approaches for soccer analytics where soccer has been a typical benchmark for AI research. The combination has been an emerging topic. In this paper, soccer match analytics are taken as a complete observation-orientation-decision-action(OODA) loop.In addition, as in AI frameworks such as that for reinforcement learning, interacting with a virtual environment enables an evolving model. Therefore, both soccer analytics in the real world and virtual domains are discussed. With the intersection of the OODA loop and the real-virtual domains, available soccer data, including event and tracking data, and diverse orientation and decisionmaking models for both real-world and virtual soccer matches are comprehensively reviewed. Finally, some promising directions in this interdisciplinary area are pointed out. It is claimed that paradigms for both professional sports analytics and AI research could be combined. Moreover, it is quite promising to bridge the gap between the real and virtual domains for soccer match analysis and decision-making.

Ethical Decision-Making Framework Based on Incremental ILP Considering Conflicts

Humans are experiencing the inclusion of artificial agents in their lives,such as unmanned vehicles,service robots,voice assistants,and intelligent medical care.If the artificial agents cannot align with social values or make ethical decisions,they may not meet the expectations of humans.Traditionally,an ethical decision-making framework is constructed by rule-based or statistical approaches.In this paper,we propose an ethical decision-making framework based on incremental ILP(Inductive Logic Programming),which can overcome the brittleness of rule-based approaches and little interpretability of statistical approaches.As the current incremental ILP makes it difficult to solve conflicts,we propose a novel ethical decision-making framework considering conflicts in this paper,which adopts our proposed incremental ILP system.The framework consists of two processes:the learning process and the deduction process.The first process records bottom clauses with their score functions and learns rules guided by the entailment and the score function.The second process obtains an ethical decision based on the rules.In an ethical scenario about chatbots for teenagers’mental health,we verify that our framework can learn ethical rules and make ethical decisions.Besides,we extract incremental ILP from the framework and compare it with the state-of-the-art ILP systems based on ASP(Answer Set Programming)focusing on conflict resolution.The results of comparisons show that our proposed system can generate better-quality rules than most other systems.

Stroke Risk Assessment Decision-Making Using a Machine Learning Model:Logistic-AdaBoost

Stroke is a chronic cerebrovascular disease that carries a high risk.Stroke risk assessment is of great significance in preventing,reversing and reducing the spread and the health hazards caused by stroke.Aiming to objectively predict and identify strokes,this paper proposes a new stroke risk assessment decision-making model named Logistic-AdaBoost(Logistic-AB)based on machine learning.First,the categorical boosting(CatBoost)method is used to perform feature selection for all features of stroke,and 8 main features are selected to form a new index evaluation system to predict the risk of stroke.Second,the borderline synthetic minority oversampling technique(SMOTE)algorithm is applied to transform the unbalanced stroke dataset into a balanced dataset.Finally,the stroke risk assessment decision-makingmodel Logistic-AB is constructed,and the overall prediction performance of this new model is evaluated by comparing it with ten other similar models.The comparison results show that the new model proposed in this paper performs better than the two single algorithms(logistic regression and AdaBoost)on the four indicators of recall,precision,F1 score,and accuracy,and the overall performance of the proposed model is better than that of common machine learning algorithms.The Logistic-AB model presented in this paper can more accurately predict patients’stroke risk.

The Spherical q-Linear Diophantine Fuzzy Multiple-Criteria Group Decision-Making Based on Differential Measure

Spherical q-linearDiophantine fuzzy sets(Sq-LDFSs)provedmore effective for handling uncertainty and vagueness in multi-criteria decision-making(MADM).It does not only cover the data in two variable parameters but is also beneficial for three parametric data.By Pythagorean fuzzy sets,the difference is calculated only between two parameters(membership and non-membership).According to human thoughts,fuzzy data can be found in three parameters(membership uncertainty,and non-membership).So,to make a compromise decision,comparing Sq-LDFSs is essential.Existing measures of different fuzzy sets do,however,can have several flaws that can lead to counterintuitive results.For instance,they treat any increase or decrease in the membership degree as the same as the non-membership degree because the uncertainty does not change,even though each parameter has a different implication.In the Sq-LDFSs comparison,this research develops the differentialmeasure(DFM).Themain goal of the DFM is to cover the unfair arguments that come from treating different types of FSs opposing criteria equally.Due to their relative positions in the attribute space and the similarity of their membership and non-membership degrees,two Sq-LDFSs formthis preference connectionwhen the uncertainty remains same in both sets.According to the degree of superiority or inferiority,two Sq-LDFSs are shown as identical,equivalent,superior,or inferior over one another.The suggested DFM’s fundamental characteristics are provided.Based on the newly developed DFM,a unique approach tomultiple criterion group decision-making is offered.Our suggestedmethod verifies the novel way of calculating the expert weights for Sq-LDFSS as in PFSs.Our proposed technique in three parameters is applied to evaluate solid-state drives and choose the optimum photovoltaic cell in two applications by taking uncertainty parameter zero.The method’s applicability and validity shown by the findings are contrasted with those obtained using various other existing approaches.To assess its stability and usefulness,a sensitivity analysis is done.

UAV maneuvering decision-making algorithm based on deep reinforcement learning under the guidance of expert experience

Autonomous umanned aerial vehicle(UAV) manipulation is necessary for the defense department to execute tactical missions given by commanders in the future unmanned battlefield. A large amount of research has been devoted to improving the autonomous decision-making ability of UAV in an interactive environment, where finding the optimal maneuvering decisionmaking policy became one of the key issues for enabling the intelligence of UAV. In this paper, we propose a maneuvering decision-making algorithm for autonomous air-delivery based on deep reinforcement learning under the guidance of expert experience. Specifically, we refine the guidance towards area and guidance towards specific point tasks for the air-delivery process based on the traditional air-to-surface fire control methods.Moreover, we construct the UAV maneuvering decision-making model based on Markov decision processes(MDPs). Specifically, we present a reward shaping method for the guidance towards area and guidance towards specific point tasks using potential-based function and expert-guided advice. The proposed algorithm could accelerate the convergence of the maneuvering decision-making policy and increase the stability of the policy in terms of the output during the later stage of training process. The effectiveness of the proposed maneuvering decision-making policy is illustrated by the curves of training parameters and extensive experimental results for testing the trained policy.

Review of Fault-tolerant Control for Motor Inverter Failure with Operational Quality Considered

In recent years,motor drive systems have garnered increasing attention due to their high efficiency and superior control performance.This is especially apparent in aerospace,marine propulsion,and electric vehicles,where high performance,efficiency,and reliability are crucial.The ability of the drive system to maintain long-term fault-tolerant control(FTC)operation after a failure is essential.The likelihood of inverter failures surpasses that of other components in the drive system,highlighting its critical importance.Long-term FTC operation ensures the system retains its fundamental functions until safe repairs or replacements can be made.The focus of developing a FTC strategy has shifted from basic FTC operations to enhancing the post-fault quality to accommodate the realities of prolonged operation post-failure.This paper primarily investigates FTC strategies for inverter failures in various motor drive systems over the past decade.These strategies are categorized into three types based on post-fault operational quality:rescue,remedy,and reestablishment.The paper discusses each typical control strategy and its research focus,the strengths and weaknesses of various algorithms,and recent advancements in FTC.Finally,this review summarizes effective FTC techniques for inverter failures in motor drive systems and suggests directions for future research.

A Planning Method for Operational Test of UAV Swarm Based on Mission Reliability

The unmanned aerial vehicle(UAV)swarm plays an increasingly important role in the modern battlefield,and the UAV swarm operational test is a vital means to validate the combat effectiveness of the UAV swarm.Due to the high cost and long duration of operational tests,it is essential to plan the test in advance.To solve the problem of planning UAV swarm operational test,this study considers the multi-stage feature of a UAV swarm mission,composed of launch,flight and combat stages,and proposes a method to find test plans that can maximize mission reliability.Therefore,a multi-stage mission reliability model for a UAV swarm is proposed to ensure successful implementation of the mission.A multi-objective integer optimization method that considers both mission reliability and cost is then formulated to obtain the optimal test plans.This study first constructs a mission reliability model for the UAV swarm in the combat stage.Then,the launch stage and flight stage are integrated to develop a complete PMS(Phased Mission Systems)reliability model.Finally,the Binary Decision Diagrams(BDD)and Multi Objective Quantum Particle Swarm Optimization(MOQPSO)methods are proposed to solve the model.The optimal plans considering both reliability and cost are obtained.The proposed model supports the planning of UAV swarm operational tests and represents a meaningful exploration of UAV swarm test planning.

Novelty of Different Distance Approach for Multi-Criteria Decision-Making Challenges Using q-Rung Vague Sets

In this article,multiple attribute decision-making problems are solved using the vague normal set(VNS).It is possible to generalize the vague set(VS)and q-rung fuzzy set(FS)into the q-rung vague set(VS).A log q-rung normal vague weighted averaging(log q-rung NVWA),a log q-rung normal vague weighted geometric(log q-rung NVWG),a log generalized q-rung normal vague weighted averaging(log Gq-rung NVWA),and a log generalized q-rungnormal vagueweightedgeometric(logGq-rungNVWG)operator are discussed in this article.Adescription is provided of the scoring function,accuracy function and operational laws of the log q-rung VS.The algorithms underlying these functions are also described.A numerical example is provided to extend the Euclidean distance and the Humming distance.Additionally,idempotency,boundedness,commutativity,and monotonicity of the log q-rung VS are examined as they facilitate recognizing the optimal alternative more quickly and help clarify conceptualization.We chose five anemia patients with four types of symptoms including seizures,emotional shock or hysteria,brain cause,and high fever,who had either retrograde amnesia,anterograde amnesia,transient global amnesia,post-traumatic amnesia,or infantile amnesia.Natural numbers q are used to express the results of the models.To demonstrate the effectiveness and accuracy of the models we are investigating,we compare several existing models with those that have been developed.

Improving the operational stability of perovskite solar cells with cesium-doped graphene oxide interlayer

Perovskite solar cells(PSCs)have made great advances in terms of power conversion efficiency(PCE),yet their subpar stability continues to hinder their commercialization.The interface between the perovskite layer and the charge-carrier transporting layers plays a crucial role in undermining the stability of PSCs.In this work,we propose a strategy to stabilize high-performance PSCs with PCE over 23%by introducing a cesium-doped graphene oxide(GO-Cs)as an interlayer between the perovskite and hole-transporting material.The GO-Cs treated PSCs exhibit excellent operational stability with a projected T80(the time where the device PCE reduces to 80%of its initial value)of 2143 h of operation at the maximum powering point under one sun illumination.

Decision-Making and Management of Self-Care in Persons with Traumatic Spinal Cord Injuries: A Preliminary Study

Patients and physicians understand the importance of self-care following spinal cord injury (SCI), yet many individuals with SCI do not adhere to recommended self-care activities despite logistical supports. Neurobehavioral determinants of SCI self-care behavior, such as impulsivity, are not widely studied, yet understanding them could inform efforts to improve SCI self-care. We explored associations between impulsivity and self-care in an observational study of 35 US adults age 18 - 50 who had traumatic SCI with paraplegia at least six months before assessment. The primary outcome measure was self-reported self-care. In LASSO regression models that included all neurobehavioral measures and demographics as predictors of self-care, dispositional measures of greater impulsivity (negative urgency, lack of premeditation, lack of perseverance), and reduced mindfulness were associated with reduced self-care. Outcome (magnitude) sensitivity, a latent decision-making parameter derived from computationally modeling successive choices in a gambling task, was also associated with self-care behavior. These results are preliminary;more research is needed to demonstrate the utility of these findings in clinical settings. Information about associations between impulsivity and poor self-care in people with SCI could guide the development of interventions to improve SCI self-care and help patients with elevated risks related to self-care and secondary health conditions.

Operational optimization of copper flotation process based on the weighted Gaussian process regression and index-oriented adaptive differential evolution algorithm

Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation industrial processes.This paper addresses the fluctuation problem of CCG through an operational optimization method.Firstly,a density-based affinity propagationalgorithm is proposed so that more ideal working condition categories can be obtained for the complex raw ore properties.Next,a Bayesian network(BN)is applied to explore the relationship between the operational variables and the CCG.Based on the analysis results of BN,a weighted Gaussian process regression model is constructed to predict the CCG that a higher prediction accuracy can be obtained.To ensure the predicted CCG is close to the set value with a smaller magnitude of the operation adjustments and a smaller uncertainty of the prediction results,an index-oriented adaptive differential evolution(IOADE)algorithm is proposed,and the convergence performance of IOADE is superior to the traditional differential evolution and adaptive differential evolution methods.Finally,the effectiveness and feasibility of the proposed methods are verified by the experiments on a copper flotation industrial process.

Operational requirements analysis method based on question answering of WEKG

The weapon and equipment operational requirement analysis(WEORA) is a necessary condition to win a future war,among which the acquisition of knowledge about weapons and equipment is a great challenge. The main challenge is that the existing weapons and equipment data fails to carry out structured knowledge representation, and knowledge navigation based on natural language cannot efficiently support the WEORA. To solve above problem, this research proposes a method based on question answering(QA) of weapons and equipment knowledge graph(WEKG) to construct and navigate the knowledge related to weapons and equipment in the WEORA. This method firstly constructs the WEKG, and builds a neutral network-based QA system over the WEKG by means of semantic parsing for knowledge navigation. Finally, the method is evaluated and a chatbot on the QA system is developed for the WEORA. Our proposed method has good performance in the accuracy and efficiency of searching target knowledge, and can well assist the WEORA.

Research on Public Engineering Emergency Decision-Making Based on Multi-Granularity Language Information

To effectively deal with fuzzy and uncertain information in public engineering emergencies,an emergency decision-making method based on multi-granularity language information is proposed.Firstly,decision makers select the appropriate language phrase set according to their own situation,give the preference information of the weight of each key indicator,and then transform the multi-granularity language information through consistency.On this basis,the sequential optimization technology of the approximately ideal scheme is introduced to obtain the weight coefficient of each key indicator.Subsequently,the weighted average operator is used to aggregate the preference information of each alternative scheme with the relative importance of decision-makers and the weight of key indicators in sequence,and the comprehensive evaluation value of each scheme is obtained to determine the optimal scheme.Lastly,the effectiveness and practicability of the method are verified by taking the earthwork collapse accident in the construction of a reservoir as an example.

Holistic Approach to Safety and Operational Stability: Analyzing VVER-1200 Reactor Dynamics in SGTR and AC Power Loss

VVER-1200 (Water-Water Energetic Reactor) represents a significant advancement in nuclear power generation, emphasizing the continuous analysis and enhancement of safety systems for reliable operation. The proposed study focuses on simulating combined scenarios involving steam generator tube rupture (SGTR) and AC power loss using core algorithms and models within personal computer transient analyzer (PCTRAN). Reactor kinetic equations, thermal-hydraulic balance, and safety system models are discussed to elucidate their role in simulating SGTR and AC power loss. Safety criteria, boundaries and initial conditions are outlined to provide a comprehensive understanding of the simulation framework. The analysis delves into dynamic behavior of VVER-1200, placing emphasis on thermal-hydraulic implications, essential reactor parameters, and radiation monitoring to facilitate impact evaluation. Continuous monitoring and maintenance of safety systems are underscored to ensure stable core cooling, particularly during proposed transient conditions. Through meticulous analysis and comparison with established benchmarks, this study contributes to bolstering the safety and reliability of VVER-1200 reactors by identifying vulnerabilities, assessing mitigation strategies, and refining emergency response protocols. Practical implications of this study offer a crucial understanding of reactor behavior, safety system performance, and emergency response strategies, thereby improving safety, optimizing operational practices, and reducing risks in nuclear reactor accidents.

Intelligent decision-making method of TBM operating parameters based on multiple constraints and objective optimization

The decision-making method of tunnel boring machine(TBM)operating parameters has a significant guiding significance for TBM safe and efficient construction,and it has been one of the TBM tunneling research hotspots.For this purpose,this paper introduces an intelligent decision-making method of TBM operating parameters based on multiple constraints and objective optimization.First,linear cutting tests and numerical simulations are used to investigate the physical rules between different cutting parameters(penetration,cutter spacing,etc.)and rock compressive strength.Second,a dual-driven mapping of rock parameters and TBM operating parameters based on data mining and physical rules of rock breaking is established with high accuracy by combining rock-breaking rules and deep neural networks(DNNs).The decision-making method is established by dual-driven mapping,using the effective rock-breaking capacity and the rated value of mechanical parameters as constraints and the total excavation cost as the optimization objective.The best operational parameters can be obtained by searching for the revolutions per minute and penetration that correspond to the extremum of the constrained objective function.The practicability and effectiveness of the developed decision-making model is verified in the SecondWater Source Channel of Hangzhou,China,resulting in the average penetration rate increasing by 11.3%and the total cost decreasing by 10%.

A Blind Spot in the Reframing of a Universe of Possibles: Towards a Suitable Model for Decision-Making Theory and A.I.

Bayesian inference model is an optimal processing of incomplete information that, more than other models, better captures the way in which any decision-maker learns and updates his degree of rational beliefs about possible states of nature, in order to make a better judgment while taking new evidence into account. Such a scientific model proposed for the general theory of decision-making, like all others in general, whether in statistics, economics, operations research, A.I., data science or applied mathematics, regardless of whether they are time-dependent, have in common a theoretical basis that is axiomatized by relying on related concepts of a universe of possibles, especially the so-called universe (or the world), the state of nature (or the state of the world), when formulated explicitly. The issue of where to stand as an observer or a decision-maker to reframe such a universe of possibles together with a partition structure of knowledge (i.e. semantic formalisms), including a copy of itself as it was initially while generalizing it, is not addressed. Memory being the substratum, whether human or artificial, wherein everything stands, to date, even the theoretical possibility of such an operation of self-inclusion is prohibited by pure mathematics. We make this blind spot come to light through a counter-example (namely Archimedes’ Eureka experiment) and explore novel theoretical foundations, fitting better with a quantum form than with fuzzy modeling, to deal with more than a reference universe of possibles. This could open up a new path of investigation for the general theory of decision-making, as well as for Artificial Intelligence, often considered as the science of the imitation of human abilities, while being also the science of knowledge representation and the science of concept formation and reasoning.

Crossing the Achilles Heel of Algorithms:Identifying the Developmental Dilemma of Artificial Intelligence-Assisted Judicial Decision-Making

In the developmental dilemma of artificial intelligence(AI)-assisted judicial decision-making,the technical architecture of AI determines its inherent lack of transparency and interpretability,which is challenging to fundamentally improve.This can be considered a true challenge in the realm of AI-assisted judicial decision-making.By examining the court’s acceptance,integration,and trade-offs of AI technology embedded in the judicial field,the exploration of potential conflicts,interactions,and even mutual shaping between the two will not only reshape their conceptual connotations and intellectual boundaries but also strengthen the cognition and re-interpretation of the basic principles and core values of the judicial trial system.